[2025-09-15T04:01:14.824583] [INFO ] [MAIN ] Using last completed trading day: 2025-09-12 [2025-09-15T04:01:14.825220] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-09-15T04:01:14.825292] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-09-15T04:01:14.826314] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-09-15T04:01:14.826387] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-09-15T04:01:15.179030] [INFO ] [REMOTE ] IBM: Fetching primary data covering 150 trading days from 2025-02-07 to 2025-09-12 (requires 8 months of data pull). [2025-09-15T04:01:15.179402] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-09-15T04:01:17.357613] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-15T04:01:17.368063] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-09-15T04:01:19.461448] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-15T04:01:19.473468] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-09-15T04:01:22.015240] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-09-15T04:01:22.026509] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-09-15T04:01:24.273716] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-15T04:01:24.285986] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-09-15T04:01:26.587191] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-15T04:01:26.598276] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-09-15T04:01:29.042362] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-15T04:01:29.055596] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-09-15T04:01:31.255286] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-15T04:01:31.267287] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-09-15T04:01:33.542137] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-15T04:01:33.569686] [INFO ] [REMOTE ] IBM: Full fetch complete (58282 records). [2025-09-15T04:01:33.569951] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-09-15T04:01:33.961178] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-09-15T04:01:33.961446] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-09-15T04:01:33.963448] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-09-15T04:01:33.963543] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-09-15T04:01:33.968109] [DEBUG] [LOCAL ] IBM: Trimmed 58282 records to 40393 (keeping 150 days of data) [2025-09-15T04:01:34.289190] [DEBUG] [LOCAL ] IBM: Primary data saved (40393 records). [2025-09-15T04:01:34.289434] [INFO ] [MAIN ] IBM: Full history saved. [2025-09-15T04:01:34.290032] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-09-15T04:01:34.349493] [DEBUG] [LOCAL ] IBM: Loaded 40393 existing records from primary storage. [2025-09-15T04:01:34.349736] [INFO ] [MAIN ] IBM: Loaded 40393 primary data records. [2025-09-15T04:01:34.635458] [DEBUG] [MAIN ] IBM: Filtered 5251 bins outside market hours, 5862 incomplete bins [2025-09-15T04:01:34.636304] [INFO ] [MAIN ] IBM: Generated 1352 derivative records from 40393 primary records. [2025-09-15T04:01:34.636391] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-09-15T04:01:34.648710] [DEBUG] [LOCAL ] IBM: Derivative data saved (1352 records). [2025-09-15T04:01:34.648789] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-09-15T17:00:01.582544] [INFO ] [MAIN ] Using last completed trading day: 2025-09-15 [2025-09-15T17:00:01.582790] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-15T17:00:01.582886] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-15T17:00:01.582965] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-15T17:00:03.273153] [DEBUG] [SYMBOL ] Found 2421 valid NYSE symbols. [2025-09-15T17:00:03.273359] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-15T17:00:03.273590] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-15T17:00:03.274533] [INFO ] [LOCAL ] Symbols cache updated with 2369 symbols. [2025-09-15T17:00:03.274585] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-15T17:00:03.274617] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-15T17:00:03.274700] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-15T17:00:03.274869] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-15T17:00:03.275252] [DEBUG] [LOCAL ] Found 2369 symbols in cached list. [2025-09-15T17:00:03.275290] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-15T17:00:03.275480] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-15T17:00:03.275540] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2369 valid symbols. [2025-09-15T17:00:03.275579] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-15T17:00:03.275611] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-15T17:00:03.298471] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/ARGD.csv (symbol ARGD no longer active). [2025-09-15T17:00:03.303539] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-15T17:00:03.325718] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/derivative_storage/ARGD.csv (symbol ARGD no longer active). [2025-09-15T17:00:03.332890] [INFO ] [LOCAL ] Deleted 2 obsolete data files. [2025-09-15T17:00:03.333031] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-15T17:00:03.333093] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-15T17:00:03.333145] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-15T17:00:03.333587] [WARN ] [STATE ] State set to: RUNNING [2025-09-15T17:00:03.333821] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-15T17:00:03.334691] [DEBUG] [LOCAL ] Found 2369 symbols in cached list. [2025-09-15T17:00:03.334762] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-15T17:00:03.334820] [INFO ] [MAIN ] Starting incremental update for 2369 symbols. [2025-09-15T17:00:03.334869] [INFO ] [MAIN ] Running in parallel mode [2025-09-15T17:00:03.335151] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2369 symbols [2025-09-15T17:00:03.885350] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:03.996868] [INFO ] [MAIN ] AACT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:04.071988] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:04.132553] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:04.133902] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-09-15T17:00:04.133956] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-09-15T17:00:04.134169] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-09-15T17:00:04.134231] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-15T17:00:04.140668] [DEBUG] [LOCAL ] AACT: Loaded 8258 existing records from primary storage. [2025-09-15T17:00:04.140342] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-15T17:00:04.140871] [INFO ] [MAIN ] AACT: Loaded 8258 existing records. [2025-09-15T17:00:04.146177] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-09-15T17:00:04.562441] [WARN ] [MAIN ] AACT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:04.599990] [DEBUG] [LOCAL ] A: Loaded 38079 existing records from primary storage. [2025-09-15T17:00:04.617899] [INFO ] [MAIN ] AACT: Wiping existing primary data before full refresh. [2025-09-15T17:00:04.638145] [INFO ] [LOCAL ] AACT: Starting deletion of primary data. [2025-09-15T17:00:04.617739] [INFO ] [MAIN ] A: Loaded 38079 existing records. [2025-09-15T17:00:04.661282] [DEBUG] [LOCAL ] AACT: Deleted primary data file. [2025-09-15T17:00:04.739716] [DEBUG] [LOCAL ] AA: Loaded 40362 existing records from primary storage. [2025-09-15T17:00:04.738556] [INFO ] [MAIN ] AACT: Starting full primary refresh. [2025-09-15T17:00:04.781179] [INFO ] [MAIN ] AA: Loaded 40362 existing records. [2025-09-15T17:00:05.195889] [INFO ] [REMOTE ] AAM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:05.250850] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:05.257744] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-09-15T17:00:05.292619] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-09-15T17:00:05.377299] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-09-15T17:00:05.377731] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:05.432234] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-09-15T17:00:05.416120] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-09-15T17:00:05.450117] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-09-15T17:00:05.469285] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-09-15T17:00:05.505381] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-09-15T17:00:05.535170] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-09-15T17:00:05.825818] [INFO ] [REMOTE ] AACT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:05.854371] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-02. [2025-09-15T17:00:05.868581] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-15T17:00:05.882220] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-09-15T17:00:06.237334] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-15T17:00:06.260631] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-03. [2025-09-15T17:00:06.447526] [INFO ] [REMOTE ] AA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:06.451116] [INFO ] [REMOTE ] A: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:06.447727] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-15T17:00:06.451511] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-09-15T17:00:06.453776] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-09-15T17:00:06.452672] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-09-15T17:00:06.804506] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-15T17:00:06.805592] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-09-15T17:00:06.849256] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-15T17:00:06.851050] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-04. [2025-09-15T17:00:07.091736] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-15T17:00:07.093021] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-09-15T17:00:07.377306] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-15T17:00:07.378517] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-09-15T17:00:07.478059] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-15T17:00:07.480956] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-05. [2025-09-15T17:00:07.646731] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-09-15T17:00:07.647759] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-09-15T17:00:08.025569] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-15T17:00:08.035855] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-09-15T17:00:08.244973] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-15T17:00:08.248861] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-06. [2025-09-15T17:00:08.317856] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-15T17:00:08.319419] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-09-15T17:00:08.359723] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-15T17:00:08.370721] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-09-15T17:00:08.746618] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-15T17:00:08.750491] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-07. [2025-09-15T17:00:08.755853] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-15T17:00:08.756707] [INFO ] [REMOTE ] AAM: Full fetch complete (708 records). [2025-09-15T17:00:08.756818] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-09-15T17:00:08.954015] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 139 unique days, need 150 days [2025-09-15T17:00:08.954251] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:00:08.954320] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:00:08.954378] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-15T17:00:08.954453] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-15T17:00:08.954504] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-09-15T17:00:08.954553] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-09-15T17:00:08.954678] [INFO ] [MAIN ] Update Progress: 1/2369 symbols completed. AAM took 5.5s. Estimated remaining: 3h 41m 47s. Rate: 10.7 symbols/min [2025-09-15T17:00:09.140482] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:09.162805] [DEBUG] [LOCAL ] AAMI: Loaded 18336 existing records from primary storage. [2025-09-15T17:00:09.162968] [INFO ] [MAIN ] AAMI: Loaded 18336 existing records. [2025-09-15T17:00:09.350114] [WARN ] [MAIN ] AAMI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:09.350397] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-09-15T17:00:09.350456] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-15T17:00:09.351015] [DEBUG] [LOCAL ] AAMI: Deleted primary data file. [2025-09-15T17:00:09.351073] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-09-15T17:00:09.547902] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-15T17:00:09.656008] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-08. [2025-09-15T17:00:09.777744] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:09.778208] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-09-15T17:00:09.813387] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-15T17:00:09.824108] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-09-15T17:00:09.986857] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T17:00:09.998833] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-09-15T17:00:10.397466] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-15T17:00:10.401219] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-09. [2025-09-15T17:00:10.426763] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-15T17:00:10.431063] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-09-15T17:00:11.239942] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-15T17:00:11.245078] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-09-15T17:00:11.252046] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-15T17:00:11.254337] [INFO ] [REMOTE ] AACT: Full fetch complete (9479 records). [2025-09-15T17:00:11.254433] [DEBUG] [VALIDATOR ] AACT: Validating primary data. [2025-09-15T17:00:11.642664] [DEBUG] [VALIDATOR ] AACT: All expected trading days are present. [2025-09-15T17:00:11.642814] [DEBUG] [VALIDATOR ] AACT: Primary data validation passed. [2025-09-15T17:00:11.643048] [INFO ] [MAIN ] AACT: Fetched primary data is valid. [2025-09-15T17:00:11.643154] [DEBUG] [LOCAL ] AACT: Saving primary data. [2025-09-15T17:00:11.643883] [DEBUG] [LOCAL ] AACT: Trimmed 9479 records to 7894 (keeping 150 days of data) [2025-09-15T17:00:11.696749] [DEBUG] [LOCAL ] AACT: Primary data saved (7894 records). [2025-09-15T17:00:11.696971] [INFO ] [MAIN ] AACT: Full history saved. [2025-09-15T17:00:11.697545] [INFO ] [MAIN ] Update Progress: 2/2369 symbols completed. AACT took 8.3s. Estimated remaining: 2h 44m 57s. Rate: 14.3 symbols/min [2025-09-15T17:00:11.849001] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-15T17:00:11.925272] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-09-15T17:00:11.924954] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:12.049057] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-15T17:00:12.062162] [DEBUG] [LOCAL ] AAP: Loaded 39164 existing records from primary storage. [2025-09-15T17:00:12.062795] [INFO ] [MAIN ] AAP: Loaded 39164 existing records. [2025-09-15T17:00:12.111227] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-09-15T17:00:12.272684] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:12.273191] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-09-15T17:00:12.273267] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-09-15T17:00:12.282345] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-09-15T17:00:12.297762] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-09-15T17:00:12.305907] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-15T17:00:12.417773] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-09-15T17:00:12.777280] [INFO ] [REMOTE ] AAP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:12.777700] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-09-15T17:00:14.154158] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-15T17:00:14.160592] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-09-15T17:00:14.549740] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-09-15T17:00:14.561537] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-09-15T17:00:14.693143] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-09-15T17:00:14.707598] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-09-15T17:00:14.874071] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-15T17:00:14.883988] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-09-15T17:00:15.661222] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-15T17:00:15.666388] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-09-15T17:00:16.164707] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-15T17:00:16.175250] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-09-15T17:00:16.742972] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-15T17:00:16.754033] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-09-15T17:00:17.669971] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T17:00:17.681960] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-09-15T17:00:18.115478] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-15T17:00:18.122382] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-09-15T17:00:18.306514] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (3.42 seconds). [2025-09-15T17:00:18.317494] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-09-15T17:00:19.052462] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-15T17:00:19.058003] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-09-15T17:00:19.225907] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-15T17:00:19.236802] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-09-15T17:00:19.456265] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-09-15T17:00:19.468742] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-09-15T17:00:19.604790] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-15T17:00:19.615989] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-09-15T17:00:20.208535] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T17:00:20.212476] [INFO ] [REMOTE ] AAMI: Full fetch complete (25858 records). [2025-09-15T17:00:20.212627] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-09-15T17:00:20.213339] [FATAL] [VALIDATOR ] AAMI: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:00:20.213428] [FATAL] [MAIN ] AAMI: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:00:20.213468] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:00:20.213521] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-15T17:00:20.213583] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-15T17:00:20.213623] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-09-15T17:00:20.213937] [DEBUG] [LOCAL ] AAMI: Deleted derivative data file. [2025-09-15T17:00:20.214045] [INFO ] [MAIN ] Update Progress: 3/2369 symbols completed. AAMI took 11.3s. Estimated remaining: 3h 41m 52s. Rate: 10.7 symbols/min [2025-09-15T17:00:20.398365] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:20.441908] [DEBUG] [LOCAL ] AAT: Loaded 22768 existing records from primary storage. [2025-09-15T17:00:20.442080] [INFO ] [MAIN ] AAT: Loaded 22768 existing records. [2025-09-15T17:00:20.634820] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:20.635206] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-09-15T17:00:20.635264] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-15T17:00:20.635895] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-09-15T17:00:20.635948] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-09-15T17:00:20.999011] [INFO ] [REMOTE ] AAT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:20.999397] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-09-15T17:00:21.121156] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-15T17:00:21.133078] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-09-15T17:00:21.274373] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-15T17:00:21.289138] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-09-15T17:00:21.352472] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-15T17:00:21.358284] [INFO ] [REMOTE ] A: Full fetch complete (54915 records). [2025-09-15T17:00:21.358447] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-09-15T17:00:21.359361] [FATAL] [VALIDATOR ] A: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:00:21.359446] [FATAL] [MAIN ] A: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:00:21.359482] [WARN ] [MAIN ] A: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:00:21.359523] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-09-15T17:00:21.359585] [DEBUG] [LOCAL ] A: No primary data file found to delete. [2025-09-15T17:00:21.359625] [INFO ] [LOCAL ] A: Starting deletion of derivative data. [2025-09-15T17:00:21.359914] [DEBUG] [LOCAL ] A: Deleted derivative data file. [2025-09-15T17:00:21.360214] [INFO ] [MAIN ] Update Progress: 4/2369 symbols completed. A took 18.0s. Estimated remaining: 2h 57m 37s. Rate: 13.3 symbols/min [2025-09-15T17:00:21.537796] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:21.538054] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-09-15T17:00:21.538099] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-09-15T17:00:21.538234] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-09-15T17:00:21.538274] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-15T17:00:21.538315] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-15T17:00:21.538349] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-09-15T17:00:21.912261] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:21.912601] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-02. [2025-09-15T17:00:22.069063] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-15T17:00:22.075260] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-09-15T17:00:22.144425] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:00:22.144802] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-02 [2025-09-15T17:00:22.145385] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-03. [2025-09-15T17:00:22.347748] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:00:22.348199] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-03 [2025-09-15T17:00:22.348921] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-04. [2025-09-15T17:00:22.504589] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T17:00:22.517560] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-09-15T17:00:22.586195] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:00:22.586447] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-04 [2025-09-15T17:00:22.586847] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-05. [2025-09-15T17:00:22.787639] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:00:22.788082] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-05 [2025-09-15T17:00:22.788712] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-06. [2025-09-15T17:00:22.854268] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T17:00:22.860255] [INFO ] [REMOTE ] AA: Full fetch complete (57864 records). [2025-09-15T17:00:22.860383] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-09-15T17:00:22.863521] [FATAL] [VALIDATOR ] AA: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:00:22.863607] [FATAL] [MAIN ] AA: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:00:22.863665] [WARN ] [MAIN ] AA: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:00:22.863716] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-09-15T17:00:22.863794] [DEBUG] [LOCAL ] AA: No primary data file found to delete. [2025-09-15T17:00:22.863872] [INFO ] [LOCAL ] AA: Starting deletion of derivative data. [2025-09-15T17:00:22.864189] [DEBUG] [LOCAL ] AA: Deleted derivative data file. [2025-09-15T17:00:22.864480] [INFO ] [MAIN ] Update Progress: 5/2369 symbols completed. AA took 19.5s. Estimated remaining: 2h 33m 54s. Rate: 15.4 symbols/min [2025-09-15T17:00:23.040422] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:23.061659] [DEBUG] [LOCAL ] AB: Loaded 18396 existing records from primary storage. [2025-09-15T17:00:23.061817] [INFO ] [MAIN ] AB: Loaded 18396 existing records. [2025-09-15T17:00:23.254959] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:23.255662] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-09-15T17:00:23.255913] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-09-15T17:00:23.262351] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-09-15T17:00:23.274572] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-09-15T17:00:23.309845] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-15T17:00:23.390215] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-09-15T17:00:23.424827] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-15T17:00:23.461797] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-07. [2025-09-15T17:00:23.669501] [INFO ] [REMOTE ] AB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:23.669875] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-09-15T17:00:23.951023] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-15T17:00:23.953828] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-08. [2025-09-15T17:00:24.119882] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-15T17:00:24.131422] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-09-15T17:00:24.377037] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-15T17:00:24.385789] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-09-15T17:00:24.637793] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T17:00:24.641699] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-09. [2025-09-15T17:00:24.897091] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-15T17:00:24.906208] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-09-15T17:00:25.309737] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-15T17:00:25.331164] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-15T17:00:25.338252] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-09-15T17:00:25.340157] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-09-15T17:00:25.690520] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-15T17:00:25.693177] [INFO ] [REMOTE ] AAUC: Full fetch complete (6395 records). [2025-09-15T17:00:25.693281] [DEBUG] [VALIDATOR ] AAUC: Validating primary data. [2025-09-15T17:00:25.884511] [WARN ] [VALIDATOR ] AAUC: Validation failed - insufficient historical data. Have 68 unique days, need 150 days [2025-09-15T17:00:25.885469] [FATAL] [MAIN ] AAUC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:00:25.885543] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:00:25.885606] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-15T17:00:25.885733] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-15T17:00:25.885798] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-09-15T17:00:25.885855] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-09-15T17:00:25.885950] [INFO ] [MAIN ] Update Progress: 6/2369 symbols completed. AAUC took 4.5s. Estimated remaining: 2h 28m 1s. Rate: 16.0 symbols/min [2025-09-15T17:00:26.070349] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:26.124813] [DEBUG] [LOCAL ] ABBV: Loaded 40433 existing records from primary storage. [2025-09-15T17:00:26.124981] [INFO ] [MAIN ] ABBV: Loaded 40433 existing records. [2025-09-15T17:00:26.310114] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:26.310497] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-09-15T17:00:26.310587] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-09-15T17:00:26.318717] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-09-15T17:00:26.326475] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-09-15T17:00:26.378969] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-15T17:00:26.429814] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-09-15T17:00:26.750171] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T17:00:26.756658] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:26.761613] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-09-15T17:00:26.765071] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-15T17:00:26.765318] [INFO ] [REMOTE ] AAP: Full fetch complete (56333 records). [2025-09-15T17:00:26.774900] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-09-15T17:00:26.775949] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-09-15T17:00:26.776333] [FATAL] [VALIDATOR ] AAP: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:00:26.776447] [FATAL] [MAIN ] AAP: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:00:26.776494] [WARN ] [MAIN ] AAP: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:00:26.776540] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-09-15T17:00:26.776598] [DEBUG] [LOCAL ] AAP: No primary data file found to delete. [2025-09-15T17:00:26.776655] [INFO ] [LOCAL ] AAP: Starting deletion of derivative data. [2025-09-15T17:00:26.777484] [DEBUG] [LOCAL ] AAP: Deleted derivative data file. [2025-09-15T17:00:26.777579] [INFO ] [MAIN ] Update Progress: 7/2369 symbols completed. AAP took 15.1s. Estimated remaining: 2h 11m 50s. Rate: 17.9 symbols/min [2025-09-15T17:00:26.948733] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:26.970223] [DEBUG] [LOCAL ] ABCB: Loaded 22109 existing records from primary storage. [2025-09-15T17:00:26.970354] [INFO ] [MAIN ] ABCB: Loaded 22109 existing records. [2025-09-15T17:00:27.147184] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:27.147433] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-09-15T17:00:27.147479] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-09-15T17:00:27.147998] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-09-15T17:00:27.148047] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-09-15T17:00:27.504366] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:27.504819] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-09-15T17:00:28.172517] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-15T17:00:28.180078] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-09-15T17:00:28.285146] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-15T17:00:28.293903] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-09-15T17:00:28.396391] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-15T17:00:28.406542] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-09-15T17:00:28.519828] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-15T17:00:28.525945] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-09-15T17:00:28.984812] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-15T17:00:28.991605] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-09-15T17:00:29.162424] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-15T17:00:29.168710] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-09-15T17:00:29.647675] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-15T17:00:29.655512] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-09-15T17:00:29.818173] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-15T17:00:29.823029] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-09-15T17:00:29.930488] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-15T17:00:29.933761] [INFO ] [REMOTE ] AAT: Full fetch complete (32803 records). [2025-09-15T17:00:29.933857] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-09-15T17:00:29.934498] [FATAL] [VALIDATOR ] AAT: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:00:29.934579] [FATAL] [MAIN ] AAT: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:00:29.934618] [WARN ] [MAIN ] AAT: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:00:29.934679] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-15T17:00:29.934757] [DEBUG] [LOCAL ] AAT: No primary data file found to delete. [2025-09-15T17:00:29.934798] [INFO ] [LOCAL ] AAT: Starting deletion of derivative data. [2025-09-15T17:00:29.935031] [DEBUG] [LOCAL ] AAT: Deleted derivative data file. [2025-09-15T17:00:29.935152] [INFO ] [MAIN ] Update Progress: 8/2369 symbols completed. AAT took 9.7s. Estimated remaining: 2h 10m 50s. Rate: 18.0 symbols/min [2025-09-15T17:00:30.104555] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:30.158555] [DEBUG] [LOCAL ] ABEV: Loaded 40061 existing records from primary storage. [2025-09-15T17:00:30.158748] [INFO ] [MAIN ] ABEV: Loaded 40061 existing records. [2025-09-15T17:00:30.410224] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:30.412507] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-15T17:00:30.412842] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-09-15T17:00:30.412950] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-09-15T17:00:30.424831] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-09-15T17:00:30.425812] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-09-15T17:00:30.425880] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-09-15T17:00:30.795831] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:30.796508] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-09-15T17:00:30.820140] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-15T17:00:30.829089] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-09-15T17:00:30.853249] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T17:00:30.861751] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-09-15T17:00:31.791894] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-15T17:00:31.798709] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-09-15T17:00:31.848252] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-15T17:00:31.853767] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-09-15T17:00:32.302777] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-15T17:00:32.318568] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-09-15T17:00:32.372740] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-15T17:00:32.392997] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-09-15T17:00:33.025565] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T17:00:33.035402] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-09-15T17:00:33.085013] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T17:00:33.090591] [INFO ] [REMOTE ] AB: Full fetch complete (33568 records). [2025-09-15T17:00:33.090875] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-09-15T17:00:33.577104] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-09-15T17:00:33.577206] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-09-15T17:00:33.577610] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-09-15T17:00:33.577690] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-09-15T17:00:33.578884] [DEBUG] [LOCAL ] AB: Trimmed 33568 records to 17717 (keeping 150 days of data) [2025-09-15T17:00:33.698773] [DEBUG] [LOCAL ] AB: Primary data saved (17717 records). [2025-09-15T17:00:33.699014] [INFO ] [MAIN ] AB: Full history saved. [2025-09-15T17:00:33.699147] [INFO ] [MAIN ] Update Progress: 9/2369 symbols completed. AB took 10.8s. Estimated remaining: 2h 12m 42s. Rate: 17.8 symbols/min [2025-09-15T17:00:33.888459] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:33.905267] [DEBUG] [LOCAL ] ABG: Loaded 13231 existing records from primary storage. [2025-09-15T17:00:33.905435] [INFO ] [MAIN ] ABG: Loaded 13231 existing records. [2025-09-15T17:00:34.097670] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:34.098370] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-09-15T17:00:34.098553] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-09-15T17:00:34.099299] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-09-15T17:00:34.099535] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-09-15T17:00:34.314279] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T17:00:34.315791] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-15T17:00:34.430785] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-09-15T17:00:34.482976] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-09-15T17:00:34.573027] [INFO ] [REMOTE ] ABG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:34.573558] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-09-15T17:00:34.607180] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-15T17:00:34.618930] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-09-15T17:00:35.372741] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-15T17:00:35.376695] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-09-15T17:00:35.740068] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-15T17:00:35.749264] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-09-15T17:00:36.210751] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-15T17:00:36.216130] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-09-15T17:00:36.299132] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-15T17:00:36.311439] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-09-15T17:00:36.394013] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-15T17:00:36.405192] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-09-15T17:00:36.474626] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-15T17:00:36.478668] [INFO ] [REMOTE ] ABCB: Full fetch complete (33187 records). [2025-09-15T17:00:36.478827] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-09-15T17:00:36.850585] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-09-15T17:00:36.850702] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-09-15T17:00:36.851080] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-09-15T17:00:36.851202] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-09-15T17:00:36.852323] [DEBUG] [LOCAL ] ABCB: Trimmed 33187 records to 21569 (keeping 150 days of data) [2025-09-15T17:00:37.001059] [DEBUG] [LOCAL ] ABCB: Primary data saved (21569 records). [2025-09-15T17:00:37.001210] [INFO ] [MAIN ] ABCB: Full history saved. [2025-09-15T17:00:37.001308] [INFO ] [MAIN ] Update Progress: 10/2369 symbols completed. ABCB took 10.2s. Estimated remaining: 2h 12m 22s. Rate: 17.8 symbols/min [2025-09-15T17:00:37.170305] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:37.193617] [DEBUG] [LOCAL ] ABM: Loaded 23534 existing records from primary storage. [2025-09-15T17:00:37.193782] [INFO ] [MAIN ] ABM: Loaded 23534 existing records. [2025-09-15T17:00:37.372157] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:37.372682] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-09-15T17:00:37.372846] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-09-15T17:00:37.373483] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-09-15T17:00:37.373538] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-09-15T17:00:37.516190] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T17:00:37.574942] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-09-15T17:00:37.775028] [INFO ] [REMOTE ] ABM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:37.776164] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-09-15T17:00:37.964529] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T17:00:37.976446] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-09-15T17:00:38.008590] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-15T17:00:38.022096] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-09-15T17:00:38.240155] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-15T17:00:38.243938] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-09-15T17:00:38.767211] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-15T17:00:38.772346] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-09-15T17:00:38.874820] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-15T17:00:38.878741] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-09-15T17:00:39.201591] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T17:00:39.213157] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-09-15T17:00:39.632634] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T17:00:39.644523] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-09-15T17:00:39.912457] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-15T17:00:39.918178] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-09-15T17:00:40.068376] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-15T17:00:40.075512] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-09-15T17:00:40.602517] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T17:00:40.608103] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-09-15T17:00:40.714408] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T17:00:40.726084] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-09-15T17:00:41.254596] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-15T17:00:41.263733] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-09-15T17:00:41.322971] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-15T17:00:41.325920] [INFO ] [REMOTE ] ABG: Full fetch complete (20389 records). [2025-09-15T17:00:41.326049] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-09-15T17:00:41.785593] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-15T17:00:41.822056] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-09-15T17:00:41.822399] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-09-15T17:00:41.822903] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-09-15T17:00:41.822987] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-09-15T17:00:41.824089] [DEBUG] [LOCAL ] ABG: Trimmed 20389 records to 12853 (keeping 150 days of data) [2025-09-15T17:00:41.824852] [INFO ] [REMOTE ] ABBV: Full fetch complete (58363 records). [2025-09-15T17:00:41.825301] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-09-15T17:00:42.332186] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-09-15T17:00:42.331922] [DEBUG] [LOCAL ] ABG: Primary data saved (12853 records). [2025-09-15T17:00:42.332468] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-09-15T17:00:42.333374] [INFO ] [MAIN ] ABG: Full history saved. [2025-09-15T17:00:42.333274] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-09-15T17:00:42.333629] [INFO ] [MAIN ] Update Progress: 11/2369 symbols completed. ABG took 8.6s. Estimated remaining: 2h 19m 20s. Rate: 16.9 symbols/min [2025-09-15T17:00:42.334119] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-09-15T17:00:42.397483] [DEBUG] [LOCAL ] ABBV: Trimmed 58363 records to 39654 (keeping 150 days of data) [2025-09-15T17:00:42.470292] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-15T17:00:42.609240] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-09-15T17:00:42.645892] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:42.693127] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-15T17:00:42.718497] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-09-15T17:00:42.746623] [DEBUG] [LOCAL ] ABR: Loaded 39178 existing records from primary storage. [2025-09-15T17:00:42.747759] [INFO ] [MAIN ] ABR: Loaded 39178 existing records. [2025-09-15T17:00:43.040555] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:43.044101] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-09-15T17:00:43.044775] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-09-15T17:00:43.046931] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-09-15T17:00:43.047634] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-09-15T17:00:43.448407] [INFO ] [REMOTE ] ABR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:43.449483] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-09-15T17:00:43.463286] [DEBUG] [LOCAL ] ABBV: Primary data saved (39654 records). [2025-09-15T17:00:43.463424] [INFO ] [MAIN ] ABBV: Full history saved. [2025-09-15T17:00:43.463517] [INFO ] [MAIN ] Update Progress: 12/2369 symbols completed. ABBV took 17.6s. Estimated remaining: 2h 11m 22s. Rate: 17.9 symbols/min [2025-09-15T17:00:43.647732] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:43.690825] [DEBUG] [LOCAL ] ABT: Loaded 40373 existing records from primary storage. [2025-09-15T17:00:43.691017] [INFO ] [MAIN ] ABT: Loaded 40373 existing records. [2025-09-15T17:00:43.861553] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-15T17:00:43.906665] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:43.907075] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-09-15T17:00:43.907331] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-09-15T17:00:43.907407] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-09-15T17:00:43.909275] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-09-15T17:00:43.909332] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-09-15T17:00:44.326412] [INFO ] [REMOTE ] ABT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:44.329037] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-09-15T17:00:44.328654] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-15T17:00:44.336711] [INFO ] [REMOTE ] ABEV: Full fetch complete (57894 records). [2025-09-15T17:00:44.336832] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-09-15T17:00:44.743658] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-09-15T17:00:44.743753] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-09-15T17:00:44.744416] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-09-15T17:00:44.744477] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-09-15T17:00:44.747214] [DEBUG] [LOCAL ] ABEV: Trimmed 57894 records to 39288 (keeping 150 days of data) [2025-09-15T17:00:44.986326] [DEBUG] [LOCAL ] ABEV: Primary data saved (39288 records). [2025-09-15T17:00:44.986498] [INFO ] [MAIN ] ABEV: Full history saved. [2025-09-15T17:00:44.986600] [INFO ] [MAIN ] Update Progress: 13/2369 symbols completed. ABEV took 15.1s. Estimated remaining: 2h 5m 49s. Rate: 18.7 symbols/min [2025-09-15T17:00:45.162137] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:45.181018] [DEBUG] [LOCAL ] ACA: Loaded 17137 existing records from primary storage. [2025-09-15T17:00:45.181161] [INFO ] [MAIN ] ACA: Loaded 17137 existing records. [2025-09-15T17:00:45.387159] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T17:00:45.387367] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:45.395585] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-09-15T17:00:45.395918] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-09-15T17:00:45.396334] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-09-15T17:00:45.396460] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-09-15T17:00:45.397568] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-09-15T17:00:45.779700] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-09-15T17:00:45.816998] [INFO ] [REMOTE ] ACA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:45.817969] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-09-15T17:00:45.817742] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-09-15T17:00:46.132367] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-15T17:00:46.142967] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-09-15T17:00:46.718916] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T17:00:46.726268] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-09-15T17:00:46.807114] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-15T17:00:46.812444] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-09-15T17:00:47.278831] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T17:00:47.289622] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-09-15T17:00:47.866796] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-15T17:00:47.873317] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-09-15T17:00:47.962471] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-15T17:00:47.967223] [INFO ] [REMOTE ] ABM: Full fetch complete (34159 records). [2025-09-15T17:00:47.967336] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-09-15T17:00:48.344063] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-09-15T17:00:48.344246] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-09-15T17:00:48.344779] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-09-15T17:00:48.344849] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-09-15T17:00:48.346085] [DEBUG] [LOCAL ] ABM: Trimmed 34159 records to 23119 (keeping 150 days of data) [2025-09-15T17:00:48.485007] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-15T17:00:48.507283] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-09-15T17:00:48.547970] [DEBUG] [LOCAL ] ABM: Primary data saved (23119 records). [2025-09-15T17:00:48.548156] [INFO ] [MAIN ] ABM: Full history saved. [2025-09-15T17:00:48.548294] [INFO ] [MAIN ] Update Progress: 14/2369 symbols completed. ABM took 11.5s. Estimated remaining: 2h 6m 46s. Rate: 18.6 symbols/min [2025-09-15T17:00:48.743707] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:48.765585] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-15T17:00:48.772186] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-09-15T17:00:48.795450] [DEBUG] [LOCAL ] ACCO: Loaded 27964 existing records from primary storage. [2025-09-15T17:00:48.795628] [INFO ] [MAIN ] ACCO: Loaded 27964 existing records. [2025-09-15T17:00:48.977384] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:48.977769] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-09-15T17:00:48.977834] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-09-15T17:00:48.991989] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-09-15T17:00:49.010514] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-09-15T17:00:49.080707] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-15T17:00:49.131677] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-09-15T17:00:49.388240] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:49.388606] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-09-15T17:00:49.914055] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-15T17:00:49.920147] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-09-15T17:00:50.251157] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-15T17:00:50.262885] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-09-15T17:00:50.521935] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-15T17:00:50.529817] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-09-15T17:00:50.703802] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T17:00:50.715853] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-09-15T17:00:50.890946] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-15T17:00:50.896363] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-09-15T17:00:51.664996] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-15T17:00:51.676696] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-09-15T17:00:51.831896] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-15T17:00:51.841045] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-09-15T17:00:51.978286] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-15T17:00:51.983981] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-09-15T17:00:52.558480] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-15T17:00:52.569922] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-09-15T17:00:52.692889] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-15T17:00:52.699291] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-09-15T17:00:52.902344] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-15T17:00:53.169264] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-15T17:00:53.257852] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-09-15T17:00:53.402843] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T17:00:53.405361] [INFO ] [REMOTE ] ACA: Full fetch complete (26548 records). [2025-09-15T17:00:53.405438] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-09-15T17:00:53.801382] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-09-15T17:00:53.801485] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-09-15T17:00:53.801972] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-09-15T17:00:53.802036] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-09-15T17:00:53.802850] [DEBUG] [LOCAL ] ACA: Trimmed 26548 records to 16627 (keeping 150 days of data) [2025-09-15T17:00:53.906438] [DEBUG] [LOCAL ] ACA: Primary data saved (16627 records). [2025-09-15T17:00:53.906614] [INFO ] [MAIN ] ACA: Full history saved. [2025-09-15T17:00:53.906738] [INFO ] [MAIN ] Update Progress: 15/2369 symbols completed. ACA took 8.9s. Estimated remaining: 2h 12m 16s. Rate: 17.8 symbols/min [2025-09-15T17:00:54.059035] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-09-15T17:00:54.082428] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:00:54.104869] [DEBUG] [LOCAL ] ACEL: Loaded 19768 existing records from primary storage. [2025-09-15T17:00:54.105025] [INFO ] [MAIN ] ACEL: Loaded 19768 existing records. [2025-09-15T17:00:54.266969] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-15T17:00:54.332611] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:00:54.332884] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-09-15T17:00:54.332933] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-09-15T17:00:54.333424] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-09-15T17:00:54.333472] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-09-15T17:00:54.696749] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:00:54.857914] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-09-15T17:00:55.142358] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-15T17:00:55.286661] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-15T17:00:55.657984] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-09-15T17:00:56.310273] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T17:00:56.457908] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-09-15T17:00:56.755399] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-15T17:00:57.257884] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-09-15T17:00:57.376074] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-15T17:00:58.058123] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-09-15T17:00:58.230065] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-15T17:00:58.857901] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-09-15T17:00:58.937156] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-15T17:00:59.657883] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-09-15T17:01:00.457915] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-09-15T17:01:00.954622] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-15T17:01:01.009193] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-15T17:01:01.257899] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-09-15T17:01:02.057938] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-09-15T17:01:02.151414] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-15T17:01:02.857947] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-09-15T17:01:03.040391] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-15T17:01:03.044681] [INFO ] [REMOTE ] ACCO: Full fetch complete (41515 records). [2025-09-15T17:01:03.044788] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-09-15T17:01:03.456130] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-09-15T17:01:03.456228] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-09-15T17:01:03.456757] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-09-15T17:01:03.456815] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-09-15T17:01:03.458014] [DEBUG] [LOCAL ] ACCO: Trimmed 41515 records to 27389 (keeping 150 days of data) [2025-09-15T17:01:03.631186] [DEBUG] [LOCAL ] ACCO: Primary data saved (27389 records). [2025-09-15T17:01:03.631348] [INFO ] [MAIN ] ACCO: Full history saved. [2025-09-15T17:01:03.631469] [INFO ] [MAIN ] Update Progress: 16/2369 symbols completed. ACCO took 15.1s. Estimated remaining: 2h 27m 47s. Rate: 15.9 symbols/min [2025-09-15T17:01:03.665094] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-09-15T17:01:03.817142] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:01:03.835758] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-15T17:01:03.842447] [INFO ] [REMOTE ] ABT: Full fetch complete (58289 records). [2025-09-15T17:01:03.842631] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-09-15T17:01:04.179909] [DEBUG] [LOCAL ] ACHR: Loaded 40558 existing records from primary storage. [2025-09-15T17:01:04.180253] [INFO ] [MAIN ] ACHR: Loaded 40558 existing records. [2025-09-15T17:01:04.380344] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-09-15T17:01:04.380615] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-09-15T17:01:04.381685] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-09-15T17:01:04.387260] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-09-15T17:01:04.465276] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-15T17:01:04.493859] [DEBUG] [LOCAL ] ABT: Trimmed 58289 records to 39593 (keeping 150 days of data) [2025-09-15T17:01:04.488016] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:01:04.495710] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-09-15T17:01:04.495829] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-09-15T17:01:04.496356] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-09-15T17:01:04.557491] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-09-15T17:01:04.557797] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-09-15T17:01:04.998662] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:01:05.146852] [DEBUG] [LOCAL ] ABT: Primary data saved (39593 records). [2025-09-15T17:01:05.147032] [INFO ] [MAIN ] ABT: Full history saved. [2025-09-15T17:01:05.151575] [INFO ] [MAIN ] Update Progress: 17/2369 symbols completed. ABT took 21.7s. Estimated remaining: 2h 22m 33s. Rate: 16.5 symbols/min [2025-09-15T17:01:05.267688] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-09-15T17:01:05.357800] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:01:05.407629] [DEBUG] [LOCAL ] ACI: Loaded 40065 existing records from primary storage. [2025-09-15T17:01:05.407958] [INFO ] [MAIN ] ACI: Loaded 40065 existing records. [2025-09-15T17:01:05.587086] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:01:05.587434] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-09-15T17:01:05.592837] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-09-15T17:01:05.601435] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-09-15T17:01:05.601550] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-09-15T17:01:05.635310] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-15T17:01:05.709590] [INFO ] [REMOTE ] ABR: Full fetch complete (56754 records). [2025-09-15T17:01:05.713571] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-09-15T17:01:06.056755] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-15T17:01:06.152030] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-09-15T17:01:06.308405] [INFO ] [REMOTE ] ACI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:01:06.461986] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-09-15T17:01:06.462078] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-09-15T17:01:06.462802] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-09-15T17:01:06.462870] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-09-15T17:01:06.464255] [DEBUG] [LOCAL ] ABR: Trimmed 56754 records to 38398 (keeping 150 days of data) [2025-09-15T17:01:06.711169] [DEBUG] [LOCAL ] ABR: Primary data saved (38398 records). [2025-09-15T17:01:06.711331] [INFO ] [MAIN ] ABR: Full history saved. [2025-09-15T17:01:06.711443] [INFO ] [MAIN ] Update Progress: 18/2369 symbols completed. ABR took 24.4s. Estimated remaining: 2h 17m 58s. Rate: 17.0 symbols/min [2025-09-15T17:01:06.862762] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-09-15T17:01:06.896241] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:01:06.935924] [DEBUG] [LOCAL ] ACM: Loaded 31709 existing records from primary storage. [2025-09-15T17:01:06.936081] [INFO ] [MAIN ] ACM: Loaded 31709 existing records. [2025-09-15T17:01:07.129294] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:01:07.129616] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-09-15T17:01:07.129709] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-09-15T17:01:07.130478] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-09-15T17:01:07.130533] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-09-15T17:01:07.558390] [INFO ] [REMOTE ] ACM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:01:07.575680] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T17:01:07.657890] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-09-15T17:01:07.698913] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-15T17:01:08.457906] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-09-15T17:01:08.569224] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-15T17:01:09.214407] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T17:01:09.258285] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-09-15T17:01:09.262840] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-15T17:01:10.057887] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-09-15T17:01:10.857894] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-09-15T17:01:11.204871] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-15T17:01:11.622297] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-15T17:01:11.657857] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-09-15T17:01:12.457931] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-09-15T17:01:12.838351] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-15T17:01:13.257955] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-09-15T17:01:13.419604] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-15T17:01:13.423206] [INFO ] [REMOTE ] ACEL: Full fetch complete (30093 records). [2025-09-15T17:01:13.423319] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-09-15T17:01:13.424180] [FATAL] [VALIDATOR ] ACEL: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:01:13.424295] [FATAL] [MAIN ] ACEL: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:01:13.424335] [WARN ] [MAIN ] ACEL: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:01:13.424384] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-09-15T17:01:13.424453] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-09-15T17:01:13.424493] [INFO ] [LOCAL ] ACEL: Starting deletion of derivative data. [2025-09-15T17:01:13.425196] [DEBUG] [LOCAL ] ACEL: Deleted derivative data file. [2025-09-15T17:01:13.425322] [INFO ] [MAIN ] Update Progress: 19/2369 symbols completed. ACEL took 19.5s. Estimated remaining: 2h 24m 29s. Rate: 16.3 symbols/min [2025-09-15T17:01:13.609000] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:01:13.654843] [DEBUG] [LOCAL ] ACN: Loaded 40185 existing records from primary storage. [2025-09-15T17:01:13.655009] [INFO ] [MAIN ] ACN: Loaded 40185 existing records. [2025-09-15T17:01:13.840458] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:01:13.840770] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-09-15T17:01:13.840825] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-09-15T17:01:13.841827] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-09-15T17:01:13.841889] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-09-15T17:01:14.070485] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-09-15T17:01:14.215728] [INFO ] [REMOTE ] ACN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:01:14.248557] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-15T17:01:14.788423] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-15T17:01:14.857834] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-09-15T17:01:15.621295] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T17:01:15.657825] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-09-15T17:01:16.203808] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T17:01:16.457881] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-09-15T17:01:17.257882] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-09-15T17:01:17.334862] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-15T17:01:18.057887] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-09-15T17:01:18.405575] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-15T17:01:18.857935] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-09-15T17:01:19.201022] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-15T17:01:19.666089] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-09-15T17:01:19.672028] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T17:01:20.457884] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-09-15T17:01:21.006018] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-15T17:01:21.243827] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-15T17:01:21.257813] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-09-15T17:01:21.649342] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-15T17:01:22.057921] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-09-15T17:01:22.857883] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-09-15T17:01:23.049660] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-15T17:01:23.657928] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-09-15T17:01:24.425612] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-15T17:01:24.457847] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-09-15T17:01:24.828904] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-15T17:01:24.870342] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-15T17:01:25.257894] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-09-15T17:01:26.057937] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-09-15T17:01:26.615431] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-15T17:01:26.726255] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T17:01:26.731816] [INFO ] [REMOTE ] ACI: Full fetch complete (57478 records). [2025-09-15T17:01:26.731963] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-09-15T17:01:26.732889] [FATAL] [VALIDATOR ] ACI: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:01:26.732990] [FATAL] [MAIN ] ACI: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:01:26.733029] [WARN ] [MAIN ] ACI: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:01:26.733068] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-09-15T17:01:26.733145] [DEBUG] [LOCAL ] ACI: No primary data file found to delete. [2025-09-15T17:01:26.733192] [INFO ] [LOCAL ] ACI: Starting deletion of derivative data. [2025-09-15T17:01:26.733427] [DEBUG] [LOCAL ] ACI: Deleted derivative data file. [2025-09-15T17:01:26.734107] [INFO ] [MAIN ] Update Progress: 20/2369 symbols completed. ACI took 21.6s. Estimated remaining: 2h 43m 15s. Rate: 14.4 symbols/min [2025-09-15T17:01:26.863037] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-09-15T17:01:26.915003] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:01:26.939953] [DEBUG] [LOCAL ] ACP: Loaded 23365 existing records from primary storage. [2025-09-15T17:01:26.940109] [INFO ] [MAIN ] ACP: Loaded 23365 existing records. [2025-09-15T17:01:27.119067] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:01:27.119322] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-09-15T17:01:27.119372] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-09-15T17:01:27.119939] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-09-15T17:01:27.119990] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-09-15T17:01:27.482110] [INFO ] [REMOTE ] ACP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:01:27.661048] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-09-15T17:01:27.668685] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T17:01:28.457906] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-09-15T17:01:29.235297] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-15T17:01:29.257863] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-09-15T17:01:29.404061] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-15T17:01:30.000877] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-15T17:01:30.006034] [INFO ] [REMOTE ] ACM: Full fetch complete (47160 records). [2025-09-15T17:01:30.006151] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-09-15T17:01:30.068617] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-09-15T17:01:30.393192] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-09-15T17:01:30.393285] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-09-15T17:01:30.394009] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-09-15T17:01:30.394062] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-09-15T17:01:30.395609] [DEBUG] [LOCAL ] ACM: Trimmed 47160 records to 31167 (keeping 150 days of data) [2025-09-15T17:01:30.604065] [DEBUG] [LOCAL ] ACM: Primary data saved (31167 records). [2025-09-15T17:01:30.604239] [INFO ] [MAIN ] ACM: Full history saved. [2025-09-15T17:01:30.604930] [INFO ] [MAIN ] Update Progress: 21/2369 symbols completed. ACM took 23.9s. Estimated remaining: 2h 42m 38s. Rate: 14.4 symbols/min [2025-09-15T17:01:30.787583] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:01:30.796401] [DEBUG] [LOCAL ] ACR: Loaded 4230 existing records from primary storage. [2025-09-15T17:01:30.796558] [INFO ] [MAIN ] ACR: Loaded 4230 existing records. [2025-09-15T17:01:30.866727] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-09-15T17:01:30.985339] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:01:30.985597] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-09-15T17:01:30.985666] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-09-15T17:01:30.985949] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-09-15T17:01:30.986005] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-09-15T17:01:31.376852] [INFO ] [REMOTE ] ACR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:01:31.409419] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-15T17:01:31.657876] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-09-15T17:01:32.213517] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T17:01:32.295374] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-15T17:01:32.457877] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-09-15T17:01:33.257883] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-09-15T17:01:33.493054] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-15T17:01:33.816282] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-15T17:01:34.057880] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-09-15T17:01:34.337231] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-15T17:01:34.344771] [INFO ] [REMOTE ] ACHR: Full fetch complete (58498 records). [2025-09-15T17:01:34.345014] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-09-15T17:01:34.772267] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-09-15T17:01:34.772380] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-09-15T17:01:34.773050] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-09-15T17:01:34.773101] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-09-15T17:01:34.774948] [DEBUG] [LOCAL ] ACHR: Trimmed 58498 records to 39778 (keeping 150 days of data) [2025-09-15T17:01:34.871857] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-09-15T17:01:34.899056] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-15T17:01:35.044572] [DEBUG] [LOCAL ] ACHR: Primary data saved (39778 records). [2025-09-15T17:01:35.044786] [INFO ] [MAIN ] ACHR: Full history saved. [2025-09-15T17:01:35.046002] [INFO ] [MAIN ] Update Progress: 22/2369 symbols completed. ACHR took 31.4s. Estimated remaining: 2h 43m 4s. Rate: 14.4 symbols/min [2025-09-15T17:01:35.219711] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:01:35.245889] [DEBUG] [LOCAL ] ACRE: Loaded 24833 existing records from primary storage. [2025-09-15T17:01:35.246068] [INFO ] [MAIN ] ACRE: Loaded 24833 existing records. [2025-09-15T17:01:35.428033] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:01:35.428307] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-09-15T17:01:35.428356] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-09-15T17:01:35.429056] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-09-15T17:01:35.429112] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-09-15T17:01:35.663136] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-09-15T17:01:35.799038] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:01:36.222894] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T17:01:36.457877] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-09-15T17:01:36.470915] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-15T17:01:37.257944] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-09-15T17:01:37.545584] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-15T17:01:37.859330] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-15T17:01:38.057908] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-09-15T17:01:38.857909] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-09-15T17:01:39.501485] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-15T17:01:39.558279] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T17:01:39.563621] [INFO ] [REMOTE ] ACN: Full fetch complete (57629 records). [2025-09-15T17:01:39.563742] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-09-15T17:01:39.564479] [FATAL] [VALIDATOR ] ACN: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:01:39.564559] [FATAL] [MAIN ] ACN: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:01:39.564596] [WARN ] [MAIN ] ACN: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:01:39.564634] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-09-15T17:01:39.564715] [DEBUG] [LOCAL ] ACN: No primary data file found to delete. [2025-09-15T17:01:39.564752] [INFO ] [LOCAL ] ACN: Starting deletion of derivative data. [2025-09-15T17:01:39.565001] [DEBUG] [LOCAL ] ACN: Deleted derivative data file. [2025-09-15T17:01:39.566105] [INFO ] [MAIN ] Update Progress: 23/2369 symbols completed. ACN took 26.1s. Estimated remaining: 2h 43m 36s. Rate: 14.3 symbols/min [2025-09-15T17:01:39.663057] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-09-15T17:01:39.737353] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:01:39.746435] [DEBUG] [LOCAL ] ACV: Loaded 4645 existing records from primary storage. [2025-09-15T17:01:39.746574] [INFO ] [MAIN ] ACV: Loaded 4645 existing records. [2025-09-15T17:01:39.925888] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:01:39.926197] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-09-15T17:01:39.926244] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-09-15T17:01:39.926481] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-09-15T17:01:39.926530] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-09-15T17:01:40.274031] [INFO ] [REMOTE ] ACV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:01:40.388152] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-15T17:01:40.457857] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-09-15T17:01:41.251268] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-15T17:01:41.257816] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-09-15T17:01:41.700782] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-15T17:01:42.057884] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-09-15T17:01:42.630969] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-15T17:01:42.857892] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-09-15T17:01:43.657924] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-09-15T17:01:44.363042] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-15T17:01:44.457982] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-09-15T17:01:44.471511] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T17:01:44.473254] [INFO ] [REMOTE ] ACR: Full fetch complete (7064 records). [2025-09-15T17:01:44.473366] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-09-15T17:01:44.473995] [FATAL] [VALIDATOR ] ACR: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:01:44.474100] [FATAL] [MAIN ] ACR: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:01:44.474155] [WARN ] [MAIN ] ACR: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:01:44.474217] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-09-15T17:01:44.474295] [DEBUG] [LOCAL ] ACR: No primary data file found to delete. [2025-09-15T17:01:44.474333] [INFO ] [LOCAL ] ACR: Starting deletion of derivative data. [2025-09-15T17:01:44.474977] [DEBUG] [LOCAL ] ACR: Deleted derivative data file. [2025-09-15T17:01:44.475441] [INFO ] [MAIN ] Update Progress: 24/2369 symbols completed. ACR took 13.9s. Estimated remaining: 2h 44m 42s. Rate: 14.2 symbols/min [2025-09-15T17:01:44.767919] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:01:44.833480] [DEBUG] [LOCAL ] ACVA: Loaded 36553 existing records from primary storage. [2025-09-15T17:01:44.833765] [INFO ] [MAIN ] ACVA: Loaded 36553 existing records. [2025-09-15T17:01:45.101876] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:01:45.102344] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-09-15T17:01:45.102426] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-09-15T17:01:45.103506] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-09-15T17:01:45.103595] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-09-15T17:01:45.262996] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-09-15T17:01:45.545773] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:01:45.570295] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T17:01:46.058044] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-09-15T17:01:46.079467] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-15T17:01:46.857934] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-09-15T17:01:47.448542] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-15T17:01:47.477834] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T17:01:47.657902] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-09-15T17:01:48.457841] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-09-15T17:01:48.861092] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-15T17:01:49.257930] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-09-15T17:01:50.057885] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-09-15T17:01:50.198695] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-15T17:01:50.263010] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-15T17:01:50.451126] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-15T17:01:50.857923] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-09-15T17:01:51.631055] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-15T17:01:51.657886] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-09-15T17:01:52.457945] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-09-15T17:01:52.913949] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-15T17:01:53.257916] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-09-15T17:01:53.871711] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-15T17:01:54.057919] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-09-15T17:01:54.809045] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T17:01:54.857913] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-09-15T17:01:55.229272] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-15T17:01:55.459357] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-15T17:01:55.657900] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-09-15T17:01:56.457919] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-09-15T17:01:57.222443] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-15T17:01:57.257912] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-09-15T17:01:57.937998] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T17:01:58.057934] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-09-15T17:01:58.181296] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-15T17:01:58.184749] [INFO ] [REMOTE ] ACP: Full fetch complete (34448 records). [2025-09-15T17:01:58.184824] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-09-15T17:01:58.551402] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-09-15T17:01:58.551490] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-09-15T17:01:58.551895] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-09-15T17:01:58.551991] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-09-15T17:01:58.552978] [DEBUG] [LOCAL ] ACP: Trimmed 34448 records to 22894 (keeping 150 days of data) [2025-09-15T17:01:58.693325] [DEBUG] [LOCAL ] ACP: Primary data saved (22894 records). [2025-09-15T17:01:58.693493] [INFO ] [MAIN ] ACP: Full history saved. [2025-09-15T17:01:58.693621] [INFO ] [MAIN ] Update Progress: 25/2369 symbols completed. ACP took 32.0s. Estimated remaining: 3h 0m 16s. Rate: 13.0 symbols/min [2025-09-15T17:01:58.874424] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-09-15T17:01:58.879385] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:01:58.880830] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-09-15T17:01:58.880893] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-09-15T17:01:58.881048] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-09-15T17:01:58.881093] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-15T17:01:58.881175] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-15T17:01:58.881259] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-09-15T17:01:59.281369] [INFO ] [REMOTE ] AD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:01:59.529813] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T17:01:59.612788] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-15T17:01:59.614687] [INFO ] [REMOTE ] ACV: Full fetch complete (7402 records). [2025-09-15T17:01:59.614807] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-09-15T17:01:59.663005] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-09-15T17:01:59.996327] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-09-15T17:01:59.996411] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-09-15T17:01:59.996597] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-09-15T17:01:59.996636] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-09-15T17:01:59.997121] [DEBUG] [LOCAL ] ACV: Trimmed 7402 records to 4587 (keeping 150 days of data) [2025-09-15T17:02:00.039581] [DEBUG] [LOCAL ] ACV: Primary data saved (4587 records). [2025-09-15T17:02:00.039805] [INFO ] [MAIN ] ACV: Full history saved. [2025-09-15T17:02:00.039945] [INFO ] [MAIN ] Update Progress: 26/2369 symbols completed. ACV took 20.5s. Estimated remaining: 2h 55m 17s. Rate: 13.4 symbols/min [2025-09-15T17:02:00.238144] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:02:00.278577] [DEBUG] [LOCAL ] ADC: Loaded 35023 existing records from primary storage. [2025-09-15T17:02:00.278746] [INFO ] [MAIN ] ADC: Loaded 35023 existing records. [2025-09-15T17:02:00.463194] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:02:00.463293] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-09-15T17:02:00.464920] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-09-15T17:02:00.464981] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-09-15T17:02:00.465965] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-09-15T17:02:00.466038] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-09-15T17:02:00.829434] [INFO ] [REMOTE ] ADC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:02:00.894486] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T17:02:01.257917] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-09-15T17:02:02.057877] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-09-15T17:02:02.213130] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-15T17:02:02.304336] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-15T17:02:02.857915] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-02. [2025-09-15T17:02:03.061847] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:02:03.062200] [WARN ] [REMOTE ] AD: No data returned for month 2025-02 [2025-09-15T17:02:03.254629] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-15T17:02:03.657945] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-09-15T17:02:04.457896] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-09-15T17:02:04.978304] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T17:02:05.257911] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-09-15T17:02:05.813093] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T17:02:06.057928] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-09-15T17:02:06.345746] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-15T17:02:06.350301] [INFO ] [REMOTE ] ACRE: Full fetch complete (37084 records). [2025-09-15T17:02:06.350472] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-09-15T17:02:06.351309] [FATAL] [VALIDATOR ] ACRE: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:02:06.351466] [FATAL] [MAIN ] ACRE: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:02:06.351539] [WARN ] [MAIN ] ACRE: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:02:06.351612] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-09-15T17:02:06.351706] [DEBUG] [LOCAL ] ACRE: No primary data file found to delete. [2025-09-15T17:02:06.351752] [INFO ] [LOCAL ] ACRE: Starting deletion of derivative data. [2025-09-15T17:02:06.352020] [DEBUG] [LOCAL ] ACRE: Deleted derivative data file. [2025-09-15T17:02:06.352126] [INFO ] [MAIN ] Update Progress: 27/2369 symbols completed. ACRE took 31.3s. Estimated remaining: 2h 57m 51s. Rate: 13.2 symbols/min [2025-09-15T17:02:06.537050] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:02:06.564868] [DEBUG] [LOCAL ] ADCT: Loaded 25869 existing records from primary storage. [2025-09-15T17:02:06.565026] [INFO ] [MAIN ] ADCT: Loaded 25869 existing records. [2025-09-15T17:02:06.748929] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:02:06.749274] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-09-15T17:02:06.749342] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-09-15T17:02:06.749882] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-09-15T17:02:06.749933] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-09-15T17:02:06.859176] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-09-15T17:02:07.186696] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:02:07.657881] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-03. [2025-09-15T17:02:07.761739] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-15T17:02:07.857937] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:02:07.858215] [WARN ] [REMOTE ] AD: No data returned for month 2025-03 [2025-09-15T17:02:08.339672] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T17:02:08.457927] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-09-15T17:02:09.257876] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-09-15T17:02:10.057882] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-04. [2025-09-15T17:02:10.085047] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-15T17:02:10.090807] [INFO ] [REMOTE ] ACVA: Full fetch complete (53599 records). [2025-09-15T17:02:10.090907] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-09-15T17:02:10.256781] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:02:10.288118] [WARN ] [REMOTE ] AD: No data returned for month 2025-04 [2025-09-15T17:02:10.492020] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-09-15T17:02:10.492114] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-09-15T17:02:10.492710] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-09-15T17:02:10.492763] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-09-15T17:02:10.498450] [DEBUG] [LOCAL ] ACVA: Trimmed 53599 records to 35821 (keeping 150 days of data) [2025-09-15T17:02:10.727026] [DEBUG] [LOCAL ] ACVA: Primary data saved (35821 records). [2025-09-15T17:02:10.727180] [INFO ] [MAIN ] ACVA: Full history saved. [2025-09-15T17:02:10.727976] [INFO ] [MAIN ] Update Progress: 28/2369 symbols completed. ACVA took 26.3s. Estimated remaining: 2h 57m 31s. Rate: 13.2 symbols/min [2025-09-15T17:02:10.858237] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-05. [2025-09-15T17:02:10.937391] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-15T17:02:10.938997] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:02:11.001712] [DEBUG] [LOCAL ] ADM: Loaded 40170 existing records from primary storage. [2025-09-15T17:02:11.001883] [INFO ] [MAIN ] ADM: Loaded 40170 existing records. [2025-09-15T17:02:11.180165] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:02:11.180452] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-09-15T17:02:11.180502] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-09-15T17:02:11.181423] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-09-15T17:02:11.181476] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-09-15T17:02:11.251404] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:02:11.287421] [WARN ] [REMOTE ] AD: No data returned for month 2025-05 [2025-09-15T17:02:11.545423] [INFO ] [REMOTE ] ADM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:02:11.657885] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-09-15T17:02:12.457869] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-06. [2025-09-15T17:02:12.662905] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:02:12.663289] [WARN ] [REMOTE ] AD: No data returned for month 2025-06 [2025-09-15T17:02:13.257893] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-09-15T17:02:13.397036] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-15T17:02:14.057880] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-09-15T17:02:14.832717] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-15T17:02:14.857845] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-07. [2025-09-15T17:02:15.058194] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:02:15.058551] [WARN ] [REMOTE ] AD: No data returned for month 2025-07 [2025-09-15T17:02:15.657919] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-09-15T17:02:15.772523] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-15T17:02:16.457880] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-09-15T17:02:16.892742] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T17:02:17.257893] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-09-15T17:02:18.057905] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-09-15T17:02:18.221501] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-15T17:02:18.366695] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-15T17:02:18.857876] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-09-15T17:02:19.582962] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-15T17:02:19.657866] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-08. [2025-09-15T17:02:19.979404] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-15T17:02:20.457872] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-09-15T17:02:20.775028] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-15T17:02:21.257920] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-09-15T17:02:21.794595] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-15T17:02:22.057926] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-09. [2025-09-15T17:02:22.769584] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-15T17:02:22.857828] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-09-15T17:02:22.867141] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T17:02:22.869945] [INFO ] [REMOTE ] AD: Full fetch complete (4768 records). [2025-09-15T17:02:22.870017] [DEBUG] [VALIDATOR ] AD: Validating primary data. [2025-09-15T17:02:23.049286] [WARN ] [VALIDATOR ] AD: Validation failed - insufficient historical data. Have 24 unique days, need 150 days [2025-09-15T17:02:23.049532] [FATAL] [MAIN ] AD: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:02:23.049591] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:02:23.049635] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-15T17:02:23.049717] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-15T17:02:23.049755] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-09-15T17:02:23.049806] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-09-15T17:02:23.049875] [INFO ] [MAIN ] Update Progress: 29/2369 symbols completed. AD took 24.4s. Estimated remaining: 3h 7m 54s. Rate: 12.5 symbols/min [2025-09-15T17:02:23.219624] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:02:23.259749] [DEBUG] [LOCAL ] ADNT: Loaded 35484 existing records from primary storage. [2025-09-15T17:02:23.259899] [INFO ] [MAIN ] ADNT: Loaded 35484 existing records. [2025-09-15T17:02:23.440926] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:02:23.441199] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-09-15T17:02:23.441267] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-09-15T17:02:23.442042] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-09-15T17:02:23.442094] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-09-15T17:02:23.666355] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-09-15T17:02:23.807579] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:02:24.457879] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-09-15T17:02:24.735593] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-15T17:02:24.959144] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T17:02:24.965140] [INFO ] [REMOTE ] ADC: Full fetch complete (50697 records). [2025-09-15T17:02:24.965257] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-09-15T17:02:25.263335] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-09-15T17:02:25.356380] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-09-15T17:02:25.356472] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-09-15T17:02:25.357009] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-09-15T17:02:25.357058] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-09-15T17:02:25.358535] [DEBUG] [LOCAL ] ADC: Trimmed 50697 records to 34268 (keeping 150 days of data) [2025-09-15T17:02:25.593869] [DEBUG] [LOCAL ] ADC: Primary data saved (34268 records). [2025-09-15T17:02:25.594082] [INFO ] [MAIN ] ADC: Full history saved. [2025-09-15T17:02:25.595229] [INFO ] [MAIN ] Update Progress: 30/2369 symbols completed. ADC took 25.6s. Estimated remaining: 3h 4m 52s. Rate: 12.7 symbols/min [2025-09-15T17:02:25.771264] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:02:25.807611] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T17:02:25.855518] [DEBUG] [LOCAL ] ADT: Loaded 40255 existing records from primary storage. [2025-09-15T17:02:25.855694] [INFO ] [MAIN ] ADT: Loaded 40255 existing records. [2025-09-15T17:02:26.037716] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:02:26.038069] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-09-15T17:02:26.038143] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-09-15T17:02:26.039042] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-09-15T17:02:26.039111] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-09-15T17:02:26.062979] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-09-15T17:02:26.416202] [INFO ] [REMOTE ] ADT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:02:26.857940] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-09-15T17:02:27.225413] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-15T17:02:27.664104] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-09-15T17:02:27.670338] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-15T17:02:28.183126] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-15T17:02:28.457905] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-09-15T17:02:28.969227] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-15T17:02:29.257889] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-09-15T17:02:30.057880] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-09-15T17:02:30.258904] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-15T17:02:30.565305] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T17:02:30.857885] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-09-15T17:02:31.535452] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-15T17:02:31.657879] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-09-15T17:02:32.457924] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-09-15T17:02:32.607115] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-15T17:02:33.257875] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-09-15T17:02:33.476509] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-15T17:02:33.557635] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-15T17:02:33.563897] [INFO ] [REMOTE ] ADM: Full fetch complete (58069 records). [2025-09-15T17:02:33.564057] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-09-15T17:02:33.965497] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-09-15T17:02:33.965596] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-09-15T17:02:33.966190] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-09-15T17:02:33.966253] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-09-15T17:02:33.967754] [DEBUG] [LOCAL ] ADM: Trimmed 58069 records to 39393 (keeping 150 days of data) [2025-09-15T17:02:34.068852] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-09-15T17:02:34.230532] [DEBUG] [LOCAL ] ADM: Primary data saved (39393 records). [2025-09-15T17:02:34.230713] [INFO ] [MAIN ] ADM: Full history saved. [2025-09-15T17:02:34.231499] [INFO ] [MAIN ] Update Progress: 31/2369 symbols completed. ADM took 23.5s. Estimated remaining: 3h 9m 41s. Rate: 12.3 symbols/min [2025-09-15T17:02:34.406350] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:02:34.433666] [DEBUG] [LOCAL ] ADX: Loaded 20648 existing records from primary storage. [2025-09-15T17:02:34.433812] [INFO ] [MAIN ] ADX: Loaded 20648 existing records. [2025-09-15T17:02:34.649432] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-15T17:02:34.654147] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:02:34.666091] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-09-15T17:02:34.666193] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-09-15T17:02:34.667027] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-09-15T17:02:34.667094] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-09-15T17:02:34.863154] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-09-15T17:02:35.039899] [INFO ] [REMOTE ] ADX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:02:35.496492] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-15T17:02:35.657897] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-09-15T17:02:36.347140] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T17:02:36.457919] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-09-15T17:02:36.793204] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-15T17:02:36.799492] [INFO ] [REMOTE ] ADCT: Full fetch complete (36614 records). [2025-09-15T17:02:36.799737] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-09-15T17:02:37.188104] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-09-15T17:02:37.188199] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-09-15T17:02:37.188615] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-09-15T17:02:37.188692] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-09-15T17:02:37.189817] [DEBUG] [LOCAL ] ADCT: Trimmed 36614 records to 25686 (keeping 150 days of data) [2025-09-15T17:02:37.284717] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-09-15T17:02:37.354524] [DEBUG] [LOCAL ] ADCT: Primary data saved (25686 records). [2025-09-15T17:02:37.354765] [INFO ] [MAIN ] ADCT: Full history saved. [2025-09-15T17:02:37.354875] [INFO ] [MAIN ] Update Progress: 32/2369 symbols completed. ADCT took 31.0s. Estimated remaining: 3h 7m 28s. Rate: 12.5 symbols/min [2025-09-15T17:02:37.530078] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:02:37.577222] [DEBUG] [LOCAL ] AEE: Loaded 37637 existing records from primary storage. [2025-09-15T17:02:37.577416] [INFO ] [MAIN ] AEE: Loaded 37637 existing records. [2025-09-15T17:02:37.831164] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:02:37.831536] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-09-15T17:02:37.831617] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-09-15T17:02:37.833177] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-09-15T17:02:37.833271] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-09-15T17:02:38.063229] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-09-15T17:02:38.477088] [INFO ] [REMOTE ] AEE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:02:38.481316] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-15T17:02:38.857932] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-09-15T17:02:38.930151] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-15T17:02:38.980289] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-15T17:02:39.657887] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-09-15T17:02:40.464663] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-09-15T17:02:40.482556] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T17:02:40.572606] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-15T17:02:41.257902] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-09-15T17:02:41.797758] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-15T17:02:42.057900] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-09-15T17:02:42.469581] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T17:02:42.857879] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-09-15T17:02:43.670617] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-09-15T17:02:43.676995] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T17:02:44.313965] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T17:02:44.457853] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-09-15T17:02:44.897797] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-15T17:02:45.257887] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-09-15T17:02:45.792344] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-15T17:02:45.797108] [INFO ] [REMOTE ] ADNT: Full fetch complete (51160 records). [2025-09-15T17:02:45.797226] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-09-15T17:02:45.797946] [FATAL] [VALIDATOR ] ADNT: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:02:45.798029] [FATAL] [MAIN ] ADNT: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:02:45.798068] [WARN ] [MAIN ] ADNT: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:02:45.798116] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-09-15T17:02:45.798203] [DEBUG] [LOCAL ] ADNT: No primary data file found to delete. [2025-09-15T17:02:45.798244] [INFO ] [LOCAL ] ADNT: Starting deletion of derivative data. [2025-09-15T17:02:45.798616] [DEBUG] [LOCAL ] ADNT: Deleted derivative data file. [2025-09-15T17:02:45.803090] [INFO ] [MAIN ] Update Progress: 33/2369 symbols completed. ADNT took 22.8s. Estimated remaining: 3h 11m 41s. Rate: 12.2 symbols/min [2025-09-15T17:02:45.973861] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:02:45.987390] [DEBUG] [LOCAL ] AEFC: Loaded 5954 existing records from primary storage. [2025-09-15T17:02:45.987526] [INFO ] [MAIN ] AEFC: Loaded 5954 existing records. [2025-09-15T17:02:46.062962] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-09-15T17:02:46.166590] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:02:46.166853] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-09-15T17:02:46.166936] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-09-15T17:02:46.167186] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-09-15T17:02:46.167230] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-09-15T17:02:46.531482] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:02:46.857909] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-09-15T17:02:46.955918] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-15T17:02:47.398439] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-15T17:02:47.657887] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-09-15T17:02:47.710797] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T17:02:48.457883] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-09-15T17:02:49.262045] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-09-15T17:02:49.268658] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T17:02:49.675954] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-15T17:02:50.057910] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-09-15T17:02:50.548592] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-15T17:02:50.857888] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-09-15T17:02:51.547249] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-15T17:02:51.657910] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-09-15T17:02:52.457875] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-09-15T17:02:52.662118] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-15T17:02:52.668483] [INFO ] [REMOTE ] ADT: Full fetch complete (58077 records). [2025-09-15T17:02:52.668586] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-09-15T17:02:53.056128] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-09-15T17:02:53.056212] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-09-15T17:02:53.056792] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-09-15T17:02:53.056837] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-09-15T17:02:53.058130] [DEBUG] [LOCAL ] ADT: Trimmed 58077 records to 39482 (keeping 150 days of data) [2025-09-15T17:02:53.274504] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-09-15T17:02:53.286823] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-15T17:02:53.321160] [DEBUG] [LOCAL ] ADT: Primary data saved (39482 records). [2025-09-15T17:02:53.321397] [INFO ] [MAIN ] ADT: Full history saved. [2025-09-15T17:02:53.323751] [INFO ] [MAIN ] Update Progress: 34/2369 symbols completed. ADT took 27.7s. Estimated remaining: 3h 14m 34s. Rate: 12.0 symbols/min [2025-09-15T17:02:53.520250] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:02:53.552317] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-15T17:02:53.602269] [DEBUG] [LOCAL ] AEG: Loaded 37400 existing records from primary storage. [2025-09-15T17:02:53.602436] [INFO ] [MAIN ] AEG: Loaded 37400 existing records. [2025-09-15T17:02:53.788916] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:02:53.789185] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-09-15T17:02:53.789231] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-09-15T17:02:53.790109] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-09-15T17:02:53.790172] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-09-15T17:02:54.063077] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-09-15T17:02:54.159565] [INFO ] [REMOTE ] AEG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:02:54.608107] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-15T17:02:54.857918] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-09-15T17:02:55.354416] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-15T17:02:55.657925] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-09-15T17:02:55.692788] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T17:02:56.457880] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-09-15T17:02:56.924511] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-15T17:02:57.257899] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-09-15T17:02:57.347778] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T17:02:58.057913] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-09-15T17:02:58.537823] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-15T17:02:58.543196] [INFO ] [REMOTE ] AEE: Full fetch complete (54606 records). [2025-09-15T17:02:58.543345] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-09-15T17:02:58.544091] [FATAL] [VALIDATOR ] AEE: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:02:58.544177] [FATAL] [MAIN ] AEE: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:02:58.544229] [WARN ] [MAIN ] AEE: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:02:58.544310] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-09-15T17:02:58.544389] [DEBUG] [LOCAL ] AEE: No primary data file found to delete. [2025-09-15T17:02:58.544442] [INFO ] [LOCAL ] AEE: Starting deletion of derivative data. [2025-09-15T17:02:58.544856] [DEBUG] [LOCAL ] AEE: Deleted derivative data file. [2025-09-15T17:02:58.544984] [INFO ] [MAIN ] Update Progress: 35/2369 symbols completed. AEE took 21.2s. Estimated remaining: 3h 14m 44s. Rate: 12.0 symbols/min [2025-09-15T17:02:58.727174] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:02:58.774290] [DEBUG] [LOCAL ] AEM: Loaded 40246 existing records from primary storage. [2025-09-15T17:02:58.774489] [INFO ] [MAIN ] AEM: Loaded 40246 existing records. [2025-09-15T17:02:58.865803] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-09-15T17:02:58.973549] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:02:58.973896] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-09-15T17:02:58.973961] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-09-15T17:02:58.975252] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-09-15T17:02:58.975388] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-09-15T17:02:59.346080] [INFO ] [REMOTE ] AEM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:02:59.367633] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-15T17:02:59.657884] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-09-15T17:03:00.113737] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-15T17:03:00.457889] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-09-15T17:03:00.768610] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-15T17:03:01.257866] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-09-15T17:03:02.057927] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-09-15T17:03:02.793099] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-15T17:03:02.857921] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-09-15T17:03:03.657940] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-09-15T17:03:04.397104] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (3.14 seconds). [2025-09-15T17:03:04.417714] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-15T17:03:04.421586] [INFO ] [REMOTE ] ADX: Full fetch complete (30755 records). [2025-09-15T17:03:04.421794] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-09-15T17:03:04.467457] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-09-15T17:03:04.756903] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-15T17:03:04.819270] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-09-15T17:03:04.819364] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-09-15T17:03:04.819797] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-09-15T17:03:04.819842] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-09-15T17:03:04.820687] [DEBUG] [LOCAL ] ADX: Trimmed 30755 records to 20404 (keeping 150 days of data) [2025-09-15T17:03:04.949615] [DEBUG] [LOCAL ] ADX: Primary data saved (20404 records). [2025-09-15T17:03:04.949769] [INFO ] [MAIN ] ADX: Full history saved. [2025-09-15T17:03:04.949857] [INFO ] [MAIN ] Update Progress: 36/2369 symbols completed. ADX took 30.7s. Estimated remaining: 3h 16m 10s. Rate: 11.9 symbols/min [2025-09-15T17:03:05.125932] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:03:05.167574] [DEBUG] [LOCAL ] AEO: Loaded 40310 existing records from primary storage. [2025-09-15T17:03:05.167749] [INFO ] [MAIN ] AEO: Loaded 40310 existing records. [2025-09-15T17:03:05.265383] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-09-15T17:03:05.345682] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:03:05.345928] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-09-15T17:03:05.345975] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-09-15T17:03:05.346973] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-09-15T17:03:05.347026] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-09-15T17:03:05.733056] [INFO ] [REMOTE ] AEO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:03:05.748558] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-15T17:03:05.769160] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-15T17:03:06.057892] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-09-15T17:03:06.632194] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-15T17:03:06.857884] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-09-15T17:03:07.540927] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-15T17:03:07.657919] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-09-15T17:03:08.148624] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-15T17:03:08.457877] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-09-15T17:03:08.543889] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T17:03:09.257881] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-09-15T17:03:10.063080] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-09-15T17:03:10.080632] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T17:03:10.858050] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-09-15T17:03:11.174017] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-15T17:03:11.352952] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-15T17:03:11.446520] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-15T17:03:11.447753] [INFO ] [REMOTE ] AEFC: Full fetch complete (9434 records). [2025-09-15T17:03:11.447820] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-09-15T17:03:11.683221] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-09-15T17:03:11.880925] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-09-15T17:03:11.881016] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-09-15T17:03:11.881215] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-09-15T17:03:11.881259] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-09-15T17:03:11.881733] [DEBUG] [LOCAL ] AEFC: Trimmed 9434 records to 5866 (keeping 150 days of data) [2025-09-15T17:03:11.919334] [DEBUG] [LOCAL ] AEFC: Primary data saved (5866 records). [2025-09-15T17:03:11.919489] [INFO ] [MAIN ] AEFC: Full history saved. [2025-09-15T17:03:11.919583] [INFO ] [MAIN ] Update Progress: 37/2369 symbols completed. AEFC took 26.1s. Estimated remaining: 3h 18m 6s. Rate: 11.8 symbols/min [2025-09-15T17:03:12.457917] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-09-15T17:03:13.257933] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-09-15T17:03:15.089556] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (3.41 seconds). [2025-09-15T17:03:15.110972] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-09-15T17:03:15.129213] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-15T17:03:15.140244] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-09-15T17:03:15.189394] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-09-15T17:03:15.657880] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-09-15T17:03:16.789412] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-15T17:03:16.801703] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-09-15T17:03:16.958565] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-15T17:03:16.964034] [INFO ] [REMOTE ] AEG: Full fetch complete (53645 records). [2025-09-15T17:03:16.964141] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-09-15T17:03:17.348290] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-09-15T17:03:17.348435] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-09-15T17:03:17.349060] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-09-15T17:03:17.349111] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-09-15T17:03:17.350464] [DEBUG] [LOCAL ] AEG: Trimmed 53645 records to 36681 (keeping 150 days of data) [2025-09-15T17:03:17.484981] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-15T17:03:17.499806] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-09-15T17:03:17.621220] [DEBUG] [LOCAL ] AEG: Primary data saved (36681 records). [2025-09-15T17:03:17.621361] [INFO ] [MAIN ] AEG: Full history saved. [2025-09-15T17:03:17.622382] [INFO ] [MAIN ] Update Progress: 38/2369 symbols completed. AEG took 24.3s. Estimated remaining: 3h 18m 38s. Rate: 11.7 symbols/min [2025-09-15T17:03:18.456787] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-15T17:03:18.469090] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-09-15T17:03:19.266149] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-15T17:03:19.277355] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-09-15T17:03:20.418219] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-15T17:03:20.429720] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-09-15T17:03:21.397886] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-15T17:03:21.409813] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-09-15T17:03:21.875616] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-15T17:03:21.882036] [INFO ] [REMOTE ] AEM: Full fetch complete (58134 records). [2025-09-15T17:03:21.882203] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-09-15T17:03:22.273328] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-09-15T17:03:22.273441] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-09-15T17:03:22.274075] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-09-15T17:03:22.274138] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-09-15T17:03:22.275915] [DEBUG] [LOCAL ] AEM: Trimmed 58134 records to 39467 (keeping 150 days of data) [2025-09-15T17:03:22.534046] [DEBUG] [LOCAL ] AEM: Primary data saved (39467 records). [2025-09-15T17:03:22.534207] [INFO ] [MAIN ] AEM: Full history saved. [2025-09-15T17:03:22.537173] [INFO ] [MAIN ] Update Progress: 39/2369 symbols completed. AEM took 24.0s. Estimated remaining: 3h 18m 21s. Rate: 11.7 symbols/min [2025-09-15T17:03:23.130005] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-15T17:03:23.142196] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-09-15T17:03:24.887070] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-15T17:03:24.893682] [INFO ] [REMOTE ] AEO: Full fetch complete (58195 records). [2025-09-15T17:03:24.893835] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-09-15T17:03:25.286824] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-09-15T17:03:25.286928] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-09-15T17:03:25.287558] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-09-15T17:03:25.287607] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-09-15T17:03:25.289170] [DEBUG] [LOCAL ] AEO: Trimmed 58195 records to 39531 (keeping 150 days of data) [2025-09-15T17:03:25.549613] [DEBUG] [LOCAL ] AEO: Primary data saved (39531 records). [2025-09-15T17:03:25.549817] [INFO ] [MAIN ] AEO: Full history saved. [2025-09-15T17:03:25.552061] [INFO ] [MAIN ] Update Progress: 40/2369 symbols completed. AEO took 20.6s. Estimated remaining: 3h 16m 14s. Rate: 11.9 symbols/min [2025-09-15T17:03:26.298714] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:03:26.319257] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:03:26.347882] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:03:26.345572] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:03:26.363092] [DEBUG] [LOCAL ] AFB: Loaded 8175 existing records from primary storage. [2025-09-15T17:03:26.363321] [INFO ] [MAIN ] AFB: Loaded 8175 existing records. [2025-09-15T17:03:26.555486] [DEBUG] [LOCAL ] AER: Loaded 36323 existing records from primary storage. [2025-09-15T17:03:26.585815] [INFO ] [MAIN ] AER: Loaded 36323 existing records. [2025-09-15T17:03:26.660225] [DEBUG] [LOCAL ] AESI: Loaded 37122 existing records from primary storage. [2025-09-15T17:03:26.652390] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:03:26.697938] [DEBUG] [LOCAL ] AES: Loaded 40415 existing records from primary storage. [2025-09-15T17:03:26.722461] [INFO ] [MAIN ] AES: Loaded 40415 existing records. [2025-09-15T17:03:26.696953] [INFO ] [MAIN ] AESI: Loaded 37122 existing records. [2025-09-15T17:03:26.722851] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-09-15T17:03:26.733356] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-09-15T17:03:26.877841] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-09-15T17:03:26.913844] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-09-15T17:03:27.202595] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:03:27.340413] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:03:27.384377] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-09-15T17:03:27.384447] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-09-15T17:03:27.395054] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-09-15T17:03:27.395158] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-09-15T17:03:27.401266] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:03:27.406841] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-09-15T17:03:27.412275] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-09-15T17:03:27.428861] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-09-15T17:03:27.412065] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-09-15T17:03:27.424599] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-09-15T17:03:27.429237] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-09-15T17:03:27.482884] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-09-15T17:03:27.516736] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-09-15T17:03:28.199798] [INFO ] [REMOTE ] AFB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:03:28.342185] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-09-15T17:03:28.631411] [INFO ] [REMOTE ] AER: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:03:28.663564] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-09-15T17:03:28.748507] [INFO ] [REMOTE ] AESI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:03:28.764434] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-09-15T17:03:28.819380] [INFO ] [REMOTE ] AES: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:03:28.819701] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-09-15T17:03:29.172218] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-15T17:03:29.174957] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-09-15T17:03:29.973917] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-15T17:03:29.977365] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-09-15T17:03:30.292633] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-15T17:03:30.304254] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-09-15T17:03:30.353214] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T17:03:30.368629] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-09-15T17:03:30.431705] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-15T17:03:30.443941] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-09-15T17:03:30.844667] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-15T17:03:30.850404] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-09-15T17:03:31.309761] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-15T17:03:31.313500] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-09-15T17:03:31.527546] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T17:03:31.542431] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-09-15T17:03:31.781446] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-15T17:03:31.786280] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-09-15T17:03:31.827603] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T17:03:31.997736] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T17:03:32.389626] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-15T17:03:32.457935] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-09-15T17:03:33.162866] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-15T17:03:33.183121] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T17:03:33.257853] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-09-15T17:03:34.057951] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-09-15T17:03:34.491661] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-15T17:03:34.857881] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-09-15T17:03:35.657878] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-09-15T17:03:35.988912] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-15T17:03:36.030839] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-15T17:03:36.457920] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-09-15T17:03:37.103510] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T17:03:37.257901] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-09-15T17:03:37.959330] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T17:03:37.976143] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-15T17:03:37.978106] [INFO ] [REMOTE ] AFB: Full fetch complete (12378 records). [2025-09-15T17:03:37.978201] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-09-15T17:03:38.062993] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-09-15T17:03:38.385414] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-09-15T17:03:38.385513] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-09-15T17:03:38.386031] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-09-15T17:03:38.386088] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-09-15T17:03:38.386769] [DEBUG] [LOCAL ] AFB: Trimmed 12378 records to 7849 (keeping 150 days of data) [2025-09-15T17:03:38.441313] [DEBUG] [LOCAL ] AFB: Primary data saved (7849 records). [2025-09-15T17:03:38.441482] [INFO ] [MAIN ] AFB: Full history saved. [2025-09-15T17:03:38.441613] [INFO ] [MAIN ] Update Progress: 41/2369 symbols completed. AFB took 12.9s. Estimated remaining: 3h 23m 34s. Rate: 11.4 symbols/min [2025-09-15T17:03:38.637491] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:03:38.663966] [DEBUG] [LOCAL ] AFG: Loaded 23793 existing records from primary storage. [2025-09-15T17:03:38.664119] [INFO ] [MAIN ] AFG: Loaded 23793 existing records. [2025-09-15T17:03:38.860992] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-09-15T17:03:38.861237] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:03:38.862697] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-09-15T17:03:38.862771] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-09-15T17:03:38.863575] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-09-15T17:03:38.863680] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-09-15T17:03:39.264556] [INFO ] [REMOTE ] AFG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:03:39.657932] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-09-15T17:03:39.868240] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-15T17:03:40.457886] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-09-15T17:03:40.529899] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-15T17:03:41.257901] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-09-15T17:03:41.405249] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-15T17:03:41.628589] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-15T17:03:42.057900] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-09-15T17:03:42.530068] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T17:03:42.535848] [INFO ] [REMOTE ] AESI: Full fetch complete (53886 records). [2025-09-15T17:03:42.535954] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-09-15T17:03:42.863111] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-09-15T17:03:42.937448] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-09-15T17:03:42.937538] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-09-15T17:03:42.938173] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-09-15T17:03:42.938232] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-09-15T17:03:42.939792] [DEBUG] [LOCAL ] AESI: Trimmed 53886 records to 36439 (keeping 150 days of data) [2025-09-15T17:03:43.185866] [DEBUG] [LOCAL ] AESI: Primary data saved (36439 records). [2025-09-15T17:03:43.186027] [INFO ] [MAIN ] AESI: Full history saved. [2025-09-15T17:03:43.186140] [INFO ] [MAIN ] Update Progress: 42/2369 symbols completed. AESI took 17.6s. Estimated remaining: 3h 23m 1s. Rate: 11.5 symbols/min [2025-09-15T17:03:43.359290] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:03:43.362894] [DEBUG] [LOCAL ] AFGB: Loaded 1672 existing records from primary storage. [2025-09-15T17:03:43.362973] [INFO ] [MAIN ] AFGB: Loaded 1672 existing records. [2025-09-15T17:03:43.547797] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:03:43.548247] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-09-15T17:03:43.548337] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-09-15T17:03:43.548688] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-09-15T17:03:43.548745] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-09-15T17:03:43.658036] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-09-15T17:03:43.743988] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T17:03:43.954042] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:03:44.457903] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-09-15T17:03:44.560368] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-15T17:03:45.257841] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-09-15T17:03:45.339805] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-15T17:03:45.602698] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-15T17:03:46.057900] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-09-15T17:03:46.566107] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-15T17:03:46.857846] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-09-15T17:03:46.934702] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-15T17:03:47.657877] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-09-15T17:03:48.060192] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-15T17:03:48.067457] [INFO ] [REMOTE ] AER: Full fetch complete (53135 records). [2025-09-15T17:03:48.067635] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-09-15T17:03:48.464239] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-09-15T17:03:48.469591] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-09-15T17:03:48.469708] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-09-15T17:03:48.470883] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-09-15T17:03:48.471073] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-09-15T17:03:48.472985] [DEBUG] [LOCAL ] AER: Trimmed 53135 records to 35563 (keeping 150 days of data) [2025-09-15T17:03:48.709364] [DEBUG] [LOCAL ] AER: Primary data saved (35563 records). [2025-09-15T17:03:48.709521] [INFO ] [MAIN ] AER: Full history saved. [2025-09-15T17:03:48.709613] [INFO ] [MAIN ] Update Progress: 43/2369 symbols completed. AER took 23.2s. Estimated remaining: 3h 23m 11s. Rate: 11.4 symbols/min [2025-09-15T17:03:48.881033] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:03:48.884864] [DEBUG] [LOCAL ] AFGC: Loaded 2041 existing records from primary storage. [2025-09-15T17:03:48.884941] [INFO ] [MAIN ] AFGC: Loaded 2041 existing records. [2025-09-15T17:03:49.046141] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-15T17:03:49.072454] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:03:49.073916] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-09-15T17:03:49.073979] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-09-15T17:03:49.074178] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-09-15T17:03:49.074226] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-09-15T17:03:49.263016] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-09-15T17:03:49.440334] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:03:49.497128] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-15T17:03:50.057879] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-09-15T17:03:50.307149] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-15T17:03:50.588704] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-15T17:03:50.857990] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-09-15T17:03:51.657935] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-09-15T17:03:52.457912] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-09-15T17:03:52.671608] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-15T17:03:52.864198] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T17:03:52.864339] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-15T17:03:53.257885] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-09-15T17:03:53.838282] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-15T17:03:54.057940] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-09-15T17:03:54.546823] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-15T17:03:54.857917] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-09-15T17:03:55.309279] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-15T17:03:55.657908] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-09-15T17:03:56.457906] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-09-15T17:03:57.050235] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-15T17:03:57.257880] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-09-15T17:03:57.658428] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-15T17:03:57.822672] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-15T17:03:57.828623] [INFO ] [REMOTE ] AES: Full fetch complete (58353 records). [2025-09-15T17:03:57.828774] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-09-15T17:03:58.063014] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-09-15T17:03:58.224262] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-09-15T17:03:58.224353] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-09-15T17:03:58.225176] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-09-15T17:03:58.225240] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-09-15T17:03:58.226718] [DEBUG] [LOCAL ] AES: Trimmed 58353 records to 39635 (keeping 150 days of data) [2025-09-15T17:03:58.444446] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-15T17:03:58.478305] [DEBUG] [LOCAL ] AES: Primary data saved (39635 records). [2025-09-15T17:03:58.478457] [INFO ] [MAIN ] AES: Full history saved. [2025-09-15T17:03:58.478562] [INFO ] [MAIN ] Update Progress: 44/2369 symbols completed. AES took 32.9s. Estimated remaining: 3h 27m 5s. Rate: 11.2 symbols/min [2025-09-15T17:03:58.648093] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:03:58.651363] [DEBUG] [LOCAL ] AFGD: Loaded 1355 existing records from primary storage. [2025-09-15T17:03:58.651441] [INFO ] [MAIN ] AFGD: Loaded 1355 existing records. [2025-09-15T17:03:58.863439] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-09-15T17:03:58.868021] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:03:58.869267] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-09-15T17:03:58.869316] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-09-15T17:03:58.869489] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-09-15T17:03:58.869533] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-09-15T17:03:59.223248] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:03:59.427617] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-15T17:03:59.657888] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-09-15T17:04:00.457876] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-09-15T17:04:00.627467] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-15T17:04:01.021498] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-15T17:04:01.257871] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-09-15T17:04:01.905361] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-15T17:04:02.057919] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-09-15T17:04:02.857925] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-09-15T17:04:03.033502] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T17:04:03.042885] [INFO ] [REMOTE ] AFG: Full fetch complete (35770 records). [2025-09-15T17:04:03.043116] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-09-15T17:04:03.321693] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-15T17:04:03.446414] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-09-15T17:04:03.446501] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-09-15T17:04:03.446988] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-09-15T17:04:03.447035] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-09-15T17:04:03.448055] [DEBUG] [LOCAL ] AFG: Trimmed 35770 records to 23462 (keeping 150 days of data) [2025-09-15T17:04:03.599997] [DEBUG] [LOCAL ] AFG: Primary data saved (23462 records). [2025-09-15T17:04:03.600138] [INFO ] [MAIN ] AFG: Full history saved. [2025-09-15T17:04:03.600250] [INFO ] [MAIN ] Update Progress: 45/2369 symbols completed. AFG took 25.2s. Estimated remaining: 3h 26m 48s. Rate: 11.2 symbols/min [2025-09-15T17:04:03.663124] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-09-15T17:04:03.771798] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:04:03.775585] [DEBUG] [LOCAL ] AFGE: Loaded 1893 existing records from primary storage. [2025-09-15T17:04:03.775681] [INFO ] [MAIN ] AFGE: Loaded 1893 existing records. [2025-09-15T17:04:03.952778] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:04:03.953039] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-09-15T17:04:03.953134] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-09-15T17:04:03.953315] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-09-15T17:04:03.953360] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-09-15T17:04:04.247444] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-15T17:04:04.341163] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:04:04.457883] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-09-15T17:04:05.006429] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-15T17:04:05.257909] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-09-15T17:04:05.572844] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-15T17:04:06.057877] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-09-15T17:04:06.483932] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-15T17:04:06.857914] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-09-15T17:04:07.497132] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-15T17:04:07.498143] [INFO ] [REMOTE ] AFGC: Full fetch complete (2692 records). [2025-09-15T17:04:07.498422] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-09-15T17:04:07.683429] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-09-15T17:04:07.879255] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-09-15T17:04:07.879353] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-09-15T17:04:07.879480] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-09-15T17:04:07.879520] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-09-15T17:04:07.879928] [DEBUG] [LOCAL ] AFGC: Trimmed 2692 records to 2025 (keeping 150 days of data) [2025-09-15T17:04:07.894061] [DEBUG] [LOCAL ] AFGC: Primary data saved (2025 records). [2025-09-15T17:04:07.894175] [INFO ] [MAIN ] AFGC: Full history saved. [2025-09-15T17:04:07.894285] [INFO ] [MAIN ] Update Progress: 46/2369 symbols completed. AFGC took 19.2s. Estimated remaining: 3h 25m 50s. Rate: 11.3 symbols/min [2025-09-15T17:04:08.077620] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:04:08.140787] [DEBUG] [LOCAL ] AFL: Loaded 39995 existing records from primary storage. [2025-09-15T17:04:08.140964] [INFO ] [MAIN ] AFL: Loaded 39995 existing records. [2025-09-15T17:04:08.245549] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-15T17:04:08.359928] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:04:08.360230] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-09-15T17:04:08.360279] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-09-15T17:04:08.361494] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-09-15T17:04:08.361549] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-09-15T17:04:08.463417] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-09-15T17:04:08.723951] [INFO ] [REMOTE ] AFL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:04:08.783500] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-15T17:04:09.257905] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-09-15T17:04:09.667348] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-15T17:04:10.057905] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-09-15T17:04:10.476686] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-15T17:04:10.857874] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-09-15T17:04:11.283787] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-15T17:04:11.657870] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-09-15T17:04:11.974355] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-15T17:04:12.457904] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-09-15T17:04:12.896406] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-15T17:04:13.257874] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-09-15T17:04:13.708962] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-15T17:04:14.057878] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-09-15T17:04:14.582611] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-15T17:04:14.583560] [INFO ] [REMOTE ] AFGD: Full fetch complete (2025 records). [2025-09-15T17:04:14.583631] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-09-15T17:04:14.584042] [FATAL] [VALIDATOR ] AFGD: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:04:14.584137] [FATAL] [MAIN ] AFGD: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:04:14.584195] [WARN ] [MAIN ] AFGD: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:04:14.584244] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-09-15T17:04:14.584315] [DEBUG] [LOCAL ] AFGD: No primary data file found to delete. [2025-09-15T17:04:14.584354] [INFO ] [LOCAL ] AFGD: Starting deletion of derivative data. [2025-09-15T17:04:14.584636] [DEBUG] [LOCAL ] AFGD: Deleted derivative data file. [2025-09-15T17:04:14.584750] [INFO ] [MAIN ] Update Progress: 47/2369 symbols completed. AFGD took 16.1s. Estimated remaining: 3h 26m 53s. Rate: 11.2 symbols/min [2025-09-15T17:04:14.766249] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:04:14.812143] [DEBUG] [LOCAL ] AG: Loaded 40385 existing records from primary storage. [2025-09-15T17:04:14.812324] [INFO ] [MAIN ] AG: Loaded 40385 existing records. [2025-09-15T17:04:14.864172] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-09-15T17:04:14.990906] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:04:14.991235] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-09-15T17:04:14.991297] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-09-15T17:04:14.992200] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-09-15T17:04:14.992255] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-09-15T17:04:15.363596] [INFO ] [REMOTE ] AG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:04:15.366625] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-15T17:04:15.657896] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-09-15T17:04:16.214292] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-15T17:04:16.215225] [INFO ] [REMOTE ] AFGB: Full fetch complete (2647 records). [2025-09-15T17:04:16.215297] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-09-15T17:04:16.463000] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-09-15T17:04:16.591465] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-09-15T17:04:16.591555] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-09-15T17:04:16.591676] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-09-15T17:04:16.591719] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-09-15T17:04:16.592187] [DEBUG] [LOCAL ] AFGB: Trimmed 2647 records to 1640 (keeping 150 days of data) [2025-09-15T17:04:16.605804] [DEBUG] [LOCAL ] AFGB: Primary data saved (1640 records). [2025-09-15T17:04:16.605889] [INFO ] [MAIN ] AFGB: Full history saved. [2025-09-15T17:04:16.605981] [INFO ] [MAIN ] Update Progress: 48/2369 symbols completed. AFGB took 33.4s. Estimated remaining: 3h 24m 7s. Rate: 11.4 symbols/min [2025-09-15T17:04:16.779921] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:04:16.833057] [DEBUG] [LOCAL ] AGCO: Loaded 31794 existing records from primary storage. [2025-09-15T17:04:16.833225] [INFO ] [MAIN ] AGCO: Loaded 31794 existing records. [2025-09-15T17:04:17.016812] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:04:17.017088] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-09-15T17:04:17.017135] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-09-15T17:04:17.017966] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-09-15T17:04:17.018034] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-09-15T17:04:17.263581] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-09-15T17:04:17.390953] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:04:18.057912] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-09-15T17:04:18.239706] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-15T17:04:18.375250] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-15T17:04:18.857844] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-09-15T17:04:18.888194] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T17:04:19.318885] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-15T17:04:19.657881] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-09-15T17:04:20.138759] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-15T17:04:20.457890] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-09-15T17:04:21.257873] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-09-15T17:04:22.048519] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-15T17:04:22.057810] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-09-15T17:04:22.857896] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-09-15T17:04:23.113183] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-15T17:04:23.501664] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-15T17:04:23.657901] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-09-15T17:04:24.315573] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T17:04:24.457874] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-09-15T17:04:25.257900] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-09-15T17:04:25.689895] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-15T17:04:26.060191] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-09-15T17:04:26.067852] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-15T17:04:26.379562] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-15T17:04:26.857919] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-09-15T17:04:27.657874] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-09-15T17:04:27.876035] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-15T17:04:28.151715] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-15T17:04:28.152552] [INFO ] [REMOTE ] AFGE: Full fetch complete (2654 records). [2025-09-15T17:04:28.152622] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-09-15T17:04:28.478058] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-09-15T17:04:28.515452] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-09-15T17:04:28.515578] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-09-15T17:04:28.515704] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-09-15T17:04:28.515763] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-09-15T17:04:28.516193] [DEBUG] [LOCAL ] AFGE: Trimmed 2654 records to 1879 (keeping 150 days of data) [2025-09-15T17:04:28.528705] [DEBUG] [LOCAL ] AFGE: Primary data saved (1879 records). [2025-09-15T17:04:28.528798] [INFO ] [MAIN ] AFGE: Full history saved. [2025-09-15T17:04:28.528875] [INFO ] [MAIN ] Update Progress: 49/2369 symbols completed. AFGE took 24.9s. Estimated remaining: 3h 29m 16s. Rate: 11.1 symbols/min [2025-09-15T17:04:28.667380] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-15T17:04:28.763484] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:04:28.779416] [DEBUG] [LOCAL ] AGD: Loaded 13696 existing records from primary storage. [2025-09-15T17:04:28.779555] [INFO ] [MAIN ] AGD: Loaded 13696 existing records. [2025-09-15T17:04:28.956573] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:04:28.956905] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-09-15T17:04:28.956972] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-09-15T17:04:28.957552] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-09-15T17:04:28.957617] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-09-15T17:04:29.269764] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-09-15T17:04:29.308326] [INFO ] [REMOTE ] AGD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:04:29.700972] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-15T17:04:30.057891] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-09-15T17:04:30.633484] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-15T17:04:30.857854] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-09-15T17:04:31.040406] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-15T17:04:31.657931] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-09-15T17:04:32.457914] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-09-15T17:04:32.969612] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-15T17:04:33.092340] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T17:04:33.257907] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-09-15T17:04:33.943397] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T17:04:34.057985] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-09-15T17:04:34.857944] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-09-15T17:04:35.373118] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-15T17:04:35.657925] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-09-15T17:04:35.724230] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-15T17:04:36.118569] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-15T17:04:36.314230] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-15T17:04:36.457974] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-09-15T17:04:37.257884] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-09-15T17:04:37.857086] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T17:04:38.058052] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-09-15T17:04:38.857904] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-09-15T17:04:39.069996] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-15T17:04:39.076725] [INFO ] [REMOTE ] AFL: Full fetch complete (57754 records). [2025-09-15T17:04:39.077057] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-09-15T17:04:39.449143] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-15T17:04:39.463962] [INFO ] [REMOTE ] AGCO: Full fetch complete (46547 records). [2025-09-15T17:04:39.485286] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-09-15T17:04:39.661479] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-09-15T17:04:39.671976] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-09-15T17:04:39.661320] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-09-15T17:04:39.688661] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-09-15T17:04:39.702798] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-09-15T17:04:39.702679] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-15T17:04:39.847186] [DEBUG] [LOCAL ] AFL: Trimmed 57754 records to 39216 (keeping 150 days of data) [2025-09-15T17:04:40.116218] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-09-15T17:04:40.117229] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-09-15T17:04:40.118177] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-09-15T17:04:40.118462] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-09-15T17:04:40.122543] [DEBUG] [LOCAL ] AGCO: Trimmed 46547 records to 31094 (keeping 150 days of data) [2025-09-15T17:04:40.464542] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-09-15T17:04:40.471266] [DEBUG] [LOCAL ] AFL: Primary data saved (39216 records). [2025-09-15T17:04:40.471859] [INFO ] [MAIN ] AFL: Full history saved. [2025-09-15T17:04:40.475915] [INFO ] [MAIN ] Update Progress: 50/2369 symbols completed. AFL took 32.6s. Estimated remaining: 3h 34m 14s. Rate: 10.8 symbols/min [2025-09-15T17:04:40.652737] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:04:40.667527] [DEBUG] [LOCAL ] AGCO: Primary data saved (31094 records). [2025-09-15T17:04:40.667712] [INFO ] [MAIN ] AGCO: Full history saved. [2025-09-15T17:04:40.670684] [INFO ] [MAIN ] Update Progress: 51/2369 symbols completed. AGCO took 24.1s. Estimated remaining: 3h 30m 5s. Rate: 11.0 symbols/min [2025-09-15T17:04:40.863961] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:04:40.864798] [DEBUG] [LOCAL ] AGI: Loaded 40181 existing records from primary storage. [2025-09-15T17:04:40.865099] [INFO ] [MAIN ] AGI: Loaded 40181 existing records. [2025-09-15T17:04:41.053958] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:04:41.054267] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-09-15T17:04:41.054330] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-09-15T17:04:41.055610] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-09-15T17:04:41.055697] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-09-15T17:04:41.188333] [DEBUG] [LOCAL ] AGL: Loaded 39444 existing records from primary storage. [2025-09-15T17:04:41.198688] [INFO ] [MAIN ] AGL: Loaded 39444 existing records. [2025-09-15T17:04:41.552336] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:04:41.615682] [INFO ] [REMOTE ] AGI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:04:41.622724] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-09-15T17:04:41.622407] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-09-15T17:04:41.623963] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-15T17:04:41.624020] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-09-15T17:04:41.630989] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-09-15T17:04:41.631058] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-09-15T17:04:41.869081] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-15T17:04:42.037917] [INFO ] [REMOTE ] AGL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:04:42.057819] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-09-15T17:04:42.857833] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-09-15T17:04:42.908604] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-15T17:04:43.334198] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T17:04:43.657886] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-09-15T17:04:44.457956] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-09-15T17:04:44.850753] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-15T17:04:44.877492] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-15T17:04:44.883478] [INFO ] [REMOTE ] AG: Full fetch complete (58316 records). [2025-09-15T17:04:44.883620] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-09-15T17:04:45.264911] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-09-15T17:04:45.268061] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-09-15T17:04:45.269206] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-09-15T17:04:45.269834] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-09-15T17:04:45.269883] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-09-15T17:04:45.271352] [DEBUG] [LOCAL ] AG: Trimmed 58316 records to 39606 (keeping 150 days of data) [2025-09-15T17:04:45.525591] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-15T17:04:45.545339] [DEBUG] [LOCAL ] AG: Primary data saved (39606 records). [2025-09-15T17:04:45.545487] [INFO ] [MAIN ] AG: Full history saved. [2025-09-15T17:04:45.547689] [INFO ] [MAIN ] Update Progress: 52/2369 symbols completed. AG took 31.0s. Estimated remaining: 3h 29m 35s. Rate: 11.1 symbols/min [2025-09-15T17:04:45.717534] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:04:45.729457] [DEBUG] [LOCAL ] AGM: Loaded 8023 existing records from primary storage. [2025-09-15T17:04:45.729594] [INFO ] [MAIN ] AGM: Loaded 8023 existing records. [2025-09-15T17:04:45.907830] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:04:45.908097] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-09-15T17:04:45.908143] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-09-15T17:04:45.908449] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-09-15T17:04:45.908494] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-09-15T17:04:46.062205] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-09-15T17:04:46.273790] [INFO ] [REMOTE ] AGM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:04:46.857935] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-09-15T17:04:46.937346] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-15T17:04:47.442598] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-15T17:04:47.655608] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-15T17:04:47.657807] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-09-15T17:04:48.330401] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-15T17:04:48.457904] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-09-15T17:04:49.257884] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-09-15T17:04:49.999892] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-15T17:04:50.057825] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-09-15T17:04:50.219698] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-15T17:04:50.857893] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-09-15T17:04:51.349451] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-15T17:04:51.657891] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-09-15T17:04:52.457912] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-09-15T17:04:52.757005] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-15T17:04:53.053495] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-15T17:04:53.178961] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-15T17:04:53.257828] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-09-15T17:04:54.057885] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-09-15T17:04:54.477083] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-15T17:04:54.857884] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-09-15T17:04:55.040441] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-15T17:04:55.518853] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T17:04:55.657872] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-09-15T17:04:56.284931] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-15T17:04:56.457868] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-09-15T17:04:56.941624] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-15T17:04:57.257865] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-09-15T17:04:57.841358] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-15T17:04:57.842876] [INFO ] [REMOTE ] AGM: Full fetch complete (10274 records). [2025-09-15T17:04:57.842943] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-09-15T17:04:58.062988] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-09-15T17:04:58.198448] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-09-15T17:04:58.198529] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-09-15T17:04:58.198748] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-09-15T17:04:58.198790] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-09-15T17:04:58.199256] [DEBUG] [LOCAL ] AGM: Trimmed 10274 records to 7961 (keeping 150 days of data) [2025-09-15T17:04:58.250293] [DEBUG] [LOCAL ] AGM: Primary data saved (7961 records). [2025-09-15T17:04:58.250416] [INFO ] [MAIN ] AGM: Full history saved. [2025-09-15T17:04:58.250500] [INFO ] [MAIN ] Update Progress: 53/2369 symbols completed. AGM took 12.7s. Estimated remaining: 3h 34m 47s. Rate: 10.8 symbols/min [2025-09-15T17:04:58.424746] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:04:58.445872] [DEBUG] [LOCAL ] AGO: Loaded 20744 existing records from primary storage. [2025-09-15T17:04:58.446006] [INFO ] [MAIN ] AGO: Loaded 20744 existing records. [2025-09-15T17:04:58.619293] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:04:58.619595] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-09-15T17:04:58.619670] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-09-15T17:04:58.620274] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-09-15T17:04:58.620324] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-09-15T17:04:58.867220] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-09-15T17:04:58.971433] [INFO ] [REMOTE ] AGO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:04:59.516847] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-15T17:04:59.523060] [INFO ] [REMOTE ] AGL: Full fetch complete (56914 records). [2025-09-15T17:04:59.523223] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-09-15T17:04:59.668468] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-09-15T17:04:59.933170] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-09-15T17:04:59.934606] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-15T17:04:59.934665] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-09-15T17:04:59.939629] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-09-15T17:04:59.939846] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-09-15T17:04:59.941613] [DEBUG] [LOCAL ] AGL: Trimmed 56914 records to 38685 (keeping 150 days of data) [2025-09-15T17:05:00.169890] [DEBUG] [LOCAL ] AGL: Primary data saved (38685 records). [2025-09-15T17:05:00.170055] [INFO ] [MAIN ] AGL: Full history saved. [2025-09-15T17:05:00.170146] [INFO ] [MAIN ] Update Progress: 54/2369 symbols completed. AGL took 19.5s. Estimated remaining: 3h 32m 5s. Rate: 10.9 symbols/min [2025-09-15T17:05:00.340534] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:05:00.364526] [DEBUG] [LOCAL ] AGRO: Loaded 24450 existing records from primary storage. [2025-09-15T17:05:00.364677] [INFO ] [MAIN ] AGRO: Loaded 24450 existing records. [2025-09-15T17:05:00.463214] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-09-15T17:05:00.547245] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:05:00.547981] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-09-15T17:05:00.548038] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-09-15T17:05:00.548953] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-09-15T17:05:00.549040] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-09-15T17:05:00.914358] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:05:00.915621] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-15T17:05:01.257941] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-09-15T17:05:02.057878] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-09-15T17:05:02.546845] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-15T17:05:02.575050] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-15T17:05:02.857880] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-09-15T17:05:03.587562] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-15T17:05:03.657869] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-09-15T17:05:03.700116] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-15T17:05:03.703332] [INFO ] [REMOTE ] AGD: Full fetch complete (18666 records). [2025-09-15T17:05:03.703664] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-09-15T17:05:04.099741] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-09-15T17:05:04.099840] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-09-15T17:05:04.100132] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-09-15T17:05:04.100185] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-09-15T17:05:04.100940] [DEBUG] [LOCAL ] AGD: Trimmed 18666 records to 13602 (keeping 150 days of data) [2025-09-15T17:05:04.191428] [DEBUG] [LOCAL ] AGD: Primary data saved (13602 records). [2025-09-15T17:05:04.191824] [INFO ] [MAIN ] AGD: Full history saved. [2025-09-15T17:05:04.191977] [INFO ] [MAIN ] Update Progress: 55/2369 symbols completed. AGD took 35.7s. Estimated remaining: 3h 30m 58s. Rate: 11.0 symbols/min [2025-09-15T17:05:04.378870] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:05:04.406307] [DEBUG] [LOCAL ] AGX: Loaded 25055 existing records from primary storage. [2025-09-15T17:05:04.406485] [INFO ] [MAIN ] AGX: Loaded 25055 existing records. [2025-09-15T17:05:04.466320] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-09-15T17:05:04.610046] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:05:04.610270] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-09-15T17:05:04.610318] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-09-15T17:05:04.611013] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-09-15T17:05:04.611064] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-09-15T17:05:04.974957] [INFO ] [REMOTE ] AGX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:05:05.000926] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T17:05:05.257876] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-09-15T17:05:05.966492] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-15T17:05:06.057884] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-09-15T17:05:06.147263] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-15T17:05:06.857934] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-09-15T17:05:07.657873] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-09-15T17:05:08.057863] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-15T17:05:08.091434] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-15T17:05:08.457884] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-09-15T17:05:09.144548] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-15T17:05:09.180266] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-15T17:05:09.257876] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-09-15T17:05:10.057928] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-09-15T17:05:10.588267] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-15T17:05:10.857873] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-09-15T17:05:11.129554] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T17:05:11.657923] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-09-15T17:05:12.397900] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-15T17:05:12.457849] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-09-15T17:05:12.652730] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T17:05:13.257871] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-09-15T17:05:13.341661] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-15T17:05:14.057846] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-09-15T17:05:14.081284] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T17:05:14.857878] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-09-15T17:05:14.886400] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-15T17:05:14.889610] [INFO ] [REMOTE ] AGO: Full fetch complete (30363 records). [2025-09-15T17:05:14.889743] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-09-15T17:05:15.265083] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-09-15T17:05:15.265191] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-09-15T17:05:15.265568] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-09-15T17:05:15.265612] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-09-15T17:05:15.266426] [DEBUG] [LOCAL ] AGO: Trimmed 30363 records to 20242 (keeping 150 days of data) [2025-09-15T17:05:15.396080] [DEBUG] [LOCAL ] AGO: Primary data saved (20242 records). [2025-09-15T17:05:15.396243] [INFO ] [MAIN ] AGO: Full history saved. [2025-09-15T17:05:15.396359] [INFO ] [MAIN ] Update Progress: 56/2369 symbols completed. AGO took 17.1s. Estimated remaining: 3h 34m 49s. Rate: 10.8 symbols/min [2025-09-15T17:05:15.566130] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:05:15.597708] [DEBUG] [LOCAL ] AHH: Loaded 30344 existing records from primary storage. [2025-09-15T17:05:15.597876] [INFO ] [MAIN ] AHH: Loaded 30344 existing records. [2025-09-15T17:05:15.663251] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-09-15T17:05:15.775169] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:05:15.775407] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-09-15T17:05:15.775452] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-09-15T17:05:15.776107] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-09-15T17:05:15.776159] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-09-15T17:05:16.130764] [INFO ] [REMOTE ] AHH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:05:16.150372] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-15T17:05:16.457875] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-09-15T17:05:16.786852] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-15T17:05:17.257889] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-09-15T17:05:18.042731] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-15T17:05:18.057820] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-09-15T17:05:18.150717] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-15T17:05:18.857879] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-09-15T17:05:19.007249] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-15T17:05:19.011063] [INFO ] [REMOTE ] AGRO: Full fetch complete (37485 records). [2025-09-15T17:05:19.011193] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-09-15T17:05:19.399440] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-09-15T17:05:19.399520] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-09-15T17:05:19.399951] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-09-15T17:05:19.400003] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-09-15T17:05:19.400877] [DEBUG] [LOCAL ] AGRO: Trimmed 37485 records to 23968 (keeping 150 days of data) [2025-09-15T17:05:19.542157] [DEBUG] [LOCAL ] AGRO: Primary data saved (23968 records). [2025-09-15T17:05:19.542296] [INFO ] [MAIN ] AGRO: Full history saved. [2025-09-15T17:05:19.542390] [INFO ] [MAIN ] Update Progress: 57/2369 symbols completed. AGRO took 19.4s. Estimated remaining: 3h 33m 46s. Rate: 10.8 symbols/min [2025-09-15T17:05:19.663071] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-09-15T17:05:19.733183] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:05:19.733373] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-09-15T17:05:19.733418] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-09-15T17:05:19.733545] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-09-15T17:05:19.733583] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-15T17:05:19.733624] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-15T17:05:19.733678] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-09-15T17:05:20.086269] [INFO ] [REMOTE ] AHL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:05:20.457930] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-09-15T17:05:20.459011] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T17:05:20.467852] [INFO ] [REMOTE ] AGI: Full fetch complete (58059 records). [2025-09-15T17:05:20.467977] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-09-15T17:05:20.849503] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-09-15T17:05:20.849586] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-09-15T17:05:20.850178] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-09-15T17:05:20.850224] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-09-15T17:05:20.851497] [DEBUG] [LOCAL ] AGI: Trimmed 58059 records to 39404 (keeping 150 days of data) [2025-09-15T17:05:20.990572] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T17:05:21.136992] [DEBUG] [LOCAL ] AGI: Primary data saved (39404 records). [2025-09-15T17:05:21.137151] [INFO ] [MAIN ] AGI: Full history saved. [2025-09-15T17:05:21.138498] [INFO ] [MAIN ] Update Progress: 58/2369 symbols completed. AGI took 40.7s. Estimated remaining: 3h 31m 3s. Rate: 11.0 symbols/min [2025-09-15T17:05:21.262940] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-02. [2025-09-15T17:05:21.308636] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:05:21.351298] [DEBUG] [LOCAL ] AHR: Loaded 37011 existing records from primary storage. [2025-09-15T17:05:21.351448] [INFO ] [MAIN ] AHR: Loaded 37011 existing records. [2025-09-15T17:05:21.527459] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:05:21.533003] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:05:21.533310] [WARN ] [REMOTE ] AHL: No data returned for month 2025-02 [2025-09-15T17:05:21.534680] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-09-15T17:05:21.534741] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-09-15T17:05:21.535570] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-09-15T17:05:21.535621] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-09-15T17:05:21.902512] [INFO ] [REMOTE ] AHR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:05:22.015954] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T17:05:22.057830] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-09-15T17:05:22.857862] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-09-15T17:05:23.308038] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-15T17:05:23.657884] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-09-15T17:05:24.449419] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-15T17:05:24.458227] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-03. [2025-09-15T17:05:24.645834] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:05:24.646146] [WARN ] [REMOTE ] AHL: No data returned for month 2025-03 [2025-09-15T17:05:24.874370] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-15T17:05:25.257914] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-09-15T17:05:26.057930] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-09-15T17:05:26.538707] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T17:05:26.857893] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-09-15T17:05:27.271357] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-15T17:05:27.657926] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-09-15T17:05:28.029066] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-15T17:05:28.457927] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-09-15T17:05:28.783825] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-15T17:05:29.257890] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-04. [2025-09-15T17:05:29.460403] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:05:29.460744] [WARN ] [REMOTE ] AHL: No data returned for month 2025-04 [2025-09-15T17:05:30.057895] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-05. [2025-09-15T17:05:30.150717] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-15T17:05:30.809515] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-15T17:05:30.857826] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-06. [2025-09-15T17:05:31.657877] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-09-15T17:05:31.787432] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-15T17:05:32.457880] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-07. [2025-09-15T17:05:32.748762] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-15T17:05:33.257899] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-09-15T17:05:33.363962] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-15T17:05:34.057907] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-08. [2025-09-15T17:05:34.731561] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T17:05:34.857880] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-09-15T17:05:34.905020] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-15T17:05:35.657927] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-09-15T17:05:36.202377] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-15T17:05:36.457919] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-09-15T17:05:36.844617] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-15T17:05:37.257899] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-09-15T17:05:37.884976] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T17:05:38.057994] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-09-15T17:05:38.518162] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T17:05:38.524992] [INFO ] [REMOTE ] AHH: Full fetch complete (45199 records). [2025-09-15T17:05:38.525254] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-09-15T17:05:38.868498] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-09-15T17:05:39.000166] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-09-15T17:05:39.000251] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-09-15T17:05:39.000886] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-09-15T17:05:39.000941] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-09-15T17:05:39.002223] [DEBUG] [LOCAL ] AHH: Trimmed 45199 records to 29529 (keeping 150 days of data) [2025-09-15T17:05:39.184983] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T17:05:39.203145] [DEBUG] [LOCAL ] AHH: Primary data saved (29529 records). [2025-09-15T17:05:39.203279] [INFO ] [MAIN ] AHH: Full history saved. [2025-09-15T17:05:39.204917] [INFO ] [MAIN ] Update Progress: 59/2369 symbols completed. AHH took 23.8s. Estimated remaining: 3h 39m 10s. Rate: 10.5 symbols/min [2025-09-15T17:05:39.373506] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:05:39.381527] [DEBUG] [LOCAL ] AHT: Loaded 4581 existing records from primary storage. [2025-09-15T17:05:39.381687] [INFO ] [MAIN ] AHT: Loaded 4581 existing records. [2025-09-15T17:05:39.562086] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:05:39.562428] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-09-15T17:05:39.562490] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-09-15T17:05:39.562778] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-09-15T17:05:39.562847] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-09-15T17:05:39.667404] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-09. [2025-09-15T17:05:39.926706] [INFO ] [REMOTE ] AHT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:05:40.106987] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-15T17:05:40.457869] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-09-15T17:05:40.704459] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T17:05:40.709115] [INFO ] [REMOTE ] AHL: Full fetch complete (15664 records). [2025-09-15T17:05:40.709228] [DEBUG] [VALIDATOR ] AHL: Validating primary data. [2025-09-15T17:05:40.907226] [WARN ] [VALIDATOR ] AHL: Validation failed - insufficient historical data. Have 89 unique days, need 150 days [2025-09-15T17:05:40.907685] [FATAL] [MAIN ] AHL: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:05:40.907745] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:05:40.907796] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-15T17:05:40.907872] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-15T17:05:40.907929] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-09-15T17:05:40.907984] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-09-15T17:05:40.908072] [INFO ] [MAIN ] Update Progress: 60/2369 symbols completed. AHL took 21.4s. Estimated remaining: 3h 36m 31s. Rate: 10.7 symbols/min [2025-09-15T17:05:41.099550] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-15T17:05:41.134705] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:05:41.178050] [DEBUG] [LOCAL ] AI: Loaded 40507 existing records from primary storage. [2025-09-15T17:05:41.178249] [INFO ] [MAIN ] AI: Loaded 40507 existing records. [2025-09-15T17:05:41.263066] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-09-15T17:05:41.366375] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:05:41.366601] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-09-15T17:05:41.366668] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-09-15T17:05:41.367618] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-09-15T17:05:41.367710] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-09-15T17:05:41.730730] [INFO ] [REMOTE ] AI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:05:42.057891] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-09-15T17:05:42.242407] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T17:05:42.246458] [INFO ] [REMOTE ] AGX: Full fetch complete (36487 records). [2025-09-15T17:05:42.246545] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-09-15T17:05:42.616016] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-09-15T17:05:42.616100] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-09-15T17:05:42.616701] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-09-15T17:05:42.616753] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-09-15T17:05:42.617913] [DEBUG] [LOCAL ] AGX: Trimmed 36487 records to 24492 (keeping 150 days of data) [2025-09-15T17:05:42.778126] [DEBUG] [LOCAL ] AGX: Primary data saved (24492 records). [2025-09-15T17:05:42.778263] [INFO ] [MAIN ] AGX: Full history saved. [2025-09-15T17:05:42.778356] [INFO ] [MAIN ] Update Progress: 61/2369 symbols completed. AGX took 38.6s. Estimated remaining: 3h 34m 3s. Rate: 10.8 symbols/min [2025-09-15T17:05:42.863078] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-09-15T17:05:42.954541] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:05:42.994525] [DEBUG] [LOCAL ] AIG: Loaded 40230 existing records from primary storage. [2025-09-15T17:05:42.994701] [INFO ] [MAIN ] AIG: Loaded 40230 existing records. [2025-09-15T17:05:43.169659] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:05:43.169901] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-09-15T17:05:43.169946] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-09-15T17:05:43.170848] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-09-15T17:05:43.170901] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-09-15T17:05:43.484672] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-15T17:05:43.541187] [INFO ] [REMOTE ] AIG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:05:43.619903] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-15T17:05:43.657834] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-09-15T17:05:44.457910] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-09-15T17:05:44.701158] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T17:05:44.707355] [INFO ] [REMOTE ] AHR: Full fetch complete (53653 records). [2025-09-15T17:05:44.707469] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-09-15T17:05:45.089927] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-09-15T17:05:45.090010] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-09-15T17:05:45.090573] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-09-15T17:05:45.090656] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-09-15T17:05:45.091882] [DEBUG] [LOCAL ] AHR: Trimmed 53653 records to 36372 (keeping 150 days of data) [2025-09-15T17:05:45.263864] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-09-15T17:05:45.320794] [DEBUG] [LOCAL ] AHR: Primary data saved (36372 records). [2025-09-15T17:05:45.320928] [INFO ] [MAIN ] AHR: Full history saved. [2025-09-15T17:05:45.321013] [INFO ] [MAIN ] Update Progress: 62/2369 symbols completed. AHR took 24.2s. Estimated remaining: 3h 32m 5s. Rate: 10.9 symbols/min [2025-09-15T17:05:45.500555] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:05:45.500803] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-09-15T17:05:45.500842] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-09-15T17:05:45.500968] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-09-15T17:05:45.501007] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-15T17:05:45.501047] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-15T17:05:45.501080] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-09-15T17:05:45.861897] [INFO ] [REMOTE ] AII: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:05:46.057880] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-02. [2025-09-15T17:05:46.256806] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:05:46.257123] [WARN ] [REMOTE ] AII: No data returned for month 2025-02 [2025-09-15T17:05:46.780703] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-15T17:05:46.866230] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-09-15T17:05:46.887163] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-15T17:05:47.608612] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-15T17:05:47.657882] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-09-15T17:05:48.457886] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-09-15T17:05:49.257838] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-03. [2025-09-15T17:05:49.300591] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T17:05:49.476933] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:05:49.477301] [WARN ] [REMOTE ] AII: No data returned for month 2025-03 [2025-09-15T17:05:50.057874] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-09-15T17:05:50.195789] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-15T17:05:50.594259] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-15T17:05:50.857868] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-09-15T17:05:51.401775] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-15T17:05:51.657871] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-09-15T17:05:52.270280] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-15T17:05:52.457882] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-09-15T17:05:53.257900] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-09-15T17:05:53.778937] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-15T17:05:53.977859] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-15T17:05:54.057868] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-09-15T17:05:54.857877] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-09-15T17:05:55.657830] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-04. [2025-09-15T17:05:55.864380] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:05:55.865179] [WARN ] [REMOTE ] AII: No data returned for month 2025-04 [2025-09-15T17:05:56.205452] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T17:05:56.247307] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-15T17:05:56.457917] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-09-15T17:05:57.257902] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-09-15T17:05:57.967073] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-15T17:05:57.968514] [INFO ] [REMOTE ] AHT: Full fetch complete (6637 records). [2025-09-15T17:05:57.968582] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-09-15T17:05:58.067551] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-09-15T17:05:58.331798] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-09-15T17:05:58.331878] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-09-15T17:05:58.332082] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-09-15T17:05:58.332127] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-09-15T17:05:58.332556] [DEBUG] [LOCAL ] AHT: Trimmed 6637 records to 4581 (keeping 150 days of data) [2025-09-15T17:05:58.364702] [DEBUG] [LOCAL ] AHT: Primary data saved (4581 records). [2025-09-15T17:05:58.364822] [INFO ] [MAIN ] AHT: Full history saved. [2025-09-15T17:05:58.364930] [INFO ] [MAIN ] Update Progress: 63/2369 symbols completed. AHT took 19.2s. Estimated remaining: 3h 36m 35s. Rate: 10.6 symbols/min [2025-09-15T17:05:58.532522] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:05:58.556603] [DEBUG] [LOCAL ] AIN: Loaded 18249 existing records from primary storage. [2025-09-15T17:05:58.556763] [INFO ] [MAIN ] AIN: Loaded 18249 existing records. [2025-09-15T17:05:58.736034] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:05:58.736409] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-09-15T17:05:58.736465] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-09-15T17:05:58.746914] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-09-15T17:05:58.761485] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-09-15T17:05:58.841601] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-15T17:05:58.865055] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-05. [2025-09-15T17:05:59.148691] [INFO ] [REMOTE ] AIN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:05:59.656769] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T17:05:59.666525] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-09-15T17:05:59.869751] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-15T17:06:00.457909] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-09-15T17:06:01.257881] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-06. [2025-09-15T17:06:02.059144] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-09-15T17:06:02.062223] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-09-15T17:06:02.464131] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-15T17:06:02.857891] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-09-15T17:06:02.981944] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-15T17:06:03.657874] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-09-15T17:06:03.958619] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-15T17:06:04.457881] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-07. [2025-09-15T17:06:04.969223] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-15T17:06:05.004910] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-15T17:06:05.257888] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-09-15T17:06:05.986104] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-15T17:06:06.057882] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-09-15T17:06:06.814359] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-15T17:06:06.820370] [INFO ] [REMOTE ] AIG: Full fetch complete (58153 records). [2025-09-15T17:06:06.820508] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-09-15T17:06:06.863823] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-08. [2025-09-15T17:06:07.207994] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-09-15T17:06:07.208100] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-09-15T17:06:07.208772] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-09-15T17:06:07.208823] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-09-15T17:06:07.210123] [DEBUG] [LOCAL ] AIG: Trimmed 58153 records to 39454 (keeping 150 days of data) [2025-09-15T17:06:07.456040] [DEBUG] [LOCAL ] AIG: Primary data saved (39454 records). [2025-09-15T17:06:07.456203] [INFO ] [MAIN ] AIG: Full history saved. [2025-09-15T17:06:07.456804] [INFO ] [MAIN ] Update Progress: 64/2369 symbols completed. AIG took 24.7s. Estimated remaining: 3h 38m 34s. Rate: 10.5 symbols/min [2025-09-15T17:06:07.634835] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:06:07.644365] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-15T17:06:07.654960] [DEBUG] [LOCAL ] AIO: Loaded 9333 existing records from primary storage. [2025-09-15T17:06:07.655137] [INFO ] [MAIN ] AIO: Loaded 9333 existing records. [2025-09-15T17:06:07.666438] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-09-15T17:06:07.834531] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:06:07.834777] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-09-15T17:06:07.834832] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-09-15T17:06:07.835212] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-09-15T17:06:07.835259] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-09-15T17:06:08.193749] [INFO ] [REMOTE ] AIO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:06:08.250697] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-15T17:06:08.463182] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-09. [2025-09-15T17:06:08.472478] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-15T17:06:09.163613] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T17:06:09.165826] [INFO ] [REMOTE ] AII: Full fetch complete (9454 records). [2025-09-15T17:06:09.165898] [DEBUG] [VALIDATOR ] AII: Validating primary data. [2025-09-15T17:06:09.263048] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-09-15T17:06:09.350982] [WARN ] [VALIDATOR ] AII: Validation failed - insufficient historical data. Have 89 unique days, need 150 days [2025-09-15T17:06:09.351268] [FATAL] [MAIN ] AII: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:06:09.351327] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:06:09.351374] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-15T17:06:09.351442] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-15T17:06:09.351480] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-09-15T17:06:09.351525] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-09-15T17:06:09.351589] [INFO ] [MAIN ] Update Progress: 65/2369 symbols completed. AII took 24.0s. Estimated remaining: 3h 36m 14s. Rate: 10.7 symbols/min [2025-09-15T17:06:09.527685] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:06:09.548665] [DEBUG] [LOCAL ] AIR: Loaded 19592 existing records from primary storage. [2025-09-15T17:06:09.548787] [INFO ] [MAIN ] AIR: Loaded 19592 existing records. [2025-09-15T17:06:09.730834] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:06:09.731123] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-09-15T17:06:09.731171] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-09-15T17:06:09.732093] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-09-15T17:06:09.732146] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-09-15T17:06:10.060193] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-09-15T17:06:10.078305] [INFO ] [REMOTE ] AIR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:06:10.106923] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-15T17:06:10.857892] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-09-15T17:06:11.234744] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-15T17:06:11.657883] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-09-15T17:06:12.457892] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-09-15T17:06:12.549524] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-15T17:06:13.198100] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-15T17:06:13.204118] [INFO ] [REMOTE ] AI: Full fetch complete (58428 records). [2025-09-15T17:06:13.204268] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-09-15T17:06:13.270258] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-09-15T17:06:13.600405] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-09-15T17:06:13.600500] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-09-15T17:06:13.601197] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-09-15T17:06:13.601260] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-09-15T17:06:13.602708] [DEBUG] [LOCAL ] AI: Trimmed 58428 records to 39727 (keeping 150 days of data) [2025-09-15T17:06:13.672418] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-15T17:06:13.867936] [DEBUG] [LOCAL ] AI: Primary data saved (39727 records). [2025-09-15T17:06:13.868101] [INFO ] [MAIN ] AI: Full history saved. [2025-09-15T17:06:13.868198] [INFO ] [MAIN ] Update Progress: 66/2369 symbols completed. AI took 33.0s. Estimated remaining: 3h 35m 29s. Rate: 10.7 symbols/min [2025-09-15T17:06:14.039691] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:06:14.060966] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-09-15T17:06:14.061565] [DEBUG] [LOCAL ] AIT: Loaded 20843 existing records from primary storage. [2025-09-15T17:06:14.063005] [INFO ] [MAIN ] AIT: Loaded 20843 existing records. [2025-09-15T17:06:14.243117] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:06:14.243365] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-09-15T17:06:14.243413] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-09-15T17:06:14.244453] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-09-15T17:06:14.244510] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-09-15T17:06:14.605192] [INFO ] [REMOTE ] AIT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:06:14.622000] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T17:06:14.857872] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-09-15T17:06:14.996275] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-15T17:06:15.657875] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-09-15T17:06:16.457878] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-09-15T17:06:16.781116] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-15T17:06:16.904742] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-15T17:06:17.257837] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-09-15T17:06:17.447477] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T17:06:18.057872] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-09-15T17:06:18.162323] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-15T17:06:18.857878] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-09-15T17:06:18.920460] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T17:06:19.657879] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-09-15T17:06:19.716769] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-15T17:06:20.457849] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-09-15T17:06:20.593022] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T17:06:21.069878] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-15T17:06:21.257877] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-09-15T17:06:22.057870] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-09-15T17:06:22.660345] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T17:06:22.721201] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-15T17:06:22.857853] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-09-15T17:06:23.657880] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-09-15T17:06:24.117571] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T17:06:24.457867] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-09-15T17:06:24.871169] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T17:06:25.257879] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-09-15T17:06:25.513819] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T17:06:25.516804] [INFO ] [REMOTE ] AIN: Full fetch complete (26035 records). [2025-09-15T17:06:25.516883] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-09-15T17:06:25.883398] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-09-15T17:06:25.883483] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-09-15T17:06:25.883829] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-09-15T17:06:25.883876] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-09-15T17:06:25.884753] [DEBUG] [LOCAL ] AIN: Trimmed 26035 records to 17889 (keeping 150 days of data) [2025-09-15T17:06:26.009297] [DEBUG] [LOCAL ] AIN: Primary data saved (17889 records). [2025-09-15T17:06:26.009462] [INFO ] [MAIN ] AIN: Full history saved. [2025-09-15T17:06:26.009551] [INFO ] [MAIN ] Update Progress: 67/2369 symbols completed. AIN took 27.6s. Estimated remaining: 3h 39m 8s. Rate: 10.5 symbols/min [2025-09-15T17:06:26.063728] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-09-15T17:06:26.181920] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:06:26.209833] [DEBUG] [LOCAL ] AIV: Loaded 30028 existing records from primary storage. [2025-09-15T17:06:26.209975] [INFO ] [MAIN ] AIV: Loaded 30028 existing records. [2025-09-15T17:06:26.388268] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:06:26.388658] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-09-15T17:06:26.388742] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-09-15T17:06:26.389806] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-09-15T17:06:26.389862] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-09-15T17:06:26.521628] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-15T17:06:26.781769] [INFO ] [REMOTE ] AIV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:06:26.857841] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-09-15T17:06:27.381375] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-15T17:06:27.657904] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-09-15T17:06:28.463072] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-09-15T17:06:28.470078] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-15T17:06:28.878081] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-15T17:06:29.047604] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-15T17:06:29.049490] [INFO ] [REMOTE ] AIO: Full fetch complete (14710 records). [2025-09-15T17:06:29.049577] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-09-15T17:06:29.266937] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-09-15T17:06:29.422403] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-09-15T17:06:29.422480] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-09-15T17:06:29.422722] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-09-15T17:06:29.422763] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-09-15T17:06:29.423246] [DEBUG] [LOCAL ] AIO: Trimmed 14710 records to 9165 (keeping 150 days of data) [2025-09-15T17:06:29.481241] [DEBUG] [LOCAL ] AIO: Primary data saved (9165 records). [2025-09-15T17:06:29.481405] [INFO ] [MAIN ] AIO: Full history saved. [2025-09-15T17:06:29.481501] [INFO ] [MAIN ] Update Progress: 68/2369 symbols completed. AIO took 22.0s. Estimated remaining: 3h 37m 47s. Rate: 10.6 symbols/min [2025-09-15T17:06:29.649258] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:06:29.672812] [DEBUG] [LOCAL ] AIZ: Loaded 22672 existing records from primary storage. [2025-09-15T17:06:29.672963] [INFO ] [MAIN ] AIZ: Loaded 22672 existing records. [2025-09-15T17:06:29.849838] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:06:29.850113] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-09-15T17:06:29.850159] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-09-15T17:06:29.851173] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-09-15T17:06:29.851237] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-09-15T17:06:30.063099] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-09-15T17:06:30.206082] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:06:30.477762] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-15T17:06:30.857879] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-09-15T17:06:31.078313] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-15T17:06:31.660366] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-09-15T17:06:31.664606] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T17:06:31.669667] [INFO ] [REMOTE ] AIR: Full fetch complete (28611 records). [2025-09-15T17:06:31.669872] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-09-15T17:06:32.247722] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-09-15T17:06:32.247822] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-09-15T17:06:32.248255] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-09-15T17:06:32.248306] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-09-15T17:06:32.249493] [DEBUG] [LOCAL ] AIR: Trimmed 28611 records to 19182 (keeping 150 days of data) [2025-09-15T17:06:32.374801] [DEBUG] [LOCAL ] AIR: Primary data saved (19182 records). [2025-09-15T17:06:32.374965] [INFO ] [MAIN ] AIR: Full history saved. [2025-09-15T17:06:32.375060] [INFO ] [MAIN ] Update Progress: 69/2369 symbols completed. AIR took 23.0s. Estimated remaining: 3h 36m 8s. Rate: 10.6 symbols/min [2025-09-15T17:06:32.462972] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-09-15T17:06:32.553712] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:06:32.558357] [DEBUG] [LOCAL ] AIZN: Loaded 2657 existing records from primary storage. [2025-09-15T17:06:32.558455] [INFO ] [MAIN ] AIZN: Loaded 2657 existing records. [2025-09-15T17:06:32.735456] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:06:32.735722] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-09-15T17:06:32.735773] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-09-15T17:06:32.736002] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-09-15T17:06:32.736048] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-09-15T17:06:33.110322] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:06:33.121225] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-15T17:06:33.257867] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-09-15T17:06:33.846849] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-15T17:06:34.057875] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-09-15T17:06:34.857885] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-09-15T17:06:35.059267] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-15T17:06:35.657948] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-09-15T17:06:35.720762] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T17:06:35.796226] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-15T17:06:36.457882] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-09-15T17:06:36.608131] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-15T17:06:37.257876] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-09-15T17:06:37.406963] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-15T17:06:37.835435] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-15T17:06:38.057886] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-09-15T17:06:38.857907] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-09-15T17:06:39.061753] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-15T17:06:39.657879] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-09-15T17:06:40.338015] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T17:06:40.457832] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-09-15T17:06:40.527951] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-15T17:06:41.257879] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-09-15T17:06:41.663532] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-15T17:06:41.902740] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T17:06:42.057924] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-09-15T17:06:42.857892] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-09-15T17:06:43.073416] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T17:06:43.076278] [INFO ] [REMOTE ] AIT: Full fetch complete (30534 records). [2025-09-15T17:06:43.076427] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-09-15T17:06:43.447603] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-09-15T17:06:43.447705] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-09-15T17:06:43.448082] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-09-15T17:06:43.448123] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-09-15T17:06:43.448965] [DEBUG] [LOCAL ] AIT: Trimmed 30534 records to 20259 (keeping 150 days of data) [2025-09-15T17:06:43.585791] [DEBUG] [LOCAL ] AIT: Primary data saved (20259 records). [2025-09-15T17:06:43.585931] [INFO ] [MAIN ] AIT: Full history saved. [2025-09-15T17:06:43.586019] [INFO ] [MAIN ] Update Progress: 70/2369 symbols completed. AIT took 29.7s. Estimated remaining: 3h 39m 5s. Rate: 10.5 symbols/min [2025-09-15T17:06:43.663081] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-09-15T17:06:43.763819] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:06:43.764007] [DEBUG] [LOCAL ] AJG: No existing data file found in primary storage. [2025-09-15T17:06:43.764046] [WARN ] [MAIN ] AJG: No existing data found, performing full refresh instead. [2025-09-15T17:06:43.764170] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-09-15T17:06:43.764215] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-09-15T17:06:43.764256] [DEBUG] [LOCAL ] AJG: No primary data file found to delete. [2025-09-15T17:06:43.764291] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-09-15T17:06:44.127383] [INFO ] [REMOTE ] AJG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:06:44.222588] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-15T17:06:44.457880] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-09-15T17:06:45.257920] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-09-15T17:06:45.537460] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-15T17:06:45.787144] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-15T17:06:46.021075] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T17:06:46.057899] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-09-15T17:06:46.857941] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-09-15T17:06:47.191103] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T17:06:47.657884] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-09-15T17:06:48.035817] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-15T17:06:48.202754] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-15T17:06:48.457891] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-09-15T17:06:49.257890] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-09-15T17:06:49.607764] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-15T17:06:50.057888] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-09-15T17:06:50.858009] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-09-15T17:06:50.979933] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-15T17:06:50.984958] [INFO ] [REMOTE ] AIV: Full fetch complete (43495 records). [2025-09-15T17:06:50.985075] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-09-15T17:06:51.356357] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-09-15T17:06:51.356468] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-09-15T17:06:51.356943] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-09-15T17:06:51.356989] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-09-15T17:06:51.358011] [DEBUG] [LOCAL ] AIV: Trimmed 43495 records to 29479 (keeping 150 days of data) [2025-09-15T17:06:51.527092] [DEBUG] [LOCAL ] AIV: Primary data saved (29479 records). [2025-09-15T17:06:51.527326] [INFO ] [MAIN ] AIV: Full history saved. [2025-09-15T17:06:51.527502] [INFO ] [MAIN ] Update Progress: 71/2369 symbols completed. AIV took 25.5s. Estimated remaining: 3h 40m 12s. Rate: 10.4 symbols/min [2025-09-15T17:06:51.668716] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-09-15T17:06:51.700000] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:06:51.700196] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-09-15T17:06:51.700234] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-09-15T17:06:51.700354] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-09-15T17:06:51.700392] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-15T17:06:51.700437] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-15T17:06:51.700469] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-09-15T17:06:52.091527] [INFO ] [REMOTE ] AKA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:06:52.100690] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-15T17:06:52.102450] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-15T17:06:52.123880] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T17:06:52.127172] [INFO ] [REMOTE ] AIZ: Full fetch complete (33287 records). [2025-09-15T17:06:52.127256] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-09-15T17:06:52.467573] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-09-15T17:06:52.495842] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-09-15T17:06:52.495922] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-09-15T17:06:52.496325] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-09-15T17:06:52.496367] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-09-15T17:06:52.497124] [DEBUG] [LOCAL ] AIZ: Trimmed 33287 records to 22213 (keeping 150 days of data) [2025-09-15T17:06:52.642535] [DEBUG] [LOCAL ] AIZ: Primary data saved (22213 records). [2025-09-15T17:06:52.642693] [INFO ] [MAIN ] AIZ: Full history saved. [2025-09-15T17:06:52.642785] [INFO ] [MAIN ] Update Progress: 72/2369 symbols completed. AIZ took 23.2s. Estimated remaining: 3h 37m 38s. Rate: 10.6 symbols/min [2025-09-15T17:06:52.812636] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:06:52.812857] [DEBUG] [LOCAL ] AKR: No existing data file found in primary storage. [2025-09-15T17:06:52.812896] [WARN ] [MAIN ] AKR: No existing data found, performing full refresh instead. [2025-09-15T17:06:52.813045] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-09-15T17:06:52.813085] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-09-15T17:06:52.813128] [DEBUG] [LOCAL ] AKR: No primary data file found to delete. [2025-09-15T17:06:52.813163] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-09-15T17:06:53.161889] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-15T17:06:53.183269] [INFO ] [REMOTE ] AKR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:06:53.257881] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-09-15T17:06:54.057901] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-09-15T17:06:54.519932] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-15T17:06:54.609442] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T17:06:54.857878] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-09-15T17:06:55.657888] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-09-15T17:06:56.471137] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-09-15T17:06:56.474336] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-15T17:06:56.879594] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-15T17:06:57.090435] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-15T17:06:57.257911] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-09-15T17:06:58.057871] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-09-15T17:06:58.495123] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-15T17:06:58.857891] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-09-15T17:06:59.408919] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-15T17:06:59.657848] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-09-15T17:06:59.991480] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-15T17:07:00.134393] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-15T17:07:00.457870] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-09-15T17:07:00.894008] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-15T17:07:01.257905] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-09-15T17:07:02.057936] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-09-15T17:07:02.477180] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-15T17:07:02.857918] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-09-15T17:07:03.116549] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-15T17:07:03.279579] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-15T17:07:03.657864] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-09-15T17:07:04.167824] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-15T17:07:04.457886] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-09-15T17:07:04.879286] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-15T17:07:04.880029] [INFO ] [REMOTE ] AKA: Full fetch complete (1771 records). [2025-09-15T17:07:04.880098] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-09-15T17:07:05.060058] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-15T17:07:05.060268] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:07:05.060319] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:07:05.060363] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-15T17:07:05.060422] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-15T17:07:05.060468] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-09-15T17:07:05.060509] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-09-15T17:07:05.060569] [INFO ] [MAIN ] Update Progress: 73/2369 symbols completed. AKA took 13.5s. Estimated remaining: 3h 41m 4s. Rate: 10.4 symbols/min [2025-09-15T17:07:05.227333] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:07:05.227525] [DEBUG] [LOCAL ] AL: No existing data file found in primary storage. [2025-09-15T17:07:05.227563] [WARN ] [MAIN ] AL: No existing data found, performing full refresh instead. [2025-09-15T17:07:05.227705] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-09-15T17:07:05.227746] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-09-15T17:07:05.227792] [DEBUG] [LOCAL ] AL: No primary data file found to delete. [2025-09-15T17:07:05.227825] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-09-15T17:07:05.262981] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-09-15T17:07:05.588383] [INFO ] [REMOTE ] AL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:07:05.851524] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-15T17:07:05.852545] [INFO ] [REMOTE ] AIZN: Full fetch complete (4200 records). [2025-09-15T17:07:05.852614] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-09-15T17:07:06.062971] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-09-15T17:07:06.207722] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-09-15T17:07:06.207803] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-09-15T17:07:06.207971] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-09-15T17:07:06.208021] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-09-15T17:07:06.208384] [DEBUG] [LOCAL ] AIZN: Trimmed 4200 records to 2612 (keeping 150 days of data) [2025-09-15T17:07:06.224994] [DEBUG] [LOCAL ] AIZN: Primary data saved (2612 records). [2025-09-15T17:07:06.225057] [INFO ] [MAIN ] AIZN: Full history saved. [2025-09-15T17:07:06.225154] [INFO ] [MAIN ] Update Progress: 74/2369 symbols completed. AIZN took 33.8s. Estimated remaining: 3h 38m 35s. Rate: 10.5 symbols/min [2025-09-15T17:07:06.399617] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:07:06.451127] [DEBUG] [LOCAL ] ALB: Loaded 40199 existing records from primary storage. [2025-09-15T17:07:06.451292] [INFO ] [MAIN ] ALB: Loaded 40199 existing records. [2025-09-15T17:07:06.629758] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:07:06.630100] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-09-15T17:07:06.630149] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-09-15T17:07:06.631502] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-09-15T17:07:06.631556] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-09-15T17:07:06.868974] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-09-15T17:07:06.987003] [INFO ] [REMOTE ] ALB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:07:07.657877] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-09-15T17:07:07.750720] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-15T17:07:08.288817] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-15T17:07:08.457880] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-09-15T17:07:08.822164] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T17:07:09.257876] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-09-15T17:07:09.787415] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-15T17:07:09.792598] [INFO ] [REMOTE ] AJG: Full fetch complete (51487 records). [2025-09-15T17:07:09.792710] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-09-15T17:07:10.064580] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-09-15T17:07:10.188545] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-09-15T17:07:10.188718] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-09-15T17:07:10.189493] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-09-15T17:07:10.189558] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-09-15T17:07:10.191369] [DEBUG] [LOCAL ] AJG: Trimmed 51487 records to 34227 (keeping 150 days of data) [2025-09-15T17:07:10.442141] [DEBUG] [LOCAL ] AJG: Primary data saved (34227 records). [2025-09-15T17:07:10.442378] [INFO ] [MAIN ] AJG: Full history saved. [2025-09-15T17:07:10.442510] [INFO ] [MAIN ] Update Progress: 75/2369 symbols completed. AJG took 26.9s. Estimated remaining: 3h 37m 44s. Rate: 10.5 symbols/min [2025-09-15T17:07:10.624885] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:07:10.667698] [DEBUG] [LOCAL ] ALC: Loaded 38195 existing records from primary storage. [2025-09-15T17:07:10.667941] [INFO ] [MAIN ] ALC: Loaded 38195 existing records. [2025-09-15T17:07:10.855848] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:07:10.856293] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-09-15T17:07:10.856468] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-09-15T17:07:10.857551] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-09-15T17:07:10.857612] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-09-15T17:07:10.869062] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-09-15T17:07:11.054957] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-15T17:07:11.270283] [INFO ] [REMOTE ] ALC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:07:11.657862] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-09-15T17:07:11.758497] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T17:07:11.992256] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-15T17:07:12.457876] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-09-15T17:07:13.058721] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T17:07:13.257910] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-09-15T17:07:13.638046] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-15T17:07:14.057883] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-09-15T17:07:14.402676] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-15T17:07:14.857885] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-09-15T17:07:15.315554] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-15T17:07:15.657875] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-09-15T17:07:16.457901] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-09-15T17:07:16.538164] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-15T17:07:17.257894] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-09-15T17:07:17.424396] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-15T17:07:17.773175] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-15T17:07:18.057877] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-09-15T17:07:18.616871] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-15T17:07:18.857858] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-09-15T17:07:19.657833] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-09-15T17:07:19.757303] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T17:07:20.060400] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-15T17:07:20.457865] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-09-15T17:07:21.049044] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-15T17:07:21.257863] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-09-15T17:07:22.062946] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-09-15T17:07:22.086334] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T17:07:22.611631] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T17:07:22.857899] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-09-15T17:07:23.301436] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-15T17:07:23.657912] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-09-15T17:07:23.942833] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-15T17:07:23.949688] [INFO ] [REMOTE ] AKR: Full fetch complete (49401 records). [2025-09-15T17:07:23.949901] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-09-15T17:07:24.388611] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-09-15T17:07:24.388792] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-09-15T17:07:24.389729] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-09-15T17:07:24.389838] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-09-15T17:07:24.391548] [DEBUG] [LOCAL ] AKR: Trimmed 49401 records to 33836 (keeping 150 days of data) [2025-09-15T17:07:24.458277] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-09-15T17:07:24.686972] [DEBUG] [LOCAL ] AKR: Primary data saved (33836 records). [2025-09-15T17:07:24.687260] [INFO ] [MAIN ] AKR: Full history saved. [2025-09-15T17:07:24.687402] [INFO ] [MAIN ] Update Progress: 76/2369 symbols completed. AKR took 32.0s. Estimated remaining: 3h 41m 56s. Rate: 10.3 symbols/min [2025-09-15T17:07:24.966460] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:07:25.007679] [DEBUG] [LOCAL ] ALE: Loaded 22557 existing records from primary storage. [2025-09-15T17:07:25.008031] [INFO ] [MAIN ] ALE: Loaded 22557 existing records. [2025-09-15T17:07:25.221225] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-15T17:07:25.269325] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-09-15T17:07:25.309990] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:07:25.312625] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-09-15T17:07:25.312770] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-09-15T17:07:25.313492] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-09-15T17:07:25.313554] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-09-15T17:07:25.723793] [INFO ] [REMOTE ] ALE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:07:26.057928] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-09-15T17:07:26.355993] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-15T17:07:26.539686] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-15T17:07:26.857986] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-09-15T17:07:27.411015] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T17:07:27.657896] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-09-15T17:07:28.457886] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-09-15T17:07:28.690883] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-15T17:07:28.899020] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-15T17:07:28.904942] [INFO ] [REMOTE ] ALC: Full fetch complete (55364 records). [2025-09-15T17:07:28.905043] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-09-15T17:07:29.281106] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-09-15T17:07:29.300498] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-09-15T17:07:29.300568] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-09-15T17:07:29.301189] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-09-15T17:07:29.301238] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-09-15T17:07:29.302701] [DEBUG] [LOCAL ] ALC: Trimmed 55364 records to 37480 (keeping 150 days of data) [2025-09-15T17:07:29.434365] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-15T17:07:29.561222] [DEBUG] [LOCAL ] ALC: Primary data saved (37480 records). [2025-09-15T17:07:29.561404] [INFO ] [MAIN ] ALC: Full history saved. [2025-09-15T17:07:29.561531] [INFO ] [MAIN ] Update Progress: 77/2369 symbols completed. ALC took 19.1s. Estimated remaining: 3h 41m 22s. Rate: 10.4 symbols/min [2025-09-15T17:07:30.057873] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-09-15T17:07:30.417498] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-15T17:07:30.857937] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-09-15T17:07:31.578473] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-15T17:07:31.657875] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-09-15T17:07:32.107978] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-15T17:07:32.457940] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-09-15T17:07:33.160371] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T17:07:33.166617] [INFO ] [REMOTE ] AL: Full fetch complete (47533 records). [2025-09-15T17:07:33.166820] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-09-15T17:07:33.268850] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-09-15T17:07:33.601071] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-09-15T17:07:33.601179] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-09-15T17:07:33.601745] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-09-15T17:07:33.601792] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-09-15T17:07:33.603126] [DEBUG] [LOCAL ] AL: Trimmed 47533 records to 32168 (keeping 150 days of data) [2025-09-15T17:07:33.802944] [DEBUG] [LOCAL ] AL: Primary data saved (32168 records). [2025-09-15T17:07:33.803107] [INFO ] [MAIN ] AL: Full history saved. [2025-09-15T17:07:33.803189] [INFO ] [MAIN ] Update Progress: 78/2369 symbols completed. AL took 28.7s. Estimated remaining: 3h 40m 31s. Rate: 10.4 symbols/min [2025-09-15T17:07:34.452103] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-15T17:07:34.457966] [INFO ] [REMOTE ] ALB: Full fetch complete (57873 records). [2025-09-15T17:07:34.458091] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-09-15T17:07:34.840173] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-09-15T17:07:34.840301] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-09-15T17:07:34.841028] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-09-15T17:07:34.841085] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-09-15T17:07:34.858948] [DEBUG] [LOCAL ] ALB: Trimmed 57873 records to 39419 (keeping 150 days of data) [2025-09-15T17:07:34.859701] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-15T17:07:34.867136] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-09-15T17:07:35.132494] [DEBUG] [LOCAL ] ALB: Primary data saved (39419 records). [2025-09-15T17:07:35.132775] [INFO ] [MAIN ] ALB: Full history saved. [2025-09-15T17:07:35.134741] [INFO ] [MAIN ] Update Progress: 79/2369 symbols completed. ALB took 28.9s. Estimated remaining: 3h 38m 16s. Rate: 10.5 symbols/min [2025-09-15T17:07:35.620693] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-15T17:07:35.626863] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-09-15T17:07:36.376152] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-15T17:07:36.381833] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-09-15T17:07:37.749129] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-15T17:07:37.757170] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-09-15T17:07:39.160048] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T17:07:39.171244] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-09-15T17:07:40.496285] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-15T17:07:40.500251] [INFO ] [REMOTE ] ALE: Full fetch complete (31892 records). [2025-09-15T17:07:40.500375] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-09-15T17:07:40.870472] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-09-15T17:07:40.870555] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-09-15T17:07:40.870978] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-09-15T17:07:40.871024] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-09-15T17:07:40.871787] [DEBUG] [LOCAL ] ALE: Trimmed 31892 records to 22355 (keeping 150 days of data) [2025-09-15T17:07:41.010317] [DEBUG] [LOCAL ] ALE: Primary data saved (22355 records). [2025-09-15T17:07:41.010454] [INFO ] [MAIN ] ALE: Full history saved. [2025-09-15T17:07:41.010546] [INFO ] [MAIN ] Update Progress: 80/2369 symbols completed. ALE took 16.3s. Estimated remaining: 3h 38m 15s. Rate: 10.5 symbols/min [2025-09-15T17:07:41.550892] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:07:41.600344] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:07:41.683904] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:07:41.717066] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:07:41.730380] [DEBUG] [LOCAL ] ALG: Loaded 7527 existing records from primary storage. [2025-09-15T17:07:41.730685] [INFO ] [MAIN ] ALG: Loaded 7527 existing records. [2025-09-15T17:07:41.790343] [DEBUG] [LOCAL ] ALEX: Loaded 22143 existing records from primary storage. [2025-09-15T17:07:41.817631] [INFO ] [MAIN ] ALEX: Loaded 22143 existing records. [2025-09-15T17:07:42.071828] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:07:42.099378] [DEBUG] [LOCAL ] ALK: Loaded 39879 existing records from primary storage. [2025-09-15T17:07:42.114818] [DEBUG] [LOCAL ] ALIT: Loaded 39630 existing records from primary storage. [2025-09-15T17:07:42.115179] [INFO ] [MAIN ] ALIT: Loaded 39630 existing records. [2025-09-15T17:07:42.114977] [INFO ] [MAIN ] ALK: Loaded 39879 existing records. [2025-09-15T17:07:42.115099] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-09-15T17:07:42.227322] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:07:42.237670] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-09-15T17:07:42.273288] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-09-15T17:07:42.292107] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-09-15T17:07:42.312705] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-09-15T17:07:42.336284] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-09-15T17:07:42.384054] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-09-15T17:07:42.518135] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-09-15T17:07:42.518043] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:07:42.620101] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-09-15T17:07:42.656112] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:07:42.650923] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-09-15T17:07:42.689014] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-09-15T17:07:42.688977] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-09-15T17:07:42.704441] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-09-15T17:07:42.719817] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-09-15T17:07:42.807805] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-09-15T17:07:42.833062] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-09-15T17:07:43.360786] [INFO ] [REMOTE ] ALG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:07:43.405532] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-09-15T17:07:43.686636] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:07:43.728701] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-09-15T17:07:43.911563] [INFO ] [REMOTE ] ALK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:07:43.929087] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-09-15T17:07:43.932719] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:07:43.933695] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-09-15T17:07:44.105220] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-15T17:07:44.107951] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-09-15T17:07:44.600735] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-15T17:07:44.605889] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-09-15T17:07:45.101309] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-15T17:07:45.104749] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-09-15T17:07:45.585968] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-15T17:07:45.596030] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-09-15T17:07:45.632925] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T17:07:45.643832] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-09-15T17:07:45.673890] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-15T17:07:45.682634] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-09-15T17:07:45.692696] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-15T17:07:46.057897] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-09-15T17:07:46.600489] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-15T17:07:46.815909] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-15T17:07:46.857819] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-09-15T17:07:47.247017] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-15T17:07:47.291069] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-15T17:07:47.596398] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-15T17:07:47.657830] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-09-15T17:07:48.457918] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-09-15T17:07:48.973107] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T17:07:49.257933] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-09-15T17:07:49.530538] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T17:07:50.057871] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-09-15T17:07:50.575971] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-15T17:07:50.608761] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-15T17:07:50.857916] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-09-15T17:07:51.657937] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-09-15T17:07:52.249389] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-15T17:07:52.389428] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-15T17:07:52.457859] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-09-15T17:07:53.257892] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-09-15T17:07:53.818909] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-15T17:07:54.057887] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-09-15T17:07:54.808836] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T17:07:54.857845] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-09-15T17:07:55.661613] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-09-15T17:07:55.668188] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T17:07:56.103144] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-15T17:07:56.374633] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T17:07:56.457881] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-09-15T17:07:57.257877] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-09-15T17:07:57.713385] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-15T17:07:58.057934] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-09-15T17:07:58.866848] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-09-15T17:07:58.869213] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-15T17:07:58.958677] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-15T17:07:59.565340] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T17:07:59.566779] [INFO ] [REMOTE ] ALG: Full fetch complete (11795 records). [2025-09-15T17:07:59.566849] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-09-15T17:07:59.665356] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-09-15T17:07:59.939240] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-09-15T17:07:59.939351] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-09-15T17:07:59.939849] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-09-15T17:07:59.939903] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-09-15T17:07:59.941037] [DEBUG] [LOCAL ] ALG: Trimmed 11795 records to 7302 (keeping 150 days of data) [2025-09-15T17:08:00.006814] [DEBUG] [LOCAL ] ALG: Primary data saved (7302 records). [2025-09-15T17:08:00.007047] [INFO ] [MAIN ] ALG: Full history saved. [2025-09-15T17:08:00.007218] [INFO ] [MAIN ] Update Progress: 81/2369 symbols completed. ALG took 19.0s. Estimated remaining: 3h 44m 25s. Rate: 10.2 symbols/min [2025-09-15T17:08:00.184429] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:08:00.233892] [DEBUG] [LOCAL ] ALL: Loaded 37481 existing records from primary storage. [2025-09-15T17:08:00.234096] [INFO ] [MAIN ] ALL: Loaded 37481 existing records. [2025-09-15T17:08:00.419247] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:08:00.419586] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-09-15T17:08:00.419637] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-09-15T17:08:00.420776] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-09-15T17:08:00.420839] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-09-15T17:08:00.463866] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-09-15T17:08:00.795503] [INFO ] [REMOTE ] ALL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:08:01.257942] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-09-15T17:08:01.295177] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-15T17:08:01.302792] [INFO ] [REMOTE ] ALIT: Full fetch complete (57361 records). [2025-09-15T17:08:01.302989] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-09-15T17:08:01.695745] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-09-15T17:08:01.695882] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-09-15T17:08:01.696840] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-09-15T17:08:01.696920] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-09-15T17:08:01.699289] [DEBUG] [LOCAL ] ALIT: Trimmed 57361 records to 38839 (keeping 150 days of data) [2025-09-15T17:08:01.818496] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T17:08:01.825875] [INFO ] [REMOTE ] ALEX: Full fetch complete (33576 records). [2025-09-15T17:08:01.826633] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-09-15T17:08:02.066221] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-09-15T17:08:02.262376] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-09-15T17:08:02.263044] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-09-15T17:08:02.264108] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-09-15T17:08:02.264209] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-09-15T17:08:02.269134] [DEBUG] [LOCAL ] ALEX: Trimmed 33576 records to 21778 (keeping 150 days of data) [2025-09-15T17:08:02.540468] [DEBUG] [LOCAL ] ALEX: Primary data saved (21778 records). [2025-09-15T17:08:02.541468] [INFO ] [MAIN ] ALEX: Full history saved. [2025-09-15T17:08:02.542155] [INFO ] [MAIN ] Update Progress: 82/2369 symbols completed. ALEX took 21.5s. Estimated remaining: 3h 42m 45s. Rate: 10.3 symbols/min [2025-09-15T17:08:02.747909] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:08:02.786529] [DEBUG] [LOCAL ] ALIT: Primary data saved (38839 records). [2025-09-15T17:08:02.787254] [INFO ] [MAIN ] ALIT: Full history saved. [2025-09-15T17:08:02.789247] [INFO ] [MAIN ] Update Progress: 83/2369 symbols completed. ALIT took 21.8s. Estimated remaining: 3h 40m 5s. Rate: 10.4 symbols/min [2025-09-15T17:08:02.790818] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-15T17:08:02.868062] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-09-15T17:08:03.005826] [DEBUG] [LOCAL ] ALLE: Loaded 33449 existing records from primary storage. [2025-09-15T17:08:03.004153] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:08:03.006679] [INFO ] [MAIN ] ALLE: Loaded 33449 existing records. [2025-09-15T17:08:03.217000] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:08:03.217366] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-09-15T17:08:03.217416] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-09-15T17:08:03.218303] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-09-15T17:08:03.218359] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-09-15T17:08:03.365238] [DEBUG] [LOCAL ] ALLY: Loaded 40000 existing records from primary storage. [2025-09-15T17:08:03.400934] [INFO ] [MAIN ] ALLY: Loaded 40000 existing records. [2025-09-15T17:08:03.806418] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:08:03.807624] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-09-15T17:08:03.807349] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:08:03.808909] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-09-15T17:08:03.808975] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-09-15T17:08:03.810057] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-09-15T17:08:03.810132] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-09-15T17:08:04.192234] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:08:04.228848] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-15T17:08:04.375810] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-15T17:08:04.457868] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-09-15T17:08:05.111535] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-15T17:08:05.257882] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-09-15T17:08:06.057889] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-09-15T17:08:06.235687] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-15T17:08:06.857895] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-09-15T17:08:07.010843] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-15T17:08:07.518479] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T17:08:07.657912] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-09-15T17:08:08.457891] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-09-15T17:08:08.487135] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-15T17:08:08.832383] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-15T17:08:08.838621] [INFO ] [REMOTE ] ALK: Full fetch complete (57648 records). [2025-09-15T17:08:08.838778] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-09-15T17:08:09.224461] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-09-15T17:08:09.224545] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-09-15T17:08:09.225221] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-09-15T17:08:09.225278] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-09-15T17:08:09.226797] [DEBUG] [LOCAL ] ALK: Trimmed 57648 records to 39100 (keeping 150 days of data) [2025-09-15T17:08:09.286806] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-09-15T17:08:09.490163] [DEBUG] [LOCAL ] ALK: Primary data saved (39100 records). [2025-09-15T17:08:09.490409] [INFO ] [MAIN ] ALK: Full history saved. [2025-09-15T17:08:09.490542] [INFO ] [MAIN ] Update Progress: 84/2369 symbols completed. ALK took 28.5s. Estimated remaining: 3h 40m 25s. Rate: 10.4 symbols/min [2025-09-15T17:08:09.686290] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:08:09.723540] [DEBUG] [LOCAL ] ALSN: Loaded 32125 existing records from primary storage. [2025-09-15T17:08:09.723809] [INFO ] [MAIN ] ALSN: Loaded 32125 existing records. [2025-09-15T17:08:09.908014] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:08:09.908370] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-09-15T17:08:09.908469] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-09-15T17:08:09.909407] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-09-15T17:08:09.909460] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-09-15T17:08:10.063095] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-09-15T17:08:10.289263] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:08:10.361589] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-15T17:08:10.857868] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-09-15T17:08:11.178458] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-15T17:08:11.642722] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T17:08:11.657810] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-09-15T17:08:11.944110] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-15T17:08:12.457904] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-09-15T17:08:12.955520] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-15T17:08:13.257889] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-09-15T17:08:14.057896] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-09-15T17:08:14.100303] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T17:08:14.576304] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-15T17:08:14.857877] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-09-15T17:08:15.468749] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T17:08:15.657894] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-09-15T17:08:16.441475] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T17:08:16.457838] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-09-15T17:08:16.822730] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-15T17:08:17.257944] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-09-15T17:08:17.802231] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-15T17:08:17.810254] [INFO ] [REMOTE ] ALL: Full fetch complete (54490 records). [2025-09-15T17:08:17.810430] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-09-15T17:08:18.066910] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-09-15T17:08:18.243244] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-09-15T17:08:18.243346] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-09-15T17:08:18.244051] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-09-15T17:08:18.244112] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-09-15T17:08:18.245431] [DEBUG] [LOCAL ] ALL: Trimmed 54490 records to 36718 (keeping 150 days of data) [2025-09-15T17:08:18.493290] [DEBUG] [LOCAL ] ALL: Primary data saved (36718 records). [2025-09-15T17:08:18.493445] [INFO ] [MAIN ] ALL: Full history saved. [2025-09-15T17:08:18.494318] [INFO ] [MAIN ] Update Progress: 85/2369 symbols completed. ALL took 18.5s. Estimated remaining: 3h 41m 45s. Rate: 10.3 symbols/min [2025-09-15T17:08:18.668924] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:08:18.688066] [DEBUG] [LOCAL ] ALTG: Loaded 17492 existing records from primary storage. [2025-09-15T17:08:18.688208] [INFO ] [MAIN ] ALTG: Loaded 17492 existing records. [2025-09-15T17:08:18.864304] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-09-15T17:08:18.869167] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:08:18.870558] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-09-15T17:08:18.870677] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-09-15T17:08:18.881889] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-09-15T17:08:18.901059] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-09-15T17:08:18.961267] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-15T17:08:19.272423] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:08:19.626698] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-15T17:08:19.657874] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-09-15T17:08:20.093699] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-15T17:08:20.457890] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-09-15T17:08:21.082595] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T17:08:21.144077] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-15T17:08:21.257851] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-09-15T17:08:22.057859] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-09-15T17:08:22.188138] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-15T17:08:22.857888] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-09-15T17:08:23.532765] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-15T17:08:23.657915] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-09-15T17:08:23.907725] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-15T17:08:24.445050] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-15T17:08:24.457819] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-09-15T17:08:25.137621] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-15T17:08:25.257940] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-09-15T17:08:26.057907] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-09-15T17:08:26.515135] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-15T17:08:26.848254] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-15T17:08:26.857819] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-09-15T17:08:27.657910] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-09-15T17:08:28.458473] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-15T17:08:28.458570] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-09-15T17:08:28.990279] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-15T17:08:28.996231] [INFO ] [REMOTE ] ALLE: Full fetch complete (49500 records). [2025-09-15T17:08:28.996557] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-09-15T17:08:29.262996] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-09-15T17:08:29.416019] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-09-15T17:08:29.416229] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-09-15T17:08:29.416865] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-09-15T17:08:29.416933] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-09-15T17:08:29.438714] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-15T17:08:29.438939] [DEBUG] [LOCAL ] ALLE: Trimmed 49500 records to 32812 (keeping 150 days of data) [2025-09-15T17:08:29.664093] [DEBUG] [LOCAL ] ALLE: Primary data saved (32812 records). [2025-09-15T17:08:29.664261] [INFO ] [MAIN ] ALLE: Full history saved. [2025-09-15T17:08:29.664360] [INFO ] [MAIN ] Update Progress: 86/2369 symbols completed. ALLE took 27.1s. Estimated remaining: 3h 44m 1s. Rate: 10.2 symbols/min [2025-09-15T17:08:29.839113] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:08:29.848964] [DEBUG] [LOCAL ] ALUR: Loaded 7481 existing records from primary storage. [2025-09-15T17:08:29.849113] [INFO ] [MAIN ] ALUR: Loaded 7481 existing records. [2025-09-15T17:08:30.031168] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:08:30.031478] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-09-15T17:08:30.031524] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-09-15T17:08:30.031923] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-09-15T17:08:30.031971] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-09-15T17:08:30.063082] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-09-15T17:08:30.388032] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:08:30.789166] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-15T17:08:30.857902] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-09-15T17:08:31.657848] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-09-15T17:08:31.754900] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-15T17:08:32.370670] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-15T17:08:32.457836] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-09-15T17:08:32.615689] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T17:08:33.257929] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-09-15T17:08:33.652625] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-15T17:08:33.657910] [INFO ] [REMOTE ] ALSN: Full fetch complete (47488 records). [2025-09-15T17:08:33.658047] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-09-15T17:08:34.032890] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-09-15T17:08:34.032978] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-09-15T17:08:34.033492] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-09-15T17:08:34.033539] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-09-15T17:08:34.034563] [DEBUG] [LOCAL ] ALSN: Trimmed 47488 records to 31418 (keeping 150 days of data) [2025-09-15T17:08:34.093556] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-09-15T17:08:34.240329] [DEBUG] [LOCAL ] ALSN: Primary data saved (31418 records). [2025-09-15T17:08:34.240510] [INFO ] [MAIN ] ALSN: Full history saved. [2025-09-15T17:08:34.244342] [INFO ] [MAIN ] Update Progress: 87/2369 symbols completed. ALSN took 24.8s. Estimated remaining: 3h 43m 21s. Rate: 10.2 symbols/min [2025-09-15T17:08:34.431821] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:08:34.468864] [DEBUG] [LOCAL ] ALV: Loaded 31582 existing records from primary storage. [2025-09-15T17:08:34.469057] [INFO ] [MAIN ] ALV: Loaded 31582 existing records. [2025-09-15T17:08:34.649376] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:08:34.649767] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-09-15T17:08:34.649902] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-09-15T17:08:34.650826] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-09-15T17:08:34.650880] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-09-15T17:08:34.859377] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-09-15T17:08:34.974707] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-15T17:08:35.070018] [INFO ] [REMOTE ] ALV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:08:35.102611] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-15T17:08:35.105624] [INFO ] [REMOTE ] ALTG: Full fetch complete (25913 records). [2025-09-15T17:08:35.105758] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-09-15T17:08:35.106224] [FATAL] [VALIDATOR ] ALTG: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:08:35.106302] [FATAL] [MAIN ] ALTG: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:08:35.106338] [WARN ] [MAIN ] ALTG: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:08:35.106383] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-09-15T17:08:35.106442] [DEBUG] [LOCAL ] ALTG: No primary data file found to delete. [2025-09-15T17:08:35.106483] [INFO ] [LOCAL ] ALTG: Starting deletion of derivative data. [2025-09-15T17:08:35.106869] [DEBUG] [LOCAL ] ALTG: Deleted derivative data file. [2025-09-15T17:08:35.106953] [INFO ] [MAIN ] Update Progress: 88/2369 symbols completed. ALTG took 16.6s. Estimated remaining: 3h 41m 5s. Rate: 10.3 symbols/min [2025-09-15T17:08:35.282774] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:08:35.289576] [DEBUG] [LOCAL ] ALX: Loaded 5134 existing records from primary storage. [2025-09-15T17:08:35.289690] [INFO ] [MAIN ] ALX: Loaded 5134 existing records. [2025-09-15T17:08:35.465658] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:08:35.465929] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-09-15T17:08:35.465976] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-09-15T17:08:35.466301] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-09-15T17:08:35.466349] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-09-15T17:08:35.663075] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-09-15T17:08:35.818711] [INFO ] [REMOTE ] ALX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:08:35.975633] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-15T17:08:36.457894] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-09-15T17:08:36.933249] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-15T17:08:37.040982] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-15T17:08:37.257874] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-09-15T17:08:38.057897] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-09-15T17:08:38.547570] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-15T17:08:38.626887] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-15T17:08:38.632624] [INFO ] [REMOTE ] ALLY: Full fetch complete (57840 records). [2025-09-15T17:08:38.632750] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-09-15T17:08:38.862988] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-09-15T17:08:39.022800] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-09-15T17:08:39.022887] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-09-15T17:08:39.023508] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-09-15T17:08:39.023550] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-09-15T17:08:39.024809] [DEBUG] [LOCAL ] ALLY: Trimmed 57840 records to 39217 (keeping 150 days of data) [2025-09-15T17:08:39.270563] [DEBUG] [LOCAL ] ALLY: Primary data saved (39217 records). [2025-09-15T17:08:39.270738] [INFO ] [MAIN ] ALLY: Full history saved. [2025-09-15T17:08:39.273084] [INFO ] [MAIN ] Update Progress: 89/2369 symbols completed. ALLY took 36.5s. Estimated remaining: 3h 40m 17s. Rate: 10.4 symbols/min [2025-09-15T17:08:39.450455] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:08:39.494928] [DEBUG] [LOCAL ] AM: Loaded 39021 existing records from primary storage. [2025-09-15T17:08:39.495111] [INFO ] [MAIN ] AM: Loaded 39021 existing records. [2025-09-15T17:08:39.666145] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-09-15T17:08:39.671455] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:08:39.671718] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-09-15T17:08:39.671775] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-09-15T17:08:39.672813] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-09-15T17:08:39.672865] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-09-15T17:08:39.972636] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-15T17:08:40.040925] [INFO ] [REMOTE ] AM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:08:40.217835] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-15T17:08:40.457920] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-09-15T17:08:41.029536] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-15T17:08:41.257904] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-09-15T17:08:42.057863] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-09-15T17:08:42.336694] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-15T17:08:42.633979] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-15T17:08:42.857870] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-09-15T17:08:43.657951] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-09-15T17:08:44.422758] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-15T17:08:44.457866] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-09-15T17:08:44.542528] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T17:08:45.257883] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-09-15T17:08:45.912878] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T17:08:46.057847] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-09-15T17:08:46.273613] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T17:08:46.857873] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-09-15T17:08:47.550565] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-15T17:08:47.657902] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-09-15T17:08:47.885352] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-15T17:08:48.457885] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-09-15T17:08:49.195471] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-15T17:08:49.257855] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-09-15T17:08:49.295513] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-15T17:08:50.057933] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-09-15T17:08:50.671419] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-15T17:08:50.749931] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-15T17:08:50.857863] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-09-15T17:08:51.657940] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-09-15T17:08:52.377832] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T17:08:52.457888] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-09-15T17:08:53.017429] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-15T17:08:53.062135] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-15T17:08:53.063545] [INFO ] [REMOTE ] ALX: Full fetch complete (5893 records). [2025-09-15T17:08:53.063615] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-09-15T17:08:53.263029] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-09-15T17:08:53.445375] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-09-15T17:08:53.445474] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-09-15T17:08:53.445720] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-09-15T17:08:53.445767] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-09-15T17:08:53.446347] [DEBUG] [LOCAL ] ALX: Trimmed 5893 records to 5174 (keeping 150 days of data) [2025-09-15T17:08:53.480150] [DEBUG] [LOCAL ] ALX: Primary data saved (5174 records). [2025-09-15T17:08:53.480285] [INFO ] [MAIN ] ALX: Full history saved. [2025-09-15T17:08:53.480377] [INFO ] [MAIN ] Update Progress: 90/2369 symbols completed. ALX took 18.4s. Estimated remaining: 3h 43m 44s. Rate: 10.2 symbols/min [2025-09-15T17:08:53.648708] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:08:53.675601] [DEBUG] [LOCAL ] AMBC: Loaded 27132 existing records from primary storage. [2025-09-15T17:08:53.675792] [INFO ] [MAIN ] AMBC: Loaded 27132 existing records. [2025-09-15T17:08:53.855386] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:08:53.855685] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-09-15T17:08:53.855743] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-09-15T17:08:53.856442] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-09-15T17:08:53.856491] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-09-15T17:08:54.017523] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-15T17:08:54.067139] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-09-15T17:08:54.222171] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:08:54.857876] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-09-15T17:08:55.528904] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T17:08:55.657830] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-09-15T17:08:55.677467] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-15T17:08:56.457885] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-09-15T17:08:57.119359] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-15T17:08:57.257896] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-09-15T17:08:57.548003] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-15T17:08:58.057874] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-09-15T17:08:58.852107] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T17:08:58.862043] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-09-15T17:08:59.181959] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-15T17:08:59.615957] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-15T17:08:59.617187] [INFO ] [REMOTE ] ALUR: Full fetch complete (13202 records). [2025-09-15T17:08:59.617298] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-09-15T17:08:59.663109] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-09-15T17:08:59.973834] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-09-15T17:08:59.973919] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-09-15T17:08:59.974165] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-09-15T17:08:59.974205] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-09-15T17:08:59.974804] [DEBUG] [LOCAL ] ALUR: Trimmed 13202 records to 7335 (keeping 150 days of data) [2025-09-15T17:09:00.019272] [DEBUG] [LOCAL ] ALUR: Primary data saved (7335 records). [2025-09-15T17:09:00.019437] [INFO ] [MAIN ] ALUR: Full history saved. [2025-09-15T17:09:00.019525] [INFO ] [MAIN ] Update Progress: 91/2369 symbols completed. ALUR took 30.4s. Estimated remaining: 3h 43m 55s. Rate: 10.2 symbols/min [2025-09-15T17:09:00.190552] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:09:00.224851] [DEBUG] [LOCAL ] AMBP: Loaded 34048 existing records from primary storage. [2025-09-15T17:09:00.224997] [INFO ] [MAIN ] AMBP: Loaded 34048 existing records. [2025-09-15T17:09:00.403683] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:09:00.403988] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-09-15T17:09:00.404042] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-09-15T17:09:00.405107] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-09-15T17:09:00.405169] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-09-15T17:09:00.467055] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-09-15T17:09:00.759462] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:09:01.257914] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-09-15T17:09:01.422064] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-15T17:09:01.969825] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T17:09:02.057894] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-09-15T17:09:02.857876] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-09-15T17:09:03.657894] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-09-15T17:09:03.771001] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-09-15T17:09:04.457886] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-09-15T17:09:04.827416] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (2.77 seconds). [2025-09-15T17:09:05.257993] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-09-15T17:09:05.737004] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-15T17:09:06.057999] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-09-15T17:09:06.105497] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (3.25 seconds). [2025-09-15T17:09:06.112346] [INFO ] [REMOTE ] ALV: Full fetch complete (46880 records). [2025-09-15T17:09:06.112555] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-09-15T17:09:06.515139] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-09-15T17:09:06.515414] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-09-15T17:09:06.516192] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-09-15T17:09:06.516363] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-09-15T17:09:06.540677] [DEBUG] [LOCAL ] ALV: Trimmed 46880 records to 30747 (keeping 150 days of data) [2025-09-15T17:09:06.542579] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T17:09:06.680351] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-15T17:09:06.793903] [DEBUG] [LOCAL ] ALV: Primary data saved (30747 records). [2025-09-15T17:09:06.794063] [INFO ] [MAIN ] ALV: Full history saved. [2025-09-15T17:09:06.794869] [INFO ] [MAIN ] Update Progress: 92/2369 symbols completed. ALV took 32.6s. Estimated remaining: 3h 44m 11s. Rate: 10.2 symbols/min [2025-09-15T17:09:06.862976] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-09-15T17:09:06.971562] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:09:06.971768] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-09-15T17:09:06.971808] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-09-15T17:09:06.971933] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-09-15T17:09:06.971974] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-15T17:09:06.972017] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-15T17:09:06.972052] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-09-15T17:09:07.340838] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:09:07.657946] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-09-15T17:09:07.696245] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T17:09:07.702567] [INFO ] [REMOTE ] AM: Full fetch complete (56829 records). [2025-09-15T17:09:07.702743] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-09-15T17:09:08.100169] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-09-15T17:09:08.100278] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-09-15T17:09:08.100888] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-09-15T17:09:08.100934] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-09-15T17:09:08.102345] [DEBUG] [LOCAL ] AM: Trimmed 56829 records to 38259 (keeping 150 days of data) [2025-09-15T17:09:08.335557] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-15T17:09:08.371396] [DEBUG] [LOCAL ] AM: Primary data saved (38259 records). [2025-09-15T17:09:08.371558] [INFO ] [MAIN ] AM: Full history saved. [2025-09-15T17:09:08.371676] [INFO ] [MAIN ] Update Progress: 93/2369 symbols completed. AM took 29.1s. Estimated remaining: 3h 42m 19s. Rate: 10.2 symbols/min [2025-09-15T17:09:08.467696] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-02. [2025-09-15T17:09:08.542726] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:09:08.584356] [DEBUG] [LOCAL ] AMC: Loaded 40510 existing records from primary storage. [2025-09-15T17:09:08.584527] [INFO ] [MAIN ] AMC: Loaded 40510 existing records. [2025-09-15T17:09:08.707610] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:09:08.746854] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-02 [2025-09-15T17:09:08.766871] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:09:08.767107] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-09-15T17:09:08.767153] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-09-15T17:09:08.768613] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-09-15T17:09:08.768685] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-09-15T17:09:09.183362] [INFO ] [REMOTE ] AMC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:09:09.212954] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-15T17:09:09.257873] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-09-15T17:09:10.057894] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-03. [2025-09-15T17:09:10.258070] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:09:10.258410] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-03 [2025-09-15T17:09:10.857882] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-09-15T17:09:11.033246] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-15T17:09:11.657880] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-09-15T17:09:12.457889] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-04. [2025-09-15T17:09:13.063953] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-15T17:09:13.257883] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-09-15T17:09:13.495100] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:09:13.495431] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-04 [2025-09-15T17:09:14.057891] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-05. [2025-09-15T17:09:14.281794] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-09-15T17:09:14.282444] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:09:14.293744] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-05 [2025-09-15T17:09:14.327274] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-15T17:09:14.857864] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-09-15T17:09:15.657882] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-09-15T17:09:15.868388] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-15T17:09:15.872051] [INFO ] [REMOTE ] AMBC: Full fetch complete (40596 records). [2025-09-15T17:09:15.872138] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-09-15T17:09:16.245153] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-09-15T17:09:16.245243] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-09-15T17:09:16.245837] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-09-15T17:09:16.245881] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-09-15T17:09:16.246763] [DEBUG] [LOCAL ] AMBC: Trimmed 40596 records to 26441 (keeping 150 days of data) [2025-09-15T17:09:16.400835] [DEBUG] [LOCAL ] AMBC: Primary data saved (26441 records). [2025-09-15T17:09:16.400993] [INFO ] [MAIN ] AMBC: Full history saved. [2025-09-15T17:09:16.401090] [INFO ] [MAIN ] Update Progress: 94/2369 symbols completed. AMBC took 22.9s. Estimated remaining: 3h 43m 5s. Rate: 10.2 symbols/min [2025-09-15T17:09:16.465362] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-06. [2025-09-15T17:09:16.573221] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:09:16.614382] [DEBUG] [LOCAL ] AMCR: Loaded 40412 existing records from primary storage. [2025-09-15T17:09:16.614533] [INFO ] [MAIN ] AMCR: Loaded 40412 existing records. [2025-09-15T17:09:16.728514] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:09:16.759201] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-06 [2025-09-15T17:09:16.793182] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:09:16.793433] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-09-15T17:09:16.793480] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-09-15T17:09:16.794811] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-09-15T17:09:16.794865] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-09-15T17:09:17.147766] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:09:17.234262] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-15T17:09:17.257826] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-09-15T17:09:18.057873] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-07. [2025-09-15T17:09:18.630685] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-15T17:09:18.857856] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-08. [2025-09-15T17:09:18.948545] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T17:09:19.657870] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-09-15T17:09:20.402572] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-15T17:09:20.457826] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-09. [2025-09-15T17:09:21.257936] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-09-15T17:09:21.328425] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-15T17:09:21.359877] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T17:09:21.363141] [INFO ] [REMOTE ] AMBQ: Full fetch complete (6874 records). [2025-09-15T17:09:21.363219] [DEBUG] [VALIDATOR ] AMBQ: Validating primary data. [2025-09-15T17:09:21.553323] [WARN ] [VALIDATOR ] AMBQ: Validation failed - insufficient historical data. Have 33 unique days, need 150 days [2025-09-15T17:09:21.553630] [FATAL] [MAIN ] AMBQ: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:09:21.553701] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:09:21.553753] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-15T17:09:21.553824] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-15T17:09:21.553866] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-09-15T17:09:21.553910] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-09-15T17:09:21.553970] [INFO ] [MAIN ] Update Progress: 95/2369 symbols completed. AMBQ took 14.8s. Estimated remaining: 3h 42m 42s. Rate: 10.2 symbols/min [2025-09-15T17:09:21.723192] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:09:21.766524] [DEBUG] [LOCAL ] AME: Loaded 36349 existing records from primary storage. [2025-09-15T17:09:21.766698] [INFO ] [MAIN ] AME: Loaded 36349 existing records. [2025-09-15T17:09:21.944971] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:09:21.945252] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-09-15T17:09:21.945299] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-09-15T17:09:21.946721] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-09-15T17:09:21.946777] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-09-15T17:09:22.063015] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-09-15T17:09:22.325839] [INFO ] [REMOTE ] AME: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:09:22.780952] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T17:09:22.857853] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-09-15T17:09:23.657879] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-09-15T17:09:24.457916] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-09-15T17:09:24.798417] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-09-15T17:09:25.257930] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-09-15T17:09:25.514861] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-09-15T17:09:25.676040] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-15T17:09:25.844857] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-15T17:09:26.057872] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-09-15T17:09:26.857923] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-09-15T17:09:27.460690] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T17:09:27.657934] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-09-15T17:09:27.756077] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-15T17:09:28.458004] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-09-15T17:09:28.660415] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-15T17:09:29.223398] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T17:09:29.257918] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-09-15T17:09:30.057893] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-09-15T17:09:30.570375] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-15T17:09:30.607556] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-15T17:09:30.857887] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-09-15T17:09:31.139895] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-15T17:09:31.145700] [INFO ] [REMOTE ] AMBP: Full fetch complete (49434 records). [2025-09-15T17:09:31.145868] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-09-15T17:09:31.563865] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-09-15T17:09:31.563952] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-09-15T17:09:31.564470] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-09-15T17:09:31.564513] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-09-15T17:09:31.566221] [DEBUG] [LOCAL ] AMBP: Trimmed 49434 records to 33476 (keeping 150 days of data) [2025-09-15T17:09:31.657972] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-09-15T17:09:31.769182] [DEBUG] [LOCAL ] AMBP: Primary data saved (33476 records). [2025-09-15T17:09:31.769330] [INFO ] [MAIN ] AMBP: Full history saved. [2025-09-15T17:09:31.769414] [INFO ] [MAIN ] Update Progress: 96/2369 symbols completed. AMBP took 31.7s. Estimated remaining: 3h 44m 19s. Rate: 10.1 symbols/min [2025-09-15T17:09:31.955556] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:09:31.974062] [DEBUG] [LOCAL ] AMG: Loaded 14731 existing records from primary storage. [2025-09-15T17:09:31.974209] [INFO ] [MAIN ] AMG: Loaded 14731 existing records. [2025-09-15T17:09:32.162693] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:09:32.163069] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-09-15T17:09:32.163186] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-09-15T17:09:32.163945] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-09-15T17:09:32.164010] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-09-15T17:09:32.373015] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-15T17:09:32.463106] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-09-15T17:09:32.568170] [INFO ] [REMOTE ] AMG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:09:33.262964] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-09-15T17:09:33.283005] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-15T17:09:34.057933] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-09-15T17:09:34.563194] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-15T17:09:34.715535] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-15T17:09:34.857837] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-09-15T17:09:35.544476] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T17:09:35.657878] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-09-15T17:09:36.457904] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-09-15T17:09:37.271605] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-09-15T17:09:37.276395] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-15T17:09:37.310386] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-15T17:09:37.371608] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-15T17:09:38.057899] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-09-15T17:09:38.493208] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-15T17:09:38.857864] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-09-15T17:09:39.597293] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-15T17:09:39.603283] [INFO ] [REMOTE ] AMCR: Full fetch complete (58347 records). [2025-09-15T17:09:39.603440] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-09-15T17:09:39.666901] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-09-15T17:09:39.991566] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-09-15T17:09:39.991675] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-09-15T17:09:39.992289] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-09-15T17:09:39.992341] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-09-15T17:09:39.995068] [DEBUG] [LOCAL ] AMCR: Trimmed 58347 records to 39632 (keeping 150 days of data) [2025-09-15T17:09:40.248402] [DEBUG] [LOCAL ] AMCR: Primary data saved (39632 records). [2025-09-15T17:09:40.248563] [INFO ] [MAIN ] AMCR: Full history saved. [2025-09-15T17:09:40.249319] [INFO ] [MAIN ] Update Progress: 97/2369 symbols completed. AMCR took 23.8s. Estimated remaining: 3h 45m 13s. Rate: 10.1 symbols/min [2025-09-15T17:09:40.417995] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:09:40.462053] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-09-15T17:09:40.463701] [DEBUG] [LOCAL ] AMH: Loaded 38783 existing records from primary storage. [2025-09-15T17:09:40.463777] [INFO ] [MAIN ] AMH: Loaded 38783 existing records. [2025-09-15T17:09:40.641699] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:09:40.641908] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-09-15T17:09:40.641997] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-09-15T17:09:40.643166] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-09-15T17:09:40.643218] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-09-15T17:09:40.998143] [INFO ] [REMOTE ] AMH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:09:41.014262] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-15T17:09:41.020805] [INFO ] [REMOTE ] AMC: Full fetch complete (58432 records). [2025-09-15T17:09:41.020978] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-09-15T17:09:41.265505] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-09-15T17:09:41.423990] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-09-15T17:09:41.424139] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-09-15T17:09:41.424819] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-09-15T17:09:41.425201] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-09-15T17:09:41.427320] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-15T17:09:41.435467] [DEBUG] [LOCAL ] AMC: Trimmed 58432 records to 39733 (keeping 150 days of data) [2025-09-15T17:09:41.436085] [INFO ] [REMOTE ] AME: Full fetch complete (52753 records). [2025-09-15T17:09:41.436595] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-09-15T17:09:41.570152] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-15T17:09:41.983339] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-09-15T17:09:41.986822] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-09-15T17:09:41.987561] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-09-15T17:09:41.987670] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-09-15T17:09:42.045190] [DEBUG] [LOCAL ] AME: Trimmed 52753 records to 35658 (keeping 150 days of data) [2025-09-15T17:09:42.075622] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-09-15T17:09:42.294676] [DEBUG] [LOCAL ] AMC: Primary data saved (39733 records). [2025-09-15T17:09:42.306028] [INFO ] [MAIN ] AMC: Full history saved. [2025-09-15T17:09:42.328793] [INFO ] [MAIN ] Update Progress: 98/2369 symbols completed. AMC took 34.0s. Estimated remaining: 3h 43m 37s. Rate: 10.2 symbols/min [2025-09-15T17:09:42.528071] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:09:42.547990] [DEBUG] [LOCAL ] AME: Primary data saved (35658 records). [2025-09-15T17:09:42.548174] [INFO ] [MAIN ] AME: Full history saved. [2025-09-15T17:09:42.548516] [INFO ] [MAIN ] Update Progress: 99/2369 symbols completed. AME took 21.0s. Estimated remaining: 3h 41m 21s. Rate: 10.3 symbols/min [2025-09-15T17:09:42.738181] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:09:42.738941] [DEBUG] [LOCAL ] AMN: Loaded 31538 existing records from primary storage. [2025-09-15T17:09:42.739288] [INFO ] [MAIN ] AMN: Loaded 31538 existing records. [2025-09-15T17:09:42.927465] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:09:42.928036] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-09-15T17:09:42.928132] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-09-15T17:09:42.936697] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-09-15T17:09:42.936926] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-09-15T17:09:42.937315] [DEBUG] [LOCAL ] AMP: Loaded 23565 existing records from primary storage. [2025-09-15T17:09:42.968736] [INFO ] [MAIN ] AMP: Loaded 23565 existing records. [2025-09-15T17:09:43.401356] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:09:43.439869] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-09-15T17:09:43.455536] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-09-15T17:09:43.531479] [INFO ] [REMOTE ] AMN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:09:43.532085] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-09-15T17:09:43.525983] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-15T17:09:43.531605] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-09-15T17:09:43.543133] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-09-15T17:09:43.672737] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-09-15T17:09:43.715828] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T17:09:43.927579] [INFO ] [REMOTE ] AMP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:09:44.457912] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-09-15T17:09:44.621004] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-15T17:09:45.257932] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-09-15T17:09:45.404340] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-15T17:09:45.558626] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-15T17:09:46.057909] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-09-15T17:09:46.857855] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-09-15T17:09:46.887372] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-15T17:09:46.916202] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-15T17:09:47.657924] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-09-15T17:09:48.369605] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-15T17:09:48.421766] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-15T17:09:48.457831] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-09-15T17:09:49.257881] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-09-15T17:09:50.005577] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T17:09:50.057819] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-09-15T17:09:50.402613] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-15T17:09:50.857871] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-09-15T17:09:51.376426] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T17:09:51.657889] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-09-15T17:09:51.999626] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-15T17:09:52.457907] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-09-15T17:09:53.213596] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-15T17:09:53.257823] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-09-15T17:09:54.057885] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-09-15T17:09:54.059702] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-15T17:09:54.428472] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-15T17:09:54.726119] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-15T17:09:54.857888] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-09-15T17:09:55.657869] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-09-15T17:09:55.839255] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-15T17:09:56.388626] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T17:09:56.457852] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-09-15T17:09:57.229594] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T17:09:57.232658] [INFO ] [REMOTE ] AMG: Full fetch complete (22479 records). [2025-09-15T17:09:57.232756] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-09-15T17:09:57.263940] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-09-15T17:09:57.633192] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-09-15T17:09:57.633285] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-09-15T17:09:57.633663] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-09-15T17:09:57.633710] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-09-15T17:09:57.634461] [DEBUG] [LOCAL ] AMG: Trimmed 22479 records to 14410 (keeping 150 days of data) [2025-09-15T17:09:57.730864] [DEBUG] [LOCAL ] AMG: Primary data saved (14410 records). [2025-09-15T17:09:57.731006] [INFO ] [MAIN ] AMG: Full history saved. [2025-09-15T17:09:57.731089] [INFO ] [MAIN ] Update Progress: 100/2369 symbols completed. AMG took 26.0s. Estimated remaining: 3h 44m 47s. Rate: 10.1 symbols/min [2025-09-15T17:09:57.899587] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:09:57.941630] [DEBUG] [LOCAL ] AMPX: Loaded 39319 existing records from primary storage. [2025-09-15T17:09:57.941799] [INFO ] [MAIN ] AMPX: Loaded 39319 existing records. [2025-09-15T17:09:58.063124] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-09-15T17:09:58.130413] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:09:58.130690] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-09-15T17:09:58.130747] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-09-15T17:09:58.132064] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-09-15T17:09:58.132116] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-09-15T17:09:58.478915] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:09:58.579405] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-15T17:09:58.857927] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-09-15T17:09:59.660604] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-09-15T17:09:59.663204] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-15T17:10:00.457873] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-09-15T17:10:00.607987] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-15T17:10:01.257966] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-09-15T17:10:01.331588] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-15T17:10:01.716020] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T17:10:02.057896] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-09-15T17:10:02.622510] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-15T17:10:02.633857] [INFO ] [REMOTE ] AMH: Full fetch complete (56146 records). [2025-09-15T17:10:02.634110] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-09-15T17:10:02.863081] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-09-15T17:10:03.048877] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-09-15T17:10:03.049020] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-09-15T17:10:03.049744] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-09-15T17:10:03.049834] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-09-15T17:10:03.051189] [DEBUG] [LOCAL ] AMH: Trimmed 56146 records to 38075 (keeping 150 days of data) [2025-09-15T17:10:03.166470] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-15T17:10:03.316208] [DEBUG] [LOCAL ] AMH: Primary data saved (38075 records). [2025-09-15T17:10:03.316382] [INFO ] [MAIN ] AMH: Full history saved. [2025-09-15T17:10:03.317846] [INFO ] [MAIN ] Update Progress: 101/2369 symbols completed. AMH took 23.1s. Estimated remaining: 3h 44m 33s. Rate: 10.1 symbols/min [2025-09-15T17:10:03.494877] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:10:03.528742] [DEBUG] [LOCAL ] AMPY: Loaded 28357 existing records from primary storage. [2025-09-15T17:10:03.528993] [INFO ] [MAIN ] AMPY: Loaded 28357 existing records. [2025-09-15T17:10:03.676006] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-09-15T17:10:03.720598] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:10:03.720951] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-09-15T17:10:03.721005] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-09-15T17:10:03.721923] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-09-15T17:10:03.721985] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-09-15T17:10:04.104789] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:10:04.119085] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T17:10:04.124220] [INFO ] [REMOTE ] AMN: Full fetch complete (46274 records). [2025-09-15T17:10:04.124363] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-09-15T17:10:04.473432] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-09-15T17:10:04.526940] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-09-15T17:10:04.527093] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-09-15T17:10:04.527805] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-09-15T17:10:04.527859] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-09-15T17:10:04.529374] [DEBUG] [LOCAL ] AMN: Trimmed 46274 records to 31022 (keeping 150 days of data) [2025-09-15T17:10:04.731815] [DEBUG] [LOCAL ] AMN: Primary data saved (31022 records). [2025-09-15T17:10:04.732027] [INFO ] [MAIN ] AMN: Full history saved. [2025-09-15T17:10:04.732143] [INFO ] [MAIN ] Update Progress: 102/2369 symbols completed. AMN took 22.4s. Estimated remaining: 3h 42m 46s. Rate: 10.2 symbols/min [2025-09-15T17:10:04.914278] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:10:04.946332] [DEBUG] [LOCAL ] AMR: Loaded 21672 existing records from primary storage. [2025-09-15T17:10:04.946544] [INFO ] [MAIN ] AMR: Loaded 21672 existing records. [2025-09-15T17:10:05.170080] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:10:05.170503] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-09-15T17:10:05.170553] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-09-15T17:10:05.171562] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-09-15T17:10:05.171619] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-09-15T17:10:05.267167] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-09-15T17:10:05.575693] [INFO ] [REMOTE ] AMR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:10:05.631165] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-15T17:10:05.910892] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T17:10:06.044625] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-15T17:10:06.057813] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-09-15T17:10:06.857886] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-09-15T17:10:07.393325] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T17:10:07.657845] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-09-15T17:10:08.118232] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T17:10:08.457879] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-09-15T17:10:09.201174] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-15T17:10:09.257892] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-09-15T17:10:09.630871] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-15T17:10:10.057875] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-09-15T17:10:10.841405] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T17:10:10.857822] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-09-15T17:10:11.322693] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T17:10:11.327666] [INFO ] [REMOTE ] AMP: Full fetch complete (35726 records). [2025-09-15T17:10:11.327861] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-09-15T17:10:11.664341] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-09-15T17:10:11.695093] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-09-15T17:10:11.695172] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-09-15T17:10:11.695634] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-09-15T17:10:11.695692] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-09-15T17:10:11.696457] [DEBUG] [LOCAL ] AMP: Trimmed 35726 records to 23065 (keeping 150 days of data) [2025-09-15T17:10:11.850819] [DEBUG] [LOCAL ] AMP: Primary data saved (23065 records). [2025-09-15T17:10:11.850959] [INFO ] [MAIN ] AMP: Full history saved. [2025-09-15T17:10:11.851043] [INFO ] [MAIN ] Update Progress: 103/2369 symbols completed. AMP took 29.3s. Estimated remaining: 3h 43m 7s. Rate: 10.2 symbols/min [2025-09-15T17:10:12.056811] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:10:12.084176] [DEBUG] [LOCAL ] AMRC: Loaded 28206 existing records from primary storage. [2025-09-15T17:10:12.084298] [INFO ] [MAIN ] AMRC: Loaded 28206 existing records. [2025-09-15T17:10:12.257037] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:10:12.257288] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-09-15T17:10:12.257332] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-09-15T17:10:12.258255] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-09-15T17:10:12.258306] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-09-15T17:10:12.463210] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-09-15T17:10:12.613493] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:10:12.664115] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-15T17:10:12.687608] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-15T17:10:13.257876] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-09-15T17:10:14.017713] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T17:10:14.057877] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-09-15T17:10:14.225417] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-15T17:10:14.857874] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-09-15T17:10:15.517473] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T17:10:15.657854] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-09-15T17:10:15.753808] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T17:10:16.457869] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-09-15T17:10:16.809489] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-15T17:10:17.257881] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-09-15T17:10:17.443279] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-15T17:10:18.057866] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-09-15T17:10:18.857865] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-09-15T17:10:19.181154] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-15T17:10:19.310312] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-15T17:10:19.657894] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-09-15T17:10:20.091408] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-15T17:10:20.457866] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-09-15T17:10:20.652237] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T17:10:20.655619] [INFO ] [REMOTE ] AMPY: Full fetch complete (39603 records). [2025-09-15T17:10:20.655731] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-09-15T17:10:21.035784] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-09-15T17:10:21.035869] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-09-15T17:10:21.036321] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-09-15T17:10:21.036363] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-09-15T17:10:21.037286] [DEBUG] [LOCAL ] AMPY: Trimmed 39603 records to 27646 (keeping 150 days of data) [2025-09-15T17:10:21.200458] [DEBUG] [LOCAL ] AMPY: Primary data saved (27646 records). [2025-09-15T17:10:21.200605] [INFO ] [MAIN ] AMPY: Full history saved. [2025-09-15T17:10:21.200712] [INFO ] [MAIN ] Update Progress: 104/2369 symbols completed. AMPY took 17.9s. Estimated remaining: 3h 44m 16s. Rate: 10.1 symbols/min [2025-09-15T17:10:21.264554] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-09-15T17:10:21.374584] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:10:21.374782] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-09-15T17:10:21.374825] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-09-15T17:10:21.374978] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-09-15T17:10:21.375030] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-15T17:10:21.375108] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-15T17:10:21.375144] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-09-15T17:10:21.773910] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:10:21.817197] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-15T17:10:22.057964] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-09-15T17:10:22.857925] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-02. [2025-09-15T17:10:23.062522] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:10:23.083806] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-02 [2025-09-15T17:10:23.086655] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-15T17:10:23.427715] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-15T17:10:23.657896] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-09-15T17:10:24.457928] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-09-15T17:10:24.576304] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-15T17:10:25.257897] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-09-15T17:10:26.057890] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-09-15T17:10:26.297540] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-15T17:10:26.517512] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-15T17:10:26.524496] [INFO ] [REMOTE ] AMPX: Full fetch complete (56234 records). [2025-09-15T17:10:26.524630] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-09-15T17:10:26.868430] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-09-15T17:10:26.921272] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-09-15T17:10:26.921352] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-09-15T17:10:26.921960] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-09-15T17:10:26.922004] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-09-15T17:10:26.923414] [DEBUG] [LOCAL ] AMPX: Trimmed 56234 records to 38648 (keeping 150 days of data) [2025-09-15T17:10:27.116965] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-15T17:10:27.177968] [DEBUG] [LOCAL ] AMPX: Primary data saved (38648 records). [2025-09-15T17:10:27.178122] [INFO ] [MAIN ] AMPX: Full history saved. [2025-09-15T17:10:27.178212] [INFO ] [MAIN ] Update Progress: 105/2369 symbols completed. AMPX took 29.4s. Estimated remaining: 3h 44m 11s. Rate: 10.1 symbols/min [2025-09-15T17:10:27.346824] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:10:27.385788] [DEBUG] [LOCAL ] AMT: Loaded 39337 existing records from primary storage. [2025-09-15T17:10:27.385937] [INFO ] [MAIN ] AMT: Loaded 39337 existing records. [2025-09-15T17:10:27.570112] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:10:27.570377] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-09-15T17:10:27.570425] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-09-15T17:10:27.572049] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-09-15T17:10:27.572109] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-09-15T17:10:27.663428] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-09-15T17:10:27.935071] [INFO ] [REMOTE ] AMT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:10:28.033260] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-15T17:10:28.457936] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-09-15T17:10:28.857674] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T17:10:29.257943] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-03. [2025-09-15T17:10:29.457509] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:10:29.457898] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-03 [2025-09-15T17:10:29.877340] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T17:10:30.057885] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-09-15T17:10:30.857886] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-04. [2025-09-15T17:10:31.054112] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:10:31.054424] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-04 [2025-09-15T17:10:31.568899] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-15T17:10:31.657876] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-05. [2025-09-15T17:10:31.853449] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:10:31.853819] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-05 [2025-09-15T17:10:32.457869] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-09-15T17:10:33.257845] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-06. [2025-09-15T17:10:33.733036] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T17:10:34.057876] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-09-15T17:10:34.333253] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-15T17:10:34.857906] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-09-15T17:10:35.337710] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-15T17:10:35.342128] [INFO ] [REMOTE ] AMRC: Full fetch complete (41313 records). [2025-09-15T17:10:35.342210] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-09-15T17:10:35.668989] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-07. [2025-09-15T17:10:35.715310] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-09-15T17:10:35.715380] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-09-15T17:10:35.715853] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-09-15T17:10:35.715895] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-09-15T17:10:35.716778] [DEBUG] [LOCAL ] AMRC: Trimmed 41313 records to 27480 (keeping 150 days of data) [2025-09-15T17:10:35.891636] [DEBUG] [LOCAL ] AMRC: Primary data saved (27480 records). [2025-09-15T17:10:35.891838] [INFO ] [MAIN ] AMRC: Full history saved. [2025-09-15T17:10:35.891961] [INFO ] [MAIN ] Update Progress: 106/2369 symbols completed. AMRC took 24.0s. Estimated remaining: 3h 45m 4s. Rate: 10.1 symbols/min [2025-09-15T17:10:36.075751] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:10:36.094788] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-15T17:10:36.116098] [DEBUG] [LOCAL ] AMTB: Loaded 15567 existing records from primary storage. [2025-09-15T17:10:36.116323] [INFO ] [MAIN ] AMTB: Loaded 15567 existing records. [2025-09-15T17:10:36.289873] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:10:36.290181] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-09-15T17:10:36.290270] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-09-15T17:10:36.291029] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-09-15T17:10:36.291080] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-09-15T17:10:36.466331] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-09-15T17:10:36.656339] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:10:37.257921] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-09-15T17:10:37.360241] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-15T17:10:38.057925] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-08. [2025-09-15T17:10:38.512540] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-15T17:10:38.530830] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T17:10:38.534096] [INFO ] [REMOTE ] AMR: Full fetch complete (31775 records). [2025-09-15T17:10:38.534171] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-09-15T17:10:38.862924] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-09-15T17:10:38.903846] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-09-15T17:10:38.903908] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-09-15T17:10:38.904298] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-09-15T17:10:38.904336] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-09-15T17:10:38.905336] [DEBUG] [LOCAL ] AMR: Trimmed 31775 records to 21277 (keeping 150 days of data) [2025-09-15T17:10:39.041139] [DEBUG] [LOCAL ] AMR: Primary data saved (21277 records). [2025-09-15T17:10:39.041382] [INFO ] [MAIN ] AMR: Full history saved. [2025-09-15T17:10:39.041518] [INFO ] [MAIN ] Update Progress: 107/2369 symbols completed. AMR took 34.3s. Estimated remaining: 3h 43m 59s. Rate: 10.1 symbols/min [2025-09-15T17:10:39.211910] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:10:39.216732] [DEBUG] [LOCAL ] AMTD: Loaded 2827 existing records from primary storage. [2025-09-15T17:10:39.216811] [INFO ] [MAIN ] AMTD: Loaded 2827 existing records. [2025-09-15T17:10:39.391271] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:10:39.391530] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-09-15T17:10:39.391576] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-09-15T17:10:39.391833] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-09-15T17:10:39.391882] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-09-15T17:10:39.662291] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-09-15T17:10:39.745380] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:10:39.758153] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-15T17:10:39.792128] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-15T17:10:40.457910] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-09. [2025-09-15T17:10:41.257861] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-09-15T17:10:41.633848] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-15T17:10:42.015101] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-15T17:10:42.057818] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-09-15T17:10:42.186744] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-15T17:10:42.192435] [INFO ] [REMOTE ] AMRZ: Full fetch complete (22255 records). [2025-09-15T17:10:42.192578] [DEBUG] [VALIDATOR ] AMRZ: Validating primary data. [2025-09-15T17:10:42.378984] [WARN ] [VALIDATOR ] AMRZ: Validation failed - insufficient historical data. Have 59 unique days, need 150 days [2025-09-15T17:10:42.379365] [FATAL] [MAIN ] AMRZ: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:10:42.379437] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:10:42.379504] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-15T17:10:42.379570] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-15T17:10:42.379609] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-09-15T17:10:42.379680] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-09-15T17:10:42.379744] [INFO ] [MAIN ] Update Progress: 108/2369 symbols completed. AMRZ took 21.2s. Estimated remaining: 3h 42m 59s. Rate: 10.1 symbols/min [2025-09-15T17:10:42.554896] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:10:42.592039] [DEBUG] [LOCAL ] AMTM: Loaded 37905 existing records from primary storage. [2025-09-15T17:10:42.592187] [INFO ] [MAIN ] AMTM: Loaded 37905 existing records. [2025-09-15T17:10:42.769244] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:10:42.769569] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-09-15T17:10:42.769663] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-09-15T17:10:42.771168] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-09-15T17:10:42.771225] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-09-15T17:10:42.863002] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-09-15T17:10:43.145439] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:10:43.147068] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-15T17:10:43.657868] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-09-15T17:10:44.308529] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T17:10:44.457871] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-09-15T17:10:44.735859] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-15T17:10:44.941743] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-15T17:10:45.257874] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-09-15T17:10:45.997693] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-15T17:10:46.057826] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-09-15T17:10:46.857897] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-09-15T17:10:46.977919] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-15T17:10:47.657934] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-09-15T17:10:48.347179] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T17:10:48.371937] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-15T17:10:48.457870] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-09-15T17:10:49.257923] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-09-15T17:10:49.405782] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-15T17:10:49.407895] [INFO ] [REMOTE ] AMTB: Full fetch complete (22445 records). [2025-09-15T17:10:49.407968] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-09-15T17:10:49.774154] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-09-15T17:10:49.774241] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-09-15T17:10:49.774586] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-09-15T17:10:49.774627] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-09-15T17:10:49.775412] [DEBUG] [LOCAL ] AMTB: Trimmed 22445 records to 15250 (keeping 150 days of data) [2025-09-15T17:10:49.869551] [DEBUG] [LOCAL ] AMTB: Primary data saved (15250 records). [2025-09-15T17:10:49.869731] [INFO ] [MAIN ] AMTB: Full history saved. [2025-09-15T17:10:49.869823] [INFO ] [MAIN ] Update Progress: 109/2369 symbols completed. AMTB took 14.0s. Estimated remaining: 3h 43m 25s. Rate: 10.1 symbols/min [2025-09-15T17:10:50.047949] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:10:50.056566] [DEBUG] [LOCAL ] AMWL: Loaded 6581 existing records from primary storage. [2025-09-15T17:10:50.056692] [INFO ] [MAIN ] AMWL: Loaded 6581 existing records. [2025-09-15T17:10:50.067915] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-09-15T17:10:50.243739] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:10:50.244111] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-09-15T17:10:50.244166] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-09-15T17:10:50.244675] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-09-15T17:10:50.244749] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-09-15T17:10:50.606180] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:10:50.609791] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-15T17:10:50.675588] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-15T17:10:50.857878] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-09-15T17:10:51.657874] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-09-15T17:10:51.744508] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-15T17:10:52.038297] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-15T17:10:52.457885] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-09-15T17:10:52.812054] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-15T17:10:53.257926] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-09-15T17:10:54.057878] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-09-15T17:10:54.857880] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-09-15T17:10:55.216351] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-15T17:10:55.222494] [INFO ] [REMOTE ] AMT: Full fetch complete (57030 records). [2025-09-15T17:10:55.222628] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-09-15T17:10:55.510738] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-15T17:10:55.626339] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-09-15T17:10:55.626430] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-09-15T17:10:55.627032] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-09-15T17:10:55.627077] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-09-15T17:10:55.628450] [DEBUG] [LOCAL ] AMT: Trimmed 57030 records to 38572 (keeping 150 days of data) [2025-09-15T17:10:55.689749] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-09-15T17:10:55.791836] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-15T17:10:55.918158] [DEBUG] [LOCAL ] AMT: Primary data saved (38572 records). [2025-09-15T17:10:55.918338] [INFO ] [MAIN ] AMT: Full history saved. [2025-09-15T17:10:55.918480] [INFO ] [MAIN ] Update Progress: 110/2369 symbols completed. AMT took 28.7s. Estimated remaining: 3h 43m 22s. Rate: 10.1 symbols/min [2025-09-15T17:10:56.087751] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:10:56.127468] [DEBUG] [LOCAL ] AMX: Loaded 36855 existing records from primary storage. [2025-09-15T17:10:56.127625] [INFO ] [MAIN ] AMX: Loaded 36855 existing records. [2025-09-15T17:10:56.262007] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-15T17:10:56.315773] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:10:56.316025] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-09-15T17:10:56.316073] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-09-15T17:10:56.317616] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-09-15T17:10:56.317700] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-09-15T17:10:56.466116] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-09-15T17:10:56.697916] [INFO ] [REMOTE ] AMX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:10:57.032735] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-15T17:10:57.257924] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-09-15T17:10:57.825893] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-15T17:10:58.057922] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-09-15T17:10:58.857949] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-09-15T17:10:59.598045] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-15T17:10:59.657849] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-09-15T17:10:59.803248] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-15T17:11:00.157120] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-15T17:11:00.457876] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-09-15T17:11:01.164302] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-15T17:11:01.257827] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-09-15T17:11:02.057865] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-09-15T17:11:02.266204] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T17:11:02.857875] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-09-15T17:11:03.332779] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-15T17:11:03.612912] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-15T17:11:03.614164] [INFO ] [REMOTE ] AMTD: Full fetch complete (3756 records). [2025-09-15T17:11:03.614262] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-09-15T17:11:03.663077] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-09-15T17:11:03.973486] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-09-15T17:11:03.973577] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-09-15T17:11:03.973733] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-09-15T17:11:03.973776] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-09-15T17:11:03.974151] [DEBUG] [LOCAL ] AMTD: Trimmed 3756 records to 2875 (keeping 150 days of data) [2025-09-15T17:11:03.992164] [DEBUG] [LOCAL ] AMTD: Primary data saved (2875 records). [2025-09-15T17:11:03.992297] [INFO ] [MAIN ] AMTD: Full history saved. [2025-09-15T17:11:03.992415] [INFO ] [MAIN ] Update Progress: 111/2369 symbols completed. AMTD took 25.0s. Estimated remaining: 3h 43m 59s. Rate: 10.1 symbols/min [2025-09-15T17:11:04.176437] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:11:04.202129] [DEBUG] [LOCAL ] AN: Loaded 23541 existing records from primary storage. [2025-09-15T17:11:04.202290] [INFO ] [MAIN ] AN: Loaded 23541 existing records. [2025-09-15T17:11:04.377733] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:11:04.377989] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-09-15T17:11:04.378035] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-09-15T17:11:04.379027] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-09-15T17:11:04.379082] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-09-15T17:11:04.462948] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-09-15T17:11:04.733145] [INFO ] [REMOTE ] AN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:11:05.205101] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-15T17:11:05.257909] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-09-15T17:11:06.024528] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T17:11:06.057827] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-09-15T17:11:06.326919] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-15T17:11:06.857900] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-09-15T17:11:07.579737] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-15T17:11:07.657867] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-09-15T17:11:07.718403] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-15T17:11:08.457869] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-09-15T17:11:08.849825] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-15T17:11:09.257877] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-09-15T17:11:10.057887] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-09-15T17:11:10.230125] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-15T17:11:10.458610] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T17:11:10.769734] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-15T17:11:10.771456] [INFO ] [REMOTE ] AMWL: Full fetch complete (10123 records). [2025-09-15T17:11:10.771527] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-09-15T17:11:10.862975] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-09-15T17:11:11.155433] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-09-15T17:11:11.155548] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-09-15T17:11:11.155960] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-09-15T17:11:11.156022] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-09-15T17:11:11.156560] [DEBUG] [LOCAL ] AMWL: Trimmed 10123 records to 6494 (keeping 150 days of data) [2025-09-15T17:11:11.195434] [DEBUG] [LOCAL ] AMWL: Primary data saved (6494 records). [2025-09-15T17:11:11.195561] [INFO ] [MAIN ] AMWL: Full history saved. [2025-09-15T17:11:11.195688] [INFO ] [MAIN ] Update Progress: 112/2369 symbols completed. AMWL took 21.3s. Estimated remaining: 3h 44m 19s. Rate: 10.1 symbols/min [2025-09-15T17:11:11.309222] [DEBUG] [REMOTE ] AMTM: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-15T17:11:11.341471] [WARN ] [REMOTE ] AMTM: No data returned for month 2025-07 [2025-09-15T17:11:11.375296] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:11:11.417992] [DEBUG] [LOCAL ] ANET: Loaded 40506 existing records from primary storage. [2025-09-15T17:11:11.418186] [INFO ] [MAIN ] ANET: Loaded 40506 existing records. [2025-09-15T17:11:11.594424] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:11:11.594710] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-09-15T17:11:11.594761] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-09-15T17:11:11.596338] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-09-15T17:11:11.596395] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-09-15T17:11:11.662952] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-09-15T17:11:11.945142] [INFO ] [REMOTE ] ANET: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:11:12.457879] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-09-15T17:11:12.679373] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-15T17:11:13.257867] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-09-15T17:11:14.057923] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-09-15T17:11:14.276057] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T17:11:14.538783] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-15T17:11:14.857937] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-09-15T17:11:15.456346] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T17:11:15.657896] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-09-15T17:11:16.397906] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-15T17:11:16.457837] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-09-15T17:11:17.119134] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-15T17:11:17.257871] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-09-15T17:11:18.057932] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-09-15T17:11:18.382537] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-15T17:11:18.547398] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T17:11:18.552767] [INFO ] [REMOTE ] AMTM: Full fetch complete (47373 records). [2025-09-15T17:11:18.552860] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-09-15T17:11:18.739214] [WARN ] [VALIDATOR ] AMTM: Validation failed - insufficient historical data. Have 128 unique days, need 150 days [2025-09-15T17:11:18.739811] [FATAL] [MAIN ] AMTM: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:11:18.739870] [WARN ] [MAIN ] AMTM: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:11:18.739911] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-09-15T17:11:18.739980] [DEBUG] [LOCAL ] AMTM: No primary data file found to delete. [2025-09-15T17:11:18.740031] [INFO ] [LOCAL ] AMTM: Starting deletion of derivative data. [2025-09-15T17:11:18.740414] [DEBUG] [LOCAL ] AMTM: Deleted derivative data file. [2025-09-15T17:11:18.740920] [INFO ] [MAIN ] Update Progress: 113/2369 symbols completed. AMTM took 36.4s. Estimated remaining: 3h 44m 44s. Rate: 10.0 symbols/min [2025-09-15T17:11:18.863029] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-09-15T17:11:18.913241] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:11:18.958463] [DEBUG] [LOCAL ] ANF: Loaded 39151 existing records from primary storage. [2025-09-15T17:11:18.958608] [INFO ] [MAIN ] ANF: Loaded 39151 existing records. [2025-09-15T17:11:19.138033] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:11:19.138472] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-09-15T17:11:19.138529] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-09-15T17:11:19.145368] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-09-15T17:11:19.153168] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-09-15T17:11:19.159960] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T17:11:19.544548] [INFO ] [REMOTE ] ANF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:11:19.657830] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-09-15T17:11:20.280070] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-15T17:11:20.457849] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-09-15T17:11:21.003246] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T17:11:21.007223] [INFO ] [REMOTE ] AN: Full fetch complete (36021 records). [2025-09-15T17:11:21.007360] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-09-15T17:11:21.263054] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-09-15T17:11:21.389606] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-09-15T17:11:21.389727] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-09-15T17:11:21.390230] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-09-15T17:11:21.390273] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-09-15T17:11:21.391336] [DEBUG] [LOCAL ] AN: Trimmed 36021 records to 23001 (keeping 150 days of data) [2025-09-15T17:11:21.534367] [DEBUG] [LOCAL ] AN: Primary data saved (23001 records). [2025-09-15T17:11:21.534512] [INFO ] [MAIN ] AN: Full history saved. [2025-09-15T17:11:21.534619] [INFO ] [MAIN ] Update Progress: 114/2369 symbols completed. AN took 17.5s. Estimated remaining: 3h 43m 35s. Rate: 10.1 symbols/min [2025-09-15T17:11:21.739674] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T17:11:21.741061] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:11:21.750544] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-09-15T17:11:21.750705] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-09-15T17:11:21.750849] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-09-15T17:11:21.750897] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-15T17:11:21.750948] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-15T17:11:21.750985] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-09-15T17:11:22.062940] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-09-15T17:11:22.115677] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:11:22.742321] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-15T17:11:22.857866] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-09-15T17:11:23.660942] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-02. [2025-09-15T17:11:23.664905] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-15T17:11:23.866712] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:11:23.867050] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-02 [2025-09-15T17:11:24.294066] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-15T17:11:24.457936] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-09-15T17:11:25.257892] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-09-15T17:11:25.962262] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T17:11:26.057880] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-09-15T17:11:26.857878] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-03. [2025-09-15T17:11:27.059786] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:11:27.060077] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-03 [2025-09-15T17:11:27.394991] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-15T17:11:27.657887] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-09-15T17:11:27.892620] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-15T17:11:28.457888] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-04. [2025-09-15T17:11:28.661423] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:11:28.661760] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-04 [2025-09-15T17:11:29.117750] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T17:11:29.257883] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-09-15T17:11:30.057880] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-09-15T17:11:30.737842] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-15T17:11:30.857917] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-09-15T17:11:31.657892] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-09-15T17:11:32.154773] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-15T17:11:32.160231] [INFO ] [REMOTE ] AMX: Full fetch complete (53244 records). [2025-09-15T17:11:32.160363] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-09-15T17:11:32.462465] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-05. [2025-09-15T17:11:32.550055] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-09-15T17:11:32.550197] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-09-15T17:11:32.550783] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-09-15T17:11:32.550924] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-09-15T17:11:32.552371] [DEBUG] [LOCAL ] AMX: Trimmed 53244 records to 36088 (keeping 150 days of data) [2025-09-15T17:11:32.680521] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-09-15T17:11:32.773109] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:11:32.796334] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-05 [2025-09-15T17:11:32.823701] [DEBUG] [LOCAL ] AMX: Primary data saved (36088 records). [2025-09-15T17:11:32.823887] [INFO ] [MAIN ] AMX: Full history saved. [2025-09-15T17:11:32.823983] [INFO ] [MAIN ] Update Progress: 115/2369 symbols completed. AMX took 36.9s. Estimated remaining: 3h 45m 14s. Rate: 10.0 symbols/min [2025-09-15T17:11:32.997852] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:11:33.013403] [DEBUG] [LOCAL ] ANRO: Loaded 13852 existing records from primary storage. [2025-09-15T17:11:33.013551] [INFO ] [MAIN ] ANRO: Loaded 13852 existing records. [2025-09-15T17:11:33.199955] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:11:33.200318] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-09-15T17:11:33.200371] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-09-15T17:11:33.211422] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-09-15T17:11:33.225738] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-09-15T17:11:33.259842] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-06. [2025-09-15T17:11:33.333665] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-15T17:11:33.522177] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:11:33.522705] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-06 [2025-09-15T17:11:33.597310] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:11:34.057876] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-09-15T17:11:34.857890] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-07. [2025-09-15T17:11:35.051930] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:11:35.052239] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-07 [2025-09-15T17:11:35.657836] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-09-15T17:11:35.714885] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-15T17:11:36.457912] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-09-15T17:11:37.205706] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T17:11:37.257828] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-09-15T17:11:37.387612] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-15T17:11:38.057890] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-08. [2025-09-15T17:11:38.238852] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:11:38.239160] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-08 [2025-09-15T17:11:38.719223] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T17:11:38.727844] [INFO ] [REMOTE ] ANF: Full fetch complete (56859 records). [2025-09-15T17:11:38.728030] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-09-15T17:11:38.869753] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-09-15T17:11:39.116901] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-09-15T17:11:39.116999] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-09-15T17:11:39.117615] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-09-15T17:11:39.117703] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-09-15T17:11:39.119132] [DEBUG] [LOCAL ] ANF: Trimmed 56859 records to 38417 (keeping 150 days of data) [2025-09-15T17:11:39.363466] [DEBUG] [LOCAL ] ANF: Primary data saved (38417 records). [2025-09-15T17:11:39.363680] [INFO ] [MAIN ] ANF: Full history saved. [2025-09-15T17:11:39.364302] [INFO ] [MAIN ] Update Progress: 116/2369 symbols completed. ANF took 20.6s. Estimated remaining: 3h 45m 19s. Rate: 10.0 symbols/min [2025-09-15T17:11:39.536516] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:11:39.559469] [DEBUG] [LOCAL ] ANVS: Loaded 17780 existing records from primary storage. [2025-09-15T17:11:39.559611] [INFO ] [MAIN ] ANVS: Loaded 17780 existing records. [2025-09-15T17:11:39.659853] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-09. [2025-09-15T17:11:39.737175] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:11:39.737410] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-09-15T17:11:39.737458] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-09-15T17:11:39.738345] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-09-15T17:11:39.738397] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-09-15T17:11:40.092347] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:11:40.111784] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-15T17:11:40.455604] [INFO ] [REMOTE ] ANGX: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-15T17:11:40.457472] [INFO ] [REMOTE ] ANGX: Full fetch complete (979 records). [2025-09-15T17:11:40.457541] [DEBUG] [VALIDATOR ] ANGX: Validating primary data. [2025-09-15T17:11:40.463052] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-09-15T17:11:40.643408] [WARN ] [VALIDATOR ] ANGX: Validation failed - insufficient historical data. Have 3 unique days, need 150 days [2025-09-15T17:11:40.643629] [FATAL] [MAIN ] ANGX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:11:40.643723] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:11:40.643798] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-15T17:11:40.643863] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-15T17:11:40.643902] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-09-15T17:11:40.643953] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-09-15T17:11:40.644030] [INFO ] [MAIN ] Update Progress: 117/2369 symbols completed. ANGX took 19.1s. Estimated remaining: 3h 43m 42s. Rate: 10.1 symbols/min [2025-09-15T17:11:41.257875] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-09-15T17:11:42.057933] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-09-15T17:11:42.444779] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T17:11:42.857925] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-09-15T17:11:42.913376] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-15T17:11:43.104784] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-09-15T17:11:43.657881] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-09-15T17:11:43.715687] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-15T17:11:44.457901] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-09-15T17:11:45.216945] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-15T17:11:45.257920] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-09-15T17:11:45.513954] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-15T17:11:46.062976] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-09-15T17:11:46.072811] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-15T17:11:46.857871] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-09-15T17:11:47.159020] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-15T17:11:47.657934] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-09-15T17:11:48.381721] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-15T17:11:48.457909] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-09-15T17:11:48.547091] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-15T17:11:48.552986] [INFO ] [REMOTE ] ANET: Full fetch complete (58446 records). [2025-09-15T17:11:48.553089] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-09-15T17:11:48.934327] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-09-15T17:11:48.934418] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-09-15T17:11:48.935084] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-09-15T17:11:48.935133] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-09-15T17:11:48.936372] [DEBUG] [LOCAL ] ANET: Trimmed 58446 records to 39726 (keeping 150 days of data) [2025-09-15T17:11:49.041797] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-15T17:11:49.195791] [DEBUG] [LOCAL ] ANET: Primary data saved (39726 records). [2025-09-15T17:11:49.195950] [INFO ] [MAIN ] ANET: Full history saved. [2025-09-15T17:11:49.196437] [INFO ] [MAIN ] Update Progress: 118/2369 symbols completed. ANET took 38.0s. Estimated remaining: 3h 44m 25s. Rate: 10.0 symbols/min [2025-09-15T17:11:49.257913] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-09-15T17:11:50.057898] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-09-15T17:11:50.082343] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-15T17:11:50.857933] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-09-15T17:11:50.920078] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-15T17:11:50.921990] [INFO ] [REMOTE ] ANRO: Full fetch complete (22612 records). [2025-09-15T17:11:50.922190] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-09-15T17:11:51.285672] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-09-15T17:11:51.285768] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-09-15T17:11:51.286124] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-09-15T17:11:51.286165] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-09-15T17:11:51.287378] [DEBUG] [LOCAL ] ANRO: Trimmed 22612 records to 13456 (keeping 150 days of data) [2025-09-15T17:11:51.367996] [DEBUG] [LOCAL ] ANRO: Primary data saved (13456 records). [2025-09-15T17:11:51.368161] [INFO ] [MAIN ] ANRO: Full history saved. [2025-09-15T17:11:51.368274] [INFO ] [MAIN ] Update Progress: 119/2369 symbols completed. ANRO took 18.5s. Estimated remaining: 3h 43m 7s. Rate: 10.1 symbols/min [2025-09-15T17:11:51.828099] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-15T17:11:51.834559] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-09-15T17:11:52.995312] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-15T17:11:53.001190] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-09-15T17:11:53.963258] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T17:11:53.967848] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-09-15T17:11:54.803392] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-15T17:11:54.805885] [INFO ] [REMOTE ] ANVS: Full fetch complete (26600 records). [2025-09-15T17:11:54.805999] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-09-15T17:11:55.181535] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-09-15T17:11:55.181677] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-09-15T17:11:55.182032] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-09-15T17:11:55.182073] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-09-15T17:11:55.182912] [DEBUG] [LOCAL ] ANVS: Trimmed 26600 records to 17585 (keeping 150 days of data) [2025-09-15T17:11:55.300180] [DEBUG] [LOCAL ] ANVS: Primary data saved (17585 records). [2025-09-15T17:11:55.300475] [INFO ] [MAIN ] ANVS: Full history saved. [2025-09-15T17:11:55.300603] [INFO ] [MAIN ] Update Progress: 120/2369 symbols completed. ANVS took 15.9s. Estimated remaining: 3h 42m 23s. Rate: 10.1 symbols/min [2025-09-15T17:11:55.988843] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:11:56.045863] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:11:56.046219] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-09-15T17:11:56.052853] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:11:56.047222] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:11:56.053947] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-09-15T17:11:56.057372] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-09-15T17:11:56.057457] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-15T17:11:56.057508] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-15T17:11:56.057544] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-09-15T17:11:56.176402] [DEBUG] [LOCAL ] AOMR: Loaded 12788 existing records from primary storage. [2025-09-15T17:11:56.203968] [INFO ] [MAIN ] AOMR: Loaded 12788 existing records. [2025-09-15T17:11:56.401335] [DEBUG] [LOCAL ] AOD: Loaded 22575 existing records from primary storage. [2025-09-15T17:11:56.450449] [INFO ] [MAIN ] AOD: Loaded 22575 existing records. [2025-09-15T17:11:56.600057] [DEBUG] [LOCAL ] AON: Loaded 34078 existing records from primary storage. [2025-09-15T17:11:56.626192] [INFO ] [MAIN ] AON: Loaded 34078 existing records. [2025-09-15T17:11:56.889314] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:11:56.921167] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:11:56.967146] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-02. [2025-09-15T17:11:56.977631] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-09-15T17:11:57.040672] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-09-15T17:11:57.092810] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:11:57.086563] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:11:57.094547] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-09-15T17:11:57.094742] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-09-15T17:11:57.094927] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-09-15T17:11:57.094871] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-09-15T17:11:57.095054] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-09-15T17:11:57.095216] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-09-15T17:11:57.106441] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-09-15T17:11:57.130524] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-09-15T17:11:57.106309] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-09-15T17:11:57.193990] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-09-15T17:11:57.395745] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:11:57.478154] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-02 [2025-09-15T17:11:57.570761] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-03. [2025-09-15T17:11:58.057894] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:11:58.079479] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:11:58.099389] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-09-15T17:11:58.099568] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-03 [2025-09-15T17:11:58.127847] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-04. [2025-09-15T17:11:58.242214] [INFO ] [REMOTE ] AON: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:11:58.259027] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-09-15T17:11:58.262219] [INFO ] [REMOTE ] AOD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:11:58.263243] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-09-15T17:11:58.437281] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:11:58.437700] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-04 [2025-09-15T17:11:58.857891] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-05. [2025-09-15T17:11:58.952037] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-15T17:11:59.143473] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-15T17:11:59.380381] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-15T17:11:59.657841] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-09-15T17:11:59.967875] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-15T17:12:00.457919] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-06. [2025-09-15T17:12:00.520195] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-15T17:12:01.017072] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-15T17:12:01.257875] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-09-15T17:12:02.057889] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-07. [2025-09-15T17:12:02.857920] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-09-15T17:12:03.596532] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-15T17:12:03.657913] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-08. [2025-09-15T17:12:04.457868] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-09-15T17:12:04.577257] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-15T17:12:04.617123] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (3.36 seconds). [2025-09-15T17:12:04.745774] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-15T17:12:05.146850] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-15T17:12:05.257879] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-09-15T17:12:06.057942] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-09-15T17:12:06.251412] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T17:12:06.857852] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-09-15T17:12:07.039477] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-15T17:12:07.657958] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-09-15T17:12:07.723929] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-15T17:12:08.457956] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-09. [2025-09-15T17:12:08.820522] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-15T17:12:08.821662] [INFO ] [REMOTE ] AOMD: Full fetch complete (1673 records). [2025-09-15T17:12:08.821743] [DEBUG] [VALIDATOR ] AOMD: Validating primary data. [2025-09-15T17:12:09.016692] [WARN ] [VALIDATOR ] AOMD: Validation failed - insufficient historical data. Have 77 unique days, need 150 days [2025-09-15T17:12:09.016888] [FATAL] [MAIN ] AOMD: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:12:09.016934] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:12:09.016978] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-15T17:12:09.017307] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-15T17:12:09.017575] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-09-15T17:12:09.017638] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-09-15T17:12:09.017828] [INFO ] [MAIN ] Update Progress: 121/2369 symbols completed. AOMD took 13.7s. Estimated remaining: 3h 44m 42s. Rate: 10.0 symbols/min [2025-09-15T17:12:09.201005] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:12:09.226754] [DEBUG] [LOCAL ] AORT: Loaded 21896 existing records from primary storage. [2025-09-15T17:12:09.226908] [INFO ] [MAIN ] AORT: Loaded 21896 existing records. [2025-09-15T17:12:09.262950] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-09-15T17:12:09.420915] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:12:09.421236] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-09-15T17:12:09.421398] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-09-15T17:12:09.422450] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-09-15T17:12:09.422544] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-09-15T17:12:09.629762] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-15T17:12:09.823561] [INFO ] [REMOTE ] AORT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:12:10.057907] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-09-15T17:12:10.267584] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-15T17:12:10.857885] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-09-15T17:12:11.629468] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-15T17:12:11.657819] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-09-15T17:12:11.773182] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-15T17:12:12.457873] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-09-15T17:12:12.831611] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-15T17:12:12.834074] [INFO ] [REMOTE ] AOMR: Full fetch complete (19001 records). [2025-09-15T17:12:12.834156] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-09-15T17:12:13.199767] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-09-15T17:12:13.199846] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-09-15T17:12:13.200147] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-09-15T17:12:13.200195] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-09-15T17:12:13.200780] [DEBUG] [LOCAL ] AOMR: Trimmed 19001 records to 12648 (keeping 150 days of data) [2025-09-15T17:12:13.258495] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-09-15T17:12:13.279918] [DEBUG] [LOCAL ] AOMR: Primary data saved (12648 records). [2025-09-15T17:12:13.280018] [INFO ] [MAIN ] AOMR: Full history saved. [2025-09-15T17:12:13.280115] [INFO ] [MAIN ] Update Progress: 122/2369 symbols completed. AOMR took 18.0s. Estimated remaining: 3h 44m 4s. Rate: 10.0 symbols/min [2025-09-15T17:12:13.447214] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:12:13.487508] [DEBUG] [LOCAL ] AOS: Loaded 37044 existing records from primary storage. [2025-09-15T17:12:13.487671] [INFO ] [MAIN ] AOS: Loaded 37044 existing records. [2025-09-15T17:12:13.665041] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:12:13.665295] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-09-15T17:12:13.665341] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-09-15T17:12:13.666850] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-09-15T17:12:13.666904] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-09-15T17:12:14.064946] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-09-15T17:12:14.109326] [INFO ] [REMOTE ] AOS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:12:14.398804] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-15T17:12:14.857900] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-09-15T17:12:15.005520] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T17:12:15.177600] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-15T17:12:15.657870] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-09-15T17:12:16.341953] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T17:12:16.457889] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-09-15T17:12:16.761244] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-15T17:12:17.257867] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-09-15T17:12:17.664345] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T17:12:18.057867] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-09-15T17:12:18.562716] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T17:12:18.857891] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-09-15T17:12:19.621917] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-15T17:12:19.657841] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-09-15T17:12:20.036734] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-15T17:12:20.457943] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-09-15T17:12:21.041525] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-15T17:12:21.046460] [INFO ] [REMOTE ] AON: Full fetch complete (49473 records). [2025-09-15T17:12:21.046563] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-09-15T17:12:21.263674] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-09-15T17:12:21.430770] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-09-15T17:12:21.430845] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-09-15T17:12:21.431363] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-09-15T17:12:21.431406] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-09-15T17:12:21.432418] [DEBUG] [LOCAL ] AON: Trimmed 49473 records to 33409 (keeping 150 days of data) [2025-09-15T17:12:21.646929] [DEBUG] [LOCAL ] AON: Primary data saved (33409 records). [2025-09-15T17:12:21.647070] [INFO ] [MAIN ] AON: Full history saved. [2025-09-15T17:12:21.647154] [INFO ] [MAIN ] Update Progress: 123/2369 symbols completed. AON took 26.3s. Estimated remaining: 3h 44m 42s. Rate: 10.0 symbols/min [2025-09-15T17:12:21.815963] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:12:21.836446] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-15T17:12:21.846389] [DEBUG] [LOCAL ] AP: Loaded 5808 existing records from primary storage. [2025-09-15T17:12:21.846488] [INFO ] [MAIN ] AP: Loaded 5808 existing records. [2025-09-15T17:12:22.019977] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:12:22.020234] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-09-15T17:12:22.020287] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-09-15T17:12:22.020610] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-09-15T17:12:22.020685] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-09-15T17:12:22.063000] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-09-15T17:12:22.381934] [INFO ] [REMOTE ] AP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:12:22.398079] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-15T17:12:22.857864] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-09-15T17:12:23.657894] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-09-15T17:12:23.877633] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-15T17:12:24.457887] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-09-15T17:12:24.791715] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-15T17:12:24.905293] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-15T17:12:25.257879] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-09-15T17:12:25.436311] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T17:12:25.439720] [INFO ] [REMOTE ] AOD: Full fetch complete (32679 records). [2025-09-15T17:12:25.439796] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-09-15T17:12:25.440310] [FATAL] [VALIDATOR ] AOD: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:12:25.440387] [FATAL] [MAIN ] AOD: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:12:25.440424] [WARN ] [MAIN ] AOD: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:12:25.440463] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-09-15T17:12:25.440540] [DEBUG] [LOCAL ] AOD: No primary data file found to delete. [2025-09-15T17:12:25.440589] [INFO ] [LOCAL ] AOD: Starting deletion of derivative data. [2025-09-15T17:12:25.440927] [DEBUG] [LOCAL ] AOD: Deleted derivative data file. [2025-09-15T17:12:25.441009] [INFO ] [MAIN ] Update Progress: 124/2369 symbols completed. AOD took 30.1s. Estimated remaining: 3h 43m 56s. Rate: 10.0 symbols/min [2025-09-15T17:12:25.612636] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:12:25.632552] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-15T17:12:25.643954] [DEBUG] [LOCAL ] APAM: Loaded 27241 existing records from primary storage. [2025-09-15T17:12:25.644057] [INFO ] [MAIN ] APAM: Loaded 27241 existing records. [2025-09-15T17:12:25.819702] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:12:25.819951] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-09-15T17:12:25.819997] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-09-15T17:12:25.821116] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-09-15T17:12:25.821169] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-09-15T17:12:26.063058] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-09-15T17:12:26.176386] [INFO ] [REMOTE ] APAM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:12:26.857878] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-09-15T17:12:27.567370] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-15T17:12:27.657900] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-09-15T17:12:27.970101] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-15T17:12:28.457926] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-09-15T17:12:28.602506] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-15T17:12:28.607313] [INFO ] [REMOTE ] AORT: Full fetch complete (32543 records). [2025-09-15T17:12:28.607478] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-09-15T17:12:28.997560] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-09-15T17:12:28.997706] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-09-15T17:12:28.998297] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-09-15T17:12:28.998358] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-09-15T17:12:28.999721] [DEBUG] [LOCAL ] AORT: Trimmed 32543 records to 21502 (keeping 150 days of data) [2025-09-15T17:12:29.126048] [DEBUG] [LOCAL ] AORT: Primary data saved (21502 records). [2025-09-15T17:12:29.126193] [INFO ] [MAIN ] AORT: Full history saved. [2025-09-15T17:12:29.126278] [INFO ] [MAIN ] Update Progress: 125/2369 symbols completed. AORT took 20.1s. Estimated remaining: 3h 43m 8s. Rate: 10.1 symbols/min [2025-09-15T17:12:29.270140] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-09-15T17:12:29.304015] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:12:29.340116] [DEBUG] [LOCAL ] APD: Loaded 33825 existing records from primary storage. [2025-09-15T17:12:29.340296] [INFO ] [MAIN ] APD: Loaded 33825 existing records. [2025-09-15T17:12:29.516189] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:12:29.516460] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-09-15T17:12:29.516508] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-09-15T17:12:29.518006] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-09-15T17:12:29.518063] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-09-15T17:12:29.872241] [INFO ] [REMOTE ] APD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:12:29.947022] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-15T17:12:29.993589] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-15T17:12:30.057888] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-09-15T17:12:30.857916] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-09-15T17:12:30.996860] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-15T17:12:31.358549] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-15T17:12:31.657886] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-09-15T17:12:32.457892] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-09-15T17:12:32.977397] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-15T17:12:33.257917] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-09-15T17:12:33.781869] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-15T17:12:33.909978] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T17:12:34.057930] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-09-15T17:12:34.857921] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-09-15T17:12:35.657831] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-09-15T17:12:35.711600] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T17:12:36.050251] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T17:12:36.457869] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-09-15T17:12:36.754950] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-15T17:12:37.257887] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-09-15T17:12:37.901072] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-15T17:12:38.057911] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-09-15T17:12:38.848888] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-15T17:12:38.860039] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-09-15T17:12:39.508001] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T17:12:39.546525] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-15T17:12:39.657902] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-09-15T17:12:40.457927] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-09-15T17:12:41.257888] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-09-15T17:12:41.326202] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-15T17:12:41.760916] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T17:12:42.057893] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-09-15T17:12:42.318188] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-15T17:12:42.857907] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-09-15T17:12:43.292329] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T17:12:43.657880] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-09-15T17:12:44.380771] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T17:12:44.457857] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-09-15T17:12:44.916203] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T17:12:44.922390] [INFO ] [REMOTE ] AOS: Full fetch complete (53745 records). [2025-09-15T17:12:44.922514] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-09-15T17:12:45.260960] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-09-15T17:12:45.310951] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-09-15T17:12:45.311054] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-09-15T17:12:45.311738] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-09-15T17:12:45.311796] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-09-15T17:12:45.313306] [DEBUG] [LOCAL ] AOS: Trimmed 53745 records to 36309 (keeping 150 days of data) [2025-09-15T17:12:45.541938] [DEBUG] [LOCAL ] AOS: Primary data saved (36309 records). [2025-09-15T17:12:45.542089] [INFO ] [MAIN ] AOS: Full history saved. [2025-09-15T17:12:45.542177] [INFO ] [MAIN ] Update Progress: 126/2369 symbols completed. AOS took 32.3s. Estimated remaining: 3h 46m 8s. Rate: 9.9 symbols/min [2025-09-15T17:12:45.714541] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:12:45.751210] [DEBUG] [LOCAL ] APG: Loaded 38148 existing records from primary storage. [2025-09-15T17:12:45.751384] [INFO ] [MAIN ] APG: Loaded 38148 existing records. [2025-09-15T17:12:45.937866] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:12:45.938667] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-09-15T17:12:45.938726] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-09-15T17:12:45.940378] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-09-15T17:12:45.940438] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-09-15T17:12:46.059583] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-09-15T17:12:46.345174] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-15T17:12:46.351146] [INFO ] [REMOTE ] APG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:12:46.743625] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T17:12:46.809162] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T17:12:46.857833] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-09-15T17:12:47.657889] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-09-15T17:12:48.180508] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T17:12:48.252636] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-15T17:12:48.254002] [INFO ] [REMOTE ] AP: Full fetch complete (7010 records). [2025-09-15T17:12:48.254074] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-09-15T17:12:48.462991] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-09-15T17:12:48.619521] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-09-15T17:12:48.619602] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-09-15T17:12:48.619812] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-09-15T17:12:48.619858] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-09-15T17:12:48.620291] [DEBUG] [LOCAL ] AP: Trimmed 7010 records to 5760 (keeping 150 days of data) [2025-09-15T17:12:48.654484] [DEBUG] [LOCAL ] AP: Primary data saved (5760 records). [2025-09-15T17:12:48.654602] [INFO ] [MAIN ] AP: Full history saved. [2025-09-15T17:12:48.654701] [INFO ] [MAIN ] Update Progress: 127/2369 symbols completed. AP took 27.0s. Estimated remaining: 3h 45m 11s. Rate: 10.0 symbols/min [2025-09-15T17:12:48.831479] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:12:48.878954] [DEBUG] [LOCAL ] APH: Loaded 40431 existing records from primary storage. [2025-09-15T17:12:48.879174] [INFO ] [MAIN ] APH: Loaded 40431 existing records. [2025-09-15T17:12:49.058901] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:12:49.059189] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-09-15T17:12:49.059252] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-09-15T17:12:49.060814] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-09-15T17:12:49.060867] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-09-15T17:12:49.263154] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-09-15T17:12:49.420466] [INFO ] [REMOTE ] APH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:12:49.499248] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T17:12:49.503382] [INFO ] [REMOTE ] APAM: Full fetch complete (39961 records). [2025-09-15T17:12:49.503469] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-09-15T17:12:49.889899] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-09-15T17:12:49.889999] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-09-15T17:12:49.890545] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-09-15T17:12:49.890591] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-09-15T17:12:49.891634] [DEBUG] [LOCAL ] APAM: Trimmed 39961 records to 26710 (keeping 150 days of data) [2025-09-15T17:12:50.058116] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-09-15T17:12:50.069323] [DEBUG] [LOCAL ] APAM: Primary data saved (26710 records). [2025-09-15T17:12:50.069858] [INFO ] [MAIN ] APAM: Full history saved. [2025-09-15T17:12:50.069964] [INFO ] [MAIN ] Update Progress: 128/2369 symbols completed. APAM took 24.6s. Estimated remaining: 3h 43m 44s. Rate: 10.0 symbols/min [2025-09-15T17:12:50.239168] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:12:50.281740] [DEBUG] [LOCAL ] APLE: Loaded 39120 existing records from primary storage. [2025-09-15T17:12:50.281889] [INFO ] [MAIN ] APLE: Loaded 39120 existing records. [2025-09-15T17:12:50.456659] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:12:50.456949] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-09-15T17:12:50.456996] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-09-15T17:12:50.458697] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-09-15T17:12:50.458753] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-09-15T17:12:50.814111] [INFO ] [REMOTE ] APLE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:12:50.857862] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-09-15T17:12:51.026126] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-15T17:12:51.657925] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-09-15T17:12:51.980463] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-15T17:12:52.164144] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-15T17:12:52.457935] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-09-15T17:12:52.947905] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-15T17:12:53.257913] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-09-15T17:12:54.057927] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-09-15T17:12:54.351816] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-15T17:12:54.743141] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-15T17:12:54.857897] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-09-15T17:12:55.656249] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-15T17:12:55.665566] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-09-15T17:12:56.295470] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-15T17:12:56.457881] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-09-15T17:12:57.232966] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T17:12:57.257815] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-09-15T17:12:57.750925] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T17:12:58.057876] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-09-15T17:12:58.579634] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T17:12:58.857927] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-09-15T17:12:59.465260] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T17:12:59.469924] [INFO ] [REMOTE ] APD: Full fetch complete (49708 records). [2025-09-15T17:12:59.470044] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-09-15T17:12:59.665621] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-09-15T17:12:59.865926] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-09-15T17:12:59.866036] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-09-15T17:12:59.866607] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-09-15T17:12:59.866666] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-09-15T17:12:59.868003] [DEBUG] [LOCAL ] APD: Trimmed 49708 records to 33036 (keeping 150 days of data) [2025-09-15T17:13:00.079961] [DEBUG] [LOCAL ] APD: Primary data saved (33036 records). [2025-09-15T17:13:00.080109] [INFO ] [MAIN ] APD: Full history saved. [2025-09-15T17:13:00.080841] [INFO ] [MAIN ] Update Progress: 129/2369 symbols completed. APD took 31.0s. Estimated remaining: 3h 44m 48s. Rate: 10.0 symbols/min [2025-09-15T17:13:00.252350] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:13:00.286193] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T17:13:00.332289] [DEBUG] [LOCAL ] APO: Loaded 40146 existing records from primary storage. [2025-09-15T17:13:00.332452] [INFO ] [MAIN ] APO: Loaded 40146 existing records. [2025-09-15T17:13:00.462930] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-09-15T17:13:00.514129] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:13:00.514398] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-09-15T17:13:00.514458] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-09-15T17:13:00.516199] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-09-15T17:13:00.516255] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-09-15T17:13:00.873609] [INFO ] [REMOTE ] APO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:13:01.257856] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-09-15T17:13:01.352495] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-15T17:13:02.057889] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-09-15T17:13:02.115488] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-15T17:13:02.857874] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-09-15T17:13:03.098344] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-15T17:13:03.657848] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-09-15T17:13:03.691834] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-15T17:13:04.457871] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-09-15T17:13:04.554553] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-15T17:13:04.899030] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-15T17:13:05.257895] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-09-15T17:13:06.057898] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-09-15T17:13:06.399854] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-15T17:13:06.767752] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-15T17:13:06.857893] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-09-15T17:13:07.294595] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-15T17:13:07.300567] [INFO ] [REMOTE ] APG: Full fetch complete (54474 records). [2025-09-15T17:13:07.300730] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-09-15T17:13:07.661910] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-09-15T17:13:07.698566] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-09-15T17:13:07.698673] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-09-15T17:13:07.699290] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-09-15T17:13:07.699344] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-09-15T17:13:07.700615] [DEBUG] [LOCAL ] APG: Trimmed 54474 records to 37503 (keeping 150 days of data) [2025-09-15T17:13:07.930894] [DEBUG] [LOCAL ] APG: Primary data saved (37503 records). [2025-09-15T17:13:07.931048] [INFO ] [MAIN ] APG: Full history saved. [2025-09-15T17:13:07.931140] [INFO ] [MAIN ] Update Progress: 130/2369 symbols completed. APG took 22.4s. Estimated remaining: 3h 45m 13s. Rate: 9.9 symbols/min [2025-09-15T17:13:08.102208] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:13:08.109487] [DEBUG] [LOCAL ] APOS: Loaded 5346 existing records from primary storage. [2025-09-15T17:13:08.109627] [INFO ] [MAIN ] APOS: Loaded 5346 existing records. [2025-09-15T17:13:08.294040] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:13:08.294326] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-09-15T17:13:08.294375] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-09-15T17:13:08.294755] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-09-15T17:13:08.294807] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-09-15T17:13:08.468274] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-09-15T17:13:08.656589] [INFO ] [REMOTE ] APOS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:13:08.687009] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-15T17:13:09.130701] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T17:13:09.257940] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-09-15T17:13:10.057849] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-09-15T17:13:10.144742] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-15T17:13:10.494291] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-15T17:13:10.857884] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-09-15T17:13:11.572958] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-15T17:13:11.655843] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-15T17:13:11.665764] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-09-15T17:13:12.231581] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-15T17:13:12.457873] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-09-15T17:13:13.257901] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-09-15T17:13:13.951905] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-15T17:13:14.057875] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-09-15T17:13:14.114478] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-15T17:13:14.120096] [INFO ] [REMOTE ] APLE: Full fetch complete (56350 records). [2025-09-15T17:13:14.120196] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-09-15T17:13:14.499097] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-09-15T17:13:14.499222] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-09-15T17:13:14.499833] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-09-15T17:13:14.499878] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-09-15T17:13:14.501021] [DEBUG] [LOCAL ] APLE: Trimmed 56350 records to 38334 (keeping 150 days of data) [2025-09-15T17:13:14.741743] [DEBUG] [LOCAL ] APLE: Primary data saved (38334 records). [2025-09-15T17:13:14.741898] [INFO ] [MAIN ] APLE: Full history saved. [2025-09-15T17:13:14.744509] [INFO ] [MAIN ] Update Progress: 131/2369 symbols completed. APLE took 24.7s. Estimated remaining: 3h 45m 20s. Rate: 9.9 symbols/min [2025-09-15T17:13:14.860334] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-09-15T17:13:14.877349] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T17:13:14.937207] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:13:14.981813] [DEBUG] [LOCAL ] APTV: Loaded 39109 existing records from primary storage. [2025-09-15T17:13:14.982102] [INFO ] [MAIN ] APTV: Loaded 39109 existing records. [2025-09-15T17:13:15.174030] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:13:15.174430] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-09-15T17:13:15.174486] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-09-15T17:13:15.176299] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-09-15T17:13:15.176362] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-09-15T17:13:15.570008] [INFO ] [REMOTE ] APTV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:13:15.657879] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-09-15T17:13:16.135185] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-15T17:13:16.457887] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-09-15T17:13:17.077055] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-15T17:13:17.257920] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-09-15T17:13:17.994859] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-15T17:13:18.057851] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-09-15T17:13:18.857946] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-09-15T17:13:19.233844] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-15T17:13:19.515446] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T17:13:19.657923] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-09-15T17:13:20.457949] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-09-15T17:13:20.768952] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-15T17:13:21.141910] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T17:13:21.142737] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T17:13:21.257858] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-09-15T17:13:22.057896] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-09-15T17:13:22.857889] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-09-15T17:13:23.166795] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-15T17:13:23.531753] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T17:13:23.541714] [INFO ] [REMOTE ] APH: Full fetch complete (58371 records). [2025-09-15T17:13:23.541870] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-09-15T17:13:23.662976] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-09-15T17:13:23.926390] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-09-15T17:13:23.926488] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-09-15T17:13:23.927135] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-09-15T17:13:23.927185] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-09-15T17:13:23.928599] [DEBUG] [LOCAL ] APH: Trimmed 58371 records to 39651 (keeping 150 days of data) [2025-09-15T17:13:24.187275] [DEBUG] [LOCAL ] APH: Primary data saved (39651 records). [2025-09-15T17:13:24.187443] [INFO ] [MAIN ] APH: Full history saved. [2025-09-15T17:13:24.188238] [INFO ] [MAIN ] Update Progress: 132/2369 symbols completed. APH took 35.5s. Estimated remaining: 3h 46m 12s. Rate: 9.9 symbols/min [2025-09-15T17:13:24.359834] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:13:24.400120] [DEBUG] [LOCAL ] AQN: Loaded 38906 existing records from primary storage. [2025-09-15T17:13:24.400267] [INFO ] [MAIN ] AQN: Loaded 38906 existing records. [2025-09-15T17:13:24.467965] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-09-15T17:13:24.579450] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:13:24.579790] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-09-15T17:13:24.579911] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-09-15T17:13:24.581253] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-09-15T17:13:24.581319] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-09-15T17:13:24.890591] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-15T17:13:24.977961] [INFO ] [REMOTE ] AQN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:13:24.990878] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-15T17:13:24.992298] [INFO ] [REMOTE ] APOS: Full fetch complete (8098 records). [2025-09-15T17:13:24.992368] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-09-15T17:13:25.263199] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-09-15T17:13:25.344137] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-09-15T17:13:25.344219] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-09-15T17:13:25.344427] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-09-15T17:13:25.344465] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-09-15T17:13:25.344892] [DEBUG] [LOCAL ] APOS: Trimmed 8098 records to 5181 (keeping 150 days of data) [2025-09-15T17:13:25.378439] [DEBUG] [LOCAL ] APOS: Primary data saved (5181 records). [2025-09-15T17:13:25.378609] [INFO ] [MAIN ] APOS: Full history saved. [2025-09-15T17:13:25.378725] [INFO ] [MAIN ] Update Progress: 133/2369 symbols completed. APOS took 17.4s. Estimated remaining: 3h 44m 44s. Rate: 9.9 symbols/min [2025-09-15T17:13:25.545468] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:13:25.549855] [DEBUG] [LOCAL ] AQNB: Loaded 2963 existing records from primary storage. [2025-09-15T17:13:25.549932] [INFO ] [MAIN ] AQNB: Loaded 2963 existing records. [2025-09-15T17:13:25.731078] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:13:25.731445] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-09-15T17:13:25.731555] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-09-15T17:13:25.731824] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-09-15T17:13:25.731895] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-09-15T17:13:25.848743] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-15T17:13:25.909789] [INFO ] [REMOTE ] APO: Full fetch complete (58025 records). [2025-09-15T17:13:25.971193] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-09-15T17:13:26.074347] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-09-15T17:13:26.214340] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:13:26.518984] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-09-15T17:13:26.519102] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-09-15T17:13:26.520166] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-09-15T17:13:26.520260] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-09-15T17:13:26.523490] [DEBUG] [LOCAL ] APO: Trimmed 58025 records to 39369 (keeping 150 days of data) [2025-09-15T17:13:26.663145] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T17:13:26.830017] [DEBUG] [LOCAL ] APO: Primary data saved (39369 records). [2025-09-15T17:13:26.830173] [INFO ] [MAIN ] APO: Full history saved. [2025-09-15T17:13:26.830726] [INFO ] [MAIN ] Update Progress: 134/2369 symbols completed. APO took 26.7s. Estimated remaining: 3h 43m 22s. Rate: 10.0 symbols/min [2025-09-15T17:13:26.862956] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-09-15T17:13:27.007075] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:13:27.049496] [DEBUG] [LOCAL ] AR: Loaded 40342 existing records from primary storage. [2025-09-15T17:13:27.049688] [INFO ] [MAIN ] AR: Loaded 40342 existing records. [2025-09-15T17:13:27.224817] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:13:27.229976] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-09-15T17:13:27.230066] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-09-15T17:13:27.231441] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-09-15T17:13:27.231497] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-09-15T17:13:27.515336] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-15T17:13:27.591281] [INFO ] [REMOTE ] AR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:13:27.657885] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-09-15T17:13:27.914265] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-15T17:13:28.457878] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-09-15T17:13:28.797269] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-15T17:13:29.073320] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T17:13:29.257919] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-09-15T17:13:30.057878] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-09-15T17:13:30.857881] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-09-15T17:13:31.061770] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-15T17:13:31.211992] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-15T17:13:31.519395] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T17:13:31.657892] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-09-15T17:13:32.457933] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-09-15T17:13:33.173564] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T17:13:33.257824] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-09-15T17:13:34.057876] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-09-15T17:13:34.221164] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T17:13:34.386533] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-15T17:13:34.556163] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-15T17:13:34.857915] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-09-15T17:13:35.657900] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-09-15T17:13:36.259294] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-15T17:13:36.457883] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-09-15T17:13:36.519430] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T17:13:37.257881] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-09-15T17:13:38.057869] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-09-15T17:13:38.284047] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-15T17:13:38.482499] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-15T17:13:38.857888] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-09-15T17:13:38.946409] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-15T17:13:39.657906] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-09-15T17:13:40.198485] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-15T17:13:40.457857] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-09-15T17:13:41.080624] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-15T17:13:41.257873] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-09-15T17:13:41.900145] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T17:13:42.057899] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-09-15T17:13:42.625969] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-15T17:13:42.631812] [INFO ] [REMOTE ] APTV: Full fetch complete (56896 records). [2025-09-15T17:13:42.631933] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-09-15T17:13:42.863057] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-09-15T17:13:43.020373] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-09-15T17:13:43.020468] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-09-15T17:13:43.021102] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-09-15T17:13:43.021151] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-09-15T17:13:43.022753] [DEBUG] [LOCAL ] APTV: Trimmed 56896 records to 38330 (keeping 150 days of data) [2025-09-15T17:13:43.264636] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T17:13:43.299175] [DEBUG] [LOCAL ] APTV: Primary data saved (38330 records). [2025-09-15T17:13:43.299302] [INFO ] [MAIN ] APTV: Full history saved. [2025-09-15T17:13:43.299409] [INFO ] [MAIN ] Update Progress: 135/2369 symbols completed. APTV took 28.6s. Estimated remaining: 3h 46m 9s. Rate: 9.9 symbols/min [2025-09-15T17:13:43.465600] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:13:43.500222] [DEBUG] [LOCAL ] ARCO: Loaded 33598 existing records from primary storage. [2025-09-15T17:13:43.500362] [INFO ] [MAIN ] ARCO: Loaded 33598 existing records. [2025-09-15T17:13:43.672818] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-09-15T17:13:43.677279] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:13:43.678162] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-09-15T17:13:43.678210] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-09-15T17:13:43.679942] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-09-15T17:13:43.680000] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-09-15T17:13:44.043778] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:13:44.457915] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-09-15T17:13:44.741448] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-15T17:13:44.814981] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-15T17:13:45.060856] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-15T17:13:45.066469] [INFO ] [REMOTE ] AQN: Full fetch complete (56594 records). [2025-09-15T17:13:45.066571] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-09-15T17:13:45.267280] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-09-15T17:13:45.457130] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-09-15T17:13:45.457245] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-09-15T17:13:45.458427] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-09-15T17:13:45.458487] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-09-15T17:13:45.460287] [DEBUG] [LOCAL ] AQN: Trimmed 56594 records to 38142 (keeping 150 days of data) [2025-09-15T17:13:45.720511] [DEBUG] [LOCAL ] AQN: Primary data saved (38142 records). [2025-09-15T17:13:45.720855] [INFO ] [MAIN ] AQN: Full history saved. [2025-09-15T17:13:45.721441] [INFO ] [MAIN ] Update Progress: 136/2369 symbols completed. AQN took 21.5s. Estimated remaining: 3h 45m 3s. Rate: 9.9 symbols/min [2025-09-15T17:13:45.893806] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:13:45.908747] [DEBUG] [LOCAL ] ARDC: Loaded 10479 existing records from primary storage. [2025-09-15T17:13:45.908891] [INFO ] [MAIN ] ARDC: Loaded 10479 existing records. [2025-09-15T17:13:46.063075] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-09-15T17:13:46.094295] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:13:46.094603] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-09-15T17:13:46.094696] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-09-15T17:13:46.095383] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-09-15T17:13:46.095442] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-09-15T17:13:46.464119] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:13:46.780763] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-15T17:13:46.782024] [INFO ] [REMOTE ] AQNB: Full fetch complete (4399 records). [2025-09-15T17:13:46.782099] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-09-15T17:13:46.863085] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-09-15T17:13:47.147296] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-09-15T17:13:47.147478] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-09-15T17:13:47.147796] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-09-15T17:13:47.147889] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-09-15T17:13:47.148585] [DEBUG] [LOCAL ] AQNB: Trimmed 4399 records to 2896 (keeping 150 days of data) [2025-09-15T17:13:47.196755] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-15T17:13:47.211756] [DEBUG] [LOCAL ] AQNB: Primary data saved (2896 records). [2025-09-15T17:13:47.211878] [INFO ] [MAIN ] AQNB: Full history saved. [2025-09-15T17:13:47.212009] [INFO ] [MAIN ] Update Progress: 137/2369 symbols completed. AQNB took 21.8s. Estimated remaining: 3h 43m 43s. Rate: 10.0 symbols/min [2025-09-15T17:13:47.415996] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:13:47.443505] [DEBUG] [LOCAL ] ARDT: Loaded 20242 existing records from primary storage. [2025-09-15T17:13:47.443709] [INFO ] [MAIN ] ARDT: Loaded 20242 existing records. [2025-09-15T17:13:47.617340] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:13:47.617567] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-09-15T17:13:47.617612] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-09-15T17:13:47.618434] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-09-15T17:13:47.618486] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-09-15T17:13:47.663193] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-09-15T17:13:47.970560] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:13:48.453261] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-15T17:13:48.461588] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-09-15T17:13:48.731296] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-15T17:13:49.257873] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-09-15T17:13:49.483527] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-15T17:13:50.057950] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-09-15T17:13:50.335632] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-15T17:13:50.857904] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-09-15T17:13:51.657914] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-09-15T17:13:51.860828] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-15T17:13:51.963124] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-15T17:13:52.251855] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-15T17:13:52.457937] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-09-15T17:13:53.176955] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-15T17:13:53.257855] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-09-15T17:13:53.776633] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-15T17:13:54.057893] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-09-15T17:13:54.702352] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-15T17:13:54.857892] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-09-15T17:13:55.657884] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-09-15T17:13:56.423456] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T17:13:56.457931] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-09-15T17:13:57.037957] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T17:13:57.257929] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-09-15T17:13:57.553257] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-15T17:13:58.057857] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-09-15T17:13:58.460198] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T17:13:58.857847] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-09-15T17:13:59.657876] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-09-15T17:13:59.839309] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-15T17:14:00.079452] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T17:14:00.457877] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-09-15T17:14:00.478396] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-15T17:14:01.257880] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-09-15T17:14:01.504276] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-15T17:14:02.057921] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-09-15T17:14:02.060820] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-15T17:14:02.857890] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-09-15T17:14:03.657913] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-09-15T17:14:03.893382] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-15T17:14:03.985054] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-15T17:14:03.990999] [INFO ] [REMOTE ] AR: Full fetch complete (58261 records). [2025-09-15T17:14:03.991104] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-09-15T17:14:04.368512] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-09-15T17:14:04.368599] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-09-15T17:14:04.369210] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-09-15T17:14:04.369284] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-09-15T17:14:04.370615] [DEBUG] [LOCAL ] AR: Trimmed 58261 records to 39562 (keeping 150 days of data) [2025-09-15T17:14:04.463753] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-09-15T17:14:04.624458] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-15T17:14:04.630543] [DEBUG] [LOCAL ] AR: Primary data saved (39562 records). [2025-09-15T17:14:04.632981] [INFO ] [MAIN ] AR: Full history saved. [2025-09-15T17:14:04.633995] [INFO ] [MAIN ] Update Progress: 138/2369 symbols completed. AR took 37.8s. Estimated remaining: 3h 46m 41s. Rate: 9.8 symbols/min [2025-09-15T17:14:04.634421] [INFO ] [REMOTE ] ARDC: Full fetch complete (16039 records). [2025-09-15T17:14:04.646343] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-09-15T17:14:04.951114] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:14:05.195045] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-09-15T17:14:05.195152] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-09-15T17:14:05.195460] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-09-15T17:14:05.195499] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-09-15T17:14:05.196038] [DEBUG] [LOCAL ] ARDC: Trimmed 16039 records to 10313 (keeping 150 days of data) [2025-09-15T17:14:05.258145] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-09-15T17:14:05.258026] [DEBUG] [LOCAL ] ARE: Loaded 38314 existing records from primary storage. [2025-09-15T17:14:05.259197] [INFO ] [MAIN ] ARE: Loaded 38314 existing records. [2025-09-15T17:14:05.448254] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:14:05.449324] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-09-15T17:14:05.450291] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-09-15T17:14:05.453655] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-09-15T17:14:05.455012] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-09-15T17:14:05.563967] [DEBUG] [LOCAL ] ARDC: Primary data saved (10313 records). [2025-09-15T17:14:05.575030] [INFO ] [MAIN ] ARDC: Full history saved. [2025-09-15T17:14:05.592358] [INFO ] [MAIN ] Update Progress: 139/2369 symbols completed. ARDC took 19.9s. Estimated remaining: 3h 45m 12s. Rate: 9.9 symbols/min [2025-09-15T17:14:06.004376] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:14:06.027945] [INFO ] [REMOTE ] ARE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:14:06.030374] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T17:14:06.058409] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-09-15T17:14:06.076115] [DEBUG] [LOCAL ] ARES: Loaded 36960 existing records from primary storage. [2025-09-15T17:14:06.076266] [INFO ] [MAIN ] ARES: Loaded 36960 existing records. [2025-09-15T17:14:06.255611] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:14:06.255916] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-09-15T17:14:06.255963] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-09-15T17:14:06.257572] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-09-15T17:14:06.257626] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-09-15T17:14:06.614454] [INFO ] [REMOTE ] ARES: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:14:06.641040] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-15T17:14:06.857883] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-09-15T17:14:07.401239] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-15T17:14:07.657871] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-09-15T17:14:08.457854] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-09-15T17:14:08.543539] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T17:14:08.758485] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-15T17:14:08.762400] [INFO ] [REMOTE ] ARDT: Full fetch complete (31384 records). [2025-09-15T17:14:08.762629] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-09-15T17:14:09.157167] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-09-15T17:14:09.157304] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-09-15T17:14:09.157899] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-09-15T17:14:09.158039] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-09-15T17:14:09.159384] [DEBUG] [LOCAL ] ARDT: Trimmed 31384 records to 19778 (keeping 150 days of data) [2025-09-15T17:14:09.260541] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-09-15T17:14:09.289265] [DEBUG] [LOCAL ] ARDT: Primary data saved (19778 records). [2025-09-15T17:14:09.289564] [INFO ] [MAIN ] ARDT: Full history saved. [2025-09-15T17:14:09.289685] [INFO ] [MAIN ] Update Progress: 140/2369 symbols completed. ARDT took 22.1s. Estimated remaining: 3h 44m 29s. Rate: 9.9 symbols/min [2025-09-15T17:14:09.461365] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:14:09.496394] [DEBUG] [LOCAL ] ARI: Loaded 32487 existing records from primary storage. [2025-09-15T17:14:09.496575] [INFO ] [MAIN ] ARI: Loaded 32487 existing records. [2025-09-15T17:14:09.681602] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:14:09.681899] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-09-15T17:14:09.681947] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-09-15T17:14:09.683108] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-09-15T17:14:09.683161] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-09-15T17:14:10.040720] [INFO ] [REMOTE ] ARI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:14:10.067530] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-09-15T17:14:10.073686] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T17:14:10.857936] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-09-15T17:14:11.093159] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-15T17:14:11.380001] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-15T17:14:11.657858] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-09-15T17:14:12.093939] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-15T17:14:12.101945] [INFO ] [REMOTE ] ARCO: Full fetch complete (48559 records). [2025-09-15T17:14:12.102062] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-09-15T17:14:12.463118] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-09-15T17:14:12.521256] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-09-15T17:14:12.521378] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-09-15T17:14:12.522054] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-09-15T17:14:12.522114] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-09-15T17:14:12.523635] [DEBUG] [LOCAL ] ARCO: Trimmed 48559 records to 32872 (keeping 150 days of data) [2025-09-15T17:14:12.745820] [DEBUG] [LOCAL ] ARCO: Primary data saved (32872 records). [2025-09-15T17:14:12.745995] [INFO ] [MAIN ] ARCO: Full history saved. [2025-09-15T17:14:12.746095] [INFO ] [MAIN ] Update Progress: 141/2369 symbols completed. ARCO took 29.4s. Estimated remaining: 3h 43m 42s. Rate: 10.0 symbols/min [2025-09-15T17:14:13.022964] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:14:13.064234] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-15T17:14:13.121024] [DEBUG] [LOCAL ] ARIS: Loaded 31143 existing records from primary storage. [2025-09-15T17:14:13.121235] [INFO ] [MAIN ] ARIS: Loaded 31143 existing records. [2025-09-15T17:14:13.266681] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-09-15T17:14:13.404849] [WARN ] [MAIN ] ARIS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:14:13.405299] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-09-15T17:14:13.405353] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-09-15T17:14:13.407066] [DEBUG] [LOCAL ] ARIS: Deleted primary data file. [2025-09-15T17:14:13.407149] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-09-15T17:14:13.843662] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:14:14.057887] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-09-15T17:14:14.138923] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T17:14:14.857960] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-09-15T17:14:14.890432] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-15T17:14:15.251283] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T17:14:15.657904] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-09-15T17:14:16.457906] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-09-15T17:14:16.612815] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-15T17:14:17.257883] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-09-15T17:14:17.426947] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T17:14:17.600225] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-15T17:14:18.057891] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-09-15T17:14:18.857921] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-09-15T17:14:19.098589] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-15T17:14:19.379106] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T17:14:19.657887] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-09-15T17:14:20.329338] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T17:14:20.457859] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-09-15T17:14:21.070352] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T17:14:21.257869] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-09-15T17:14:22.028258] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T17:14:22.057834] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-09-15T17:14:22.783534] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-15T17:14:22.857877] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-09-15T17:14:23.230691] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-15T17:14:23.657941] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-09-15T17:14:23.903421] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-15T17:14:24.457875] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-09-15T17:14:25.150151] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-15T17:14:25.257891] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-09-15T17:14:25.947888] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T17:14:26.057884] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-09-15T17:14:26.729343] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T17:14:26.857895] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-09-15T17:14:27.378617] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T17:14:27.657903] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-09-15T17:14:28.340206] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T17:14:28.347027] [INFO ] [REMOTE ] ARI: Full fetch complete (46867 records). [2025-09-15T17:14:28.347132] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-09-15T17:14:28.462941] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-09-15T17:14:28.729390] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-09-15T17:14:28.729482] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-09-15T17:14:28.730025] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-09-15T17:14:28.730078] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-09-15T17:14:28.731193] [DEBUG] [LOCAL ] ARI: Trimmed 46867 records to 31741 (keeping 150 days of data) [2025-09-15T17:14:28.963986] [DEBUG] [LOCAL ] ARI: Primary data saved (31741 records). [2025-09-15T17:14:28.965543] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T17:14:28.965921] [INFO ] [MAIN ] ARI: Full history saved. [2025-09-15T17:14:28.966128] [INFO ] [MAIN ] Update Progress: 142/2369 symbols completed. ARI took 19.7s. Estimated remaining: 3h 46m 16s. Rate: 9.8 symbols/min [2025-09-15T17:14:29.162340] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:14:29.202733] [DEBUG] [LOCAL ] ARLO: Loaded 32823 existing records from primary storage. [2025-09-15T17:14:29.202960] [INFO ] [MAIN ] ARLO: Loaded 32823 existing records. [2025-09-15T17:14:29.267153] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-09-15T17:14:29.391159] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:14:29.391586] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-09-15T17:14:29.391663] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-09-15T17:14:29.393379] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-09-15T17:14:29.393435] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-09-15T17:14:29.765364] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:14:29.966896] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T17:14:29.972664] [INFO ] [REMOTE ] ARE: Full fetch complete (54854 records). [2025-09-15T17:14:29.972838] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-09-15T17:14:30.063133] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-09-15T17:14:30.370932] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-09-15T17:14:30.371037] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-09-15T17:14:30.371674] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-09-15T17:14:30.371721] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-09-15T17:14:30.373177] [DEBUG] [LOCAL ] ARE: Trimmed 54854 records to 37553 (keeping 150 days of data) [2025-09-15T17:14:30.606908] [DEBUG] [LOCAL ] ARE: Primary data saved (37553 records). [2025-09-15T17:14:30.607072] [INFO ] [MAIN ] ARE: Full history saved. [2025-09-15T17:14:30.607178] [INFO ] [MAIN ] Update Progress: 143/2369 symbols completed. ARE took 26.0s. Estimated remaining: 3h 45m 0s. Rate: 9.9 symbols/min [2025-09-15T17:14:30.789518] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:14:30.826870] [DEBUG] [LOCAL ] ARMK: Loaded 37720 existing records from primary storage. [2025-09-15T17:14:30.827017] [INFO ] [MAIN ] ARMK: Loaded 37720 existing records. [2025-09-15T17:14:30.869572] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-09-15T17:14:31.013678] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:14:31.014094] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-09-15T17:14:31.014148] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-09-15T17:14:31.015984] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-09-15T17:14:31.016122] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-09-15T17:14:31.152628] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-15T17:14:31.435939] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:14:31.459420] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T17:14:31.657895] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-09-15T17:14:32.443955] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T17:14:32.457827] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-09-15T17:14:32.896294] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-15T17:14:33.257882] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-09-15T17:14:33.737042] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T17:14:34.057869] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-09-15T17:14:34.865200] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-09-15T17:14:34.869903] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T17:14:35.110981] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-15T17:14:35.116838] [INFO ] [REMOTE ] ARIS: Full fetch complete (45524 records). [2025-09-15T17:14:35.116986] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-09-15T17:14:35.509458] [DEBUG] [VALIDATOR ] ARIS: All expected trading days are present. [2025-09-15T17:14:35.509566] [DEBUG] [VALIDATOR ] ARIS: Primary data validation passed. [2025-09-15T17:14:35.510306] [INFO ] [MAIN ] ARIS: Fetched primary data is valid. [2025-09-15T17:14:35.510353] [DEBUG] [LOCAL ] ARIS: Saving primary data. [2025-09-15T17:14:35.511887] [DEBUG] [LOCAL ] ARIS: Trimmed 45524 records to 30434 (keeping 150 days of data) [2025-09-15T17:14:35.668181] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-09-15T17:14:35.705225] [DEBUG] [LOCAL ] ARIS: Primary data saved (30434 records). [2025-09-15T17:14:35.705375] [INFO ] [MAIN ] ARIS: Full history saved. [2025-09-15T17:14:35.705499] [INFO ] [MAIN ] Update Progress: 144/2369 symbols completed. ARIS took 23.0s. Estimated remaining: 3h 44m 39s. Rate: 9.9 symbols/min [2025-09-15T17:14:35.876201] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:14:35.917170] [DEBUG] [LOCAL ] AROC: Loaded 36498 existing records from primary storage. [2025-09-15T17:14:35.917341] [INFO ] [MAIN ] AROC: Loaded 36498 existing records. [2025-09-15T17:14:36.095299] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:14:36.095587] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-09-15T17:14:36.095639] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-09-15T17:14:36.097100] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-09-15T17:14:36.097154] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-09-15T17:14:36.460814] [INFO ] [REMOTE ] AROC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:14:36.460962] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-09-15T17:14:36.515512] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T17:14:37.075505] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T17:14:37.081028] [INFO ] [REMOTE ] ARES: Full fetch complete (53938 records). [2025-09-15T17:14:37.081145] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-09-15T17:14:37.271234] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-09-15T17:14:37.473019] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-09-15T17:14:37.473123] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-09-15T17:14:37.473819] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-09-15T17:14:37.473873] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-09-15T17:14:37.475303] [DEBUG] [LOCAL ] ARES: Trimmed 53938 records to 36190 (keeping 150 days of data) [2025-09-15T17:14:37.723170] [DEBUG] [LOCAL ] ARES: Primary data saved (36190 records). [2025-09-15T17:14:37.723346] [INFO ] [MAIN ] ARES: Full history saved. [2025-09-15T17:14:37.723446] [INFO ] [MAIN ] Update Progress: 145/2369 symbols completed. ARES took 32.1s. Estimated remaining: 3h 43m 31s. Rate: 9.9 symbols/min [2025-09-15T17:14:37.923780] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:14:37.925484] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-15T17:14:37.973991] [DEBUG] [LOCAL ] ARR: Loaded 39076 existing records from primary storage. [2025-09-15T17:14:37.974162] [INFO ] [MAIN ] ARR: Loaded 39076 existing records. [2025-09-15T17:14:38.065711] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-09-15T17:14:38.162634] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:14:38.162993] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-09-15T17:14:38.163047] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-09-15T17:14:38.164889] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-09-15T17:14:38.164982] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-09-15T17:14:38.541804] [INFO ] [REMOTE ] ARR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:14:38.759834] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-15T17:14:38.857914] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-09-15T17:14:39.657893] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-09-15T17:14:39.829306] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-15T17:14:40.088303] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-15T17:14:40.457883] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-09-15T17:14:41.257849] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-09-15T17:14:41.576849] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-15T17:14:41.883836] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T17:14:42.057868] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-09-15T17:14:42.508676] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-15T17:14:42.857870] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-09-15T17:14:43.186973] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-15T17:14:43.657894] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-09-15T17:14:43.867609] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-15T17:14:44.457912] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-09-15T17:14:44.999961] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T17:14:45.257876] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-09-15T17:14:46.057953] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-09-15T17:14:46.095342] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-15T17:14:46.699607] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T17:14:46.857901] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-09-15T17:14:47.657884] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-09-15T17:14:47.740312] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T17:14:48.035560] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-15T17:14:48.457903] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-09-15T17:14:49.257878] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-09-15T17:14:49.440434] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-15T17:14:49.988066] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T17:14:49.993529] [INFO ] [REMOTE ] ARLO: Full fetch complete (47560 records). [2025-09-15T17:14:49.993806] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-09-15T17:14:50.063058] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-09-15T17:14:50.407500] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-09-15T17:14:50.407588] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-09-15T17:14:50.408152] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-09-15T17:14:50.408197] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-09-15T17:14:50.409477] [DEBUG] [LOCAL ] ARLO: Trimmed 47560 records to 32320 (keeping 150 days of data) [2025-09-15T17:14:50.611387] [DEBUG] [LOCAL ] ARLO: Primary data saved (32320 records). [2025-09-15T17:14:50.611533] [INFO ] [MAIN ] ARLO: Full history saved. [2025-09-15T17:14:50.611618] [INFO ] [MAIN ] Update Progress: 146/2369 symbols completed. ARLO took 21.6s. Estimated remaining: 3h 45m 10s. Rate: 9.9 symbols/min [2025-09-15T17:14:50.788756] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:14:50.813599] [DEBUG] [LOCAL ] ARW: Loaded 24276 existing records from primary storage. [2025-09-15T17:14:50.813762] [INFO ] [MAIN ] ARW: Loaded 24276 existing records. [2025-09-15T17:14:50.867612] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-09-15T17:14:51.020895] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-15T17:14:51.035469] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:14:51.036268] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-09-15T17:14:51.036322] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-09-15T17:14:51.037269] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-09-15T17:14:51.037328] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-09-15T17:14:51.393943] [INFO ] [REMOTE ] ARW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:14:51.657872] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-09-15T17:14:51.828175] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T17:14:52.457958] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-09-15T17:14:52.496328] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T17:14:53.012899] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-15T17:14:53.257870] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-09-15T17:14:54.057899] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-09-15T17:14:54.271175] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-15T17:14:54.770727] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-15T17:14:54.857949] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-09-15T17:14:55.534143] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T17:14:55.542190] [INFO ] [REMOTE ] AROC: Full fetch complete (53242 records). [2025-09-15T17:14:55.542374] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-09-15T17:14:55.662959] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-09-15T17:14:55.927738] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-09-15T17:14:55.927822] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-09-15T17:14:55.928373] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-09-15T17:14:55.928416] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-09-15T17:14:55.929956] [DEBUG] [LOCAL ] AROC: Trimmed 53242 records to 35804 (keeping 150 days of data) [2025-09-15T17:14:56.150075] [DEBUG] [LOCAL ] AROC: Primary data saved (35804 records). [2025-09-15T17:14:56.150221] [INFO ] [MAIN ] AROC: Full history saved. [2025-09-15T17:14:56.151229] [INFO ] [MAIN ] Update Progress: 147/2369 symbols completed. AROC took 20.4s. Estimated remaining: 3h 44m 55s. Rate: 9.9 symbols/min [2025-09-15T17:14:56.326079] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:14:56.326370] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-09-15T17:14:56.326445] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-09-15T17:14:56.326689] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-09-15T17:14:56.326796] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-15T17:14:56.326853] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-15T17:14:56.326899] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-09-15T17:14:56.460797] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-09-15T17:14:56.726748] [INFO ] [REMOTE ] ARX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:14:56.728664] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-15T17:14:57.257963] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-09-15T17:14:57.516837] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-15T17:14:57.628091] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-15T17:14:58.057935] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-09-15T17:14:58.855823] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-15T17:14:58.865401] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-02. [2025-09-15T17:14:59.077581] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:14:59.077924] [WARN ] [REMOTE ] ARX: No data returned for month 2025-02 [2025-09-15T17:14:59.657902] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-09-15T17:14:59.972213] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-15T17:15:00.457897] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-09-15T17:15:01.257879] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-09-15T17:15:01.377182] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-15T17:15:01.382958] [INFO ] [REMOTE ] ARMK: Full fetch complete (54672 records). [2025-09-15T17:15:01.383120] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-09-15T17:15:01.840814] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-09-15T17:15:01.840917] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-09-15T17:15:01.841548] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-09-15T17:15:01.841605] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-09-15T17:15:01.843157] [DEBUG] [LOCAL ] ARMK: Trimmed 54672 records to 37030 (keeping 150 days of data) [2025-09-15T17:15:02.060221] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-03. [2025-09-15T17:15:02.090869] [DEBUG] [LOCAL ] ARMK: Primary data saved (37030 records). [2025-09-15T17:15:02.091039] [INFO ] [MAIN ] ARMK: Full history saved. [2025-09-15T17:15:02.091579] [INFO ] [MAIN ] Update Progress: 148/2369 symbols completed. ARMK took 31.5s. Estimated remaining: 3h 44m 47s. Rate: 9.9 symbols/min [2025-09-15T17:15:02.284793] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:15:02.328826] [DEBUG] [LOCAL ] AS: Loaded 39972 existing records from primary storage. [2025-09-15T17:15:02.329018] [INFO ] [MAIN ] AS: Loaded 39972 existing records. [2025-09-15T17:15:02.519742] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:15:02.520602] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-09-15T17:15:02.554171] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-09-15T17:15:02.556595] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-15T17:15:02.556670] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-09-15T17:15:02.568472] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-09-15T17:15:02.862973] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-09-15T17:15:02.977430] [INFO ] [REMOTE ] AS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:15:03.657919] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-09-15T17:15:03.805451] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:15:03.805698] [WARN ] [REMOTE ] ARX: No data returned for month 2025-03 [2025-09-15T17:15:04.457878] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-04. [2025-09-15T17:15:04.529415] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (3.27 seconds). [2025-09-15T17:15:04.779100] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:15:04.779406] [WARN ] [REMOTE ] ARX: No data returned for month 2025-04 [2025-09-15T17:15:04.995055] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-15T17:15:05.257895] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-09-15T17:15:05.694581] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-15T17:15:06.057938] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-09-15T17:15:06.857912] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-05. [2025-09-15T17:15:06.945862] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-15T17:15:06.952043] [INFO ] [REMOTE ] ARR: Full fetch complete (56608 records). [2025-09-15T17:15:06.952199] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-09-15T17:15:07.082098] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:15:07.118123] [WARN ] [REMOTE ] ARX: No data returned for month 2025-05 [2025-09-15T17:15:07.360406] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-09-15T17:15:07.360505] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-09-15T17:15:07.361117] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-09-15T17:15:07.361172] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-09-15T17:15:07.362660] [DEBUG] [LOCAL ] ARR: Trimmed 56608 records to 38305 (keeping 150 days of data) [2025-09-15T17:15:07.613875] [DEBUG] [LOCAL ] ARR: Primary data saved (38305 records). [2025-09-15T17:15:07.614039] [INFO ] [MAIN ] ARR: Full history saved. [2025-09-15T17:15:07.614811] [INFO ] [MAIN ] Update Progress: 149/2369 symbols completed. ARR took 29.9s. Estimated remaining: 3h 44m 33s. Rate: 9.9 symbols/min [2025-09-15T17:15:07.667724] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-09-15T17:15:07.817024] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:15:07.855602] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-15T17:15:07.872227] [DEBUG] [LOCAL ] ASA: Loaded 10448 existing records from primary storage. [2025-09-15T17:15:07.872386] [INFO ] [MAIN ] ASA: Loaded 10448 existing records. [2025-09-15T17:15:08.053417] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:15:08.053728] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-09-15T17:15:08.053779] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-09-15T17:15:08.054205] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-09-15T17:15:08.054260] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-09-15T17:15:08.425461] [INFO ] [REMOTE ] ASA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:15:08.457883] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-09-15T17:15:09.003598] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-15T17:15:09.257942] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-09-15T17:15:09.918827] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-15T17:15:10.057940] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-09-15T17:15:10.242086] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-15T17:15:10.803493] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-15T17:15:10.857886] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-09-15T17:15:11.657876] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-06. [2025-09-15T17:15:12.106113] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:15:12.106457] [WARN ] [REMOTE ] ARX: No data returned for month 2025-06 [2025-09-15T17:15:12.457881] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-09-15T17:15:13.257932] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-09-15T17:15:13.571665] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-09-15T17:15:13.895412] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-15T17:15:14.028963] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-15T17:15:14.057847] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-09-15T17:15:14.857906] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-09-15T17:15:14.942566] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-15T17:15:14.946899] [INFO ] [REMOTE ] ARW: Full fetch complete (36058 records). [2025-09-15T17:15:14.947019] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-09-15T17:15:15.314871] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-09-15T17:15:15.314958] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-09-15T17:15:15.315358] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-09-15T17:15:15.315410] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-09-15T17:15:15.316940] [DEBUG] [LOCAL ] ARW: Trimmed 36058 records to 23693 (keeping 150 days of data) [2025-09-15T17:15:15.462193] [DEBUG] [LOCAL ] ARW: Primary data saved (23693 records). [2025-09-15T17:15:15.462323] [INFO ] [MAIN ] ARW: Full history saved. [2025-09-15T17:15:15.462439] [INFO ] [MAIN ] Update Progress: 150/2369 symbols completed. ARW took 24.9s. Estimated remaining: 3h 44m 53s. Rate: 9.9 symbols/min [2025-09-15T17:15:15.633762] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:15:15.659473] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-09-15T17:15:15.678138] [DEBUG] [LOCAL ] ASAN: Loaded 39578 existing records from primary storage. [2025-09-15T17:15:15.678276] [INFO ] [MAIN ] ASAN: Loaded 39578 existing records. [2025-09-15T17:15:15.857003] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:15:15.857274] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-09-15T17:15:15.857323] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-09-15T17:15:15.858933] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-09-15T17:15:15.858989] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-09-15T17:15:16.206095] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:15:16.262696] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-15T17:15:16.343198] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-15T17:15:16.457811] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-09-15T17:15:17.257911] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-07. [2025-09-15T17:15:17.712550] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-15T17:15:18.057969] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-09-15T17:15:18.198047] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T17:15:18.817786] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-15T17:15:18.857866] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-09-15T17:15:19.576984] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-15T17:15:19.657878] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-09-15T17:15:20.437092] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-15T17:15:20.457845] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-09-15T17:15:21.257913] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-09-15T17:15:22.057868] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-08. [2025-09-15T17:15:22.226529] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-15T17:15:22.857867] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-09-15T17:15:23.011973] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-15T17:15:23.657915] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-09-15T17:15:23.958844] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-15T17:15:24.457889] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-09. [2025-09-15T17:15:25.077770] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-15T17:15:25.083931] [INFO ] [REMOTE ] AS: Full fetch complete (57679 records). [2025-09-15T17:15:25.084114] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-09-15T17:15:25.269937] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-09-15T17:15:25.498203] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-09-15T17:15:25.498356] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-09-15T17:15:25.499183] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-09-15T17:15:25.499438] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-09-15T17:15:25.513038] [DEBUG] [LOCAL ] AS: Trimmed 57679 records to 39205 (keeping 150 days of data) [2025-09-15T17:15:25.514734] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T17:15:25.520241] [INFO ] [REMOTE ] ARX: Full fetch complete (11666 records). [2025-09-15T17:15:25.520356] [DEBUG] [VALIDATOR ] ARX: Validating primary data. [2025-09-15T17:15:25.804218] [WARN ] [VALIDATOR ] ARX: Validation failed - insufficient historical data. Have 37 unique days, need 150 days [2025-09-15T17:15:25.805599] [FATAL] [MAIN ] ARX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:15:25.806267] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:15:25.807030] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-15T17:15:25.807944] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-15T17:15:25.808313] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-09-15T17:15:25.808909] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-09-15T17:15:25.809581] [INFO ] [MAIN ] Update Progress: 151/2369 symbols completed. ARX took 29.7s. Estimated remaining: 3h 45m 50s. Rate: 9.8 symbols/min [2025-09-15T17:15:25.913161] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-15T17:15:26.052237] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:15:26.058105] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-09-15T17:15:26.192986] [DEBUG] [LOCAL ] ASB: Loaded 36945 existing records from primary storage. [2025-09-15T17:15:26.194586] [INFO ] [MAIN ] ASB: Loaded 36945 existing records. [2025-09-15T17:15:26.389738] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:15:26.391679] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-09-15T17:15:26.392155] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-09-15T17:15:26.410824] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-15T17:15:26.411291] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-09-15T17:15:26.415248] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-09-15T17:15:26.689527] [DEBUG] [LOCAL ] AS: Primary data saved (39205 records). [2025-09-15T17:15:26.706211] [INFO ] [MAIN ] AS: Full history saved. [2025-09-15T17:15:26.725207] [INFO ] [MAIN ] Update Progress: 152/2369 symbols completed. AS took 24.6s. Estimated remaining: 3h 44m 28s. Rate: 9.9 symbols/min [2025-09-15T17:15:26.876394] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-09-15T17:15:26.905757] [INFO ] [REMOTE ] ASB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:15:26.977831] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:15:26.989171] [DEBUG] [LOCAL ] ASBA: Loaded 2556 existing records from primary storage. [2025-09-15T17:15:26.989289] [INFO ] [MAIN ] ASBA: Loaded 2556 existing records. [2025-09-15T17:15:27.168778] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:15:27.169059] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-09-15T17:15:27.169106] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-09-15T17:15:27.169332] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-09-15T17:15:27.169377] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-09-15T17:15:27.534227] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:15:27.591427] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-15T17:15:27.630037] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-15T17:15:27.633152] [INFO ] [REMOTE ] ASA: Full fetch complete (14281 records). [2025-09-15T17:15:27.633237] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-09-15T17:15:27.663161] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-09-15T17:15:28.004990] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-09-15T17:15:28.005076] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-09-15T17:15:28.005428] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-09-15T17:15:28.005468] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-09-15T17:15:28.006038] [DEBUG] [LOCAL ] ASA: Trimmed 14281 records to 10287 (keeping 150 days of data) [2025-09-15T17:15:28.074054] [DEBUG] [LOCAL ] ASA: Primary data saved (10287 records). [2025-09-15T17:15:28.074213] [INFO ] [MAIN ] ASA: Full history saved. [2025-09-15T17:15:28.074306] [INFO ] [MAIN ] Update Progress: 153/2369 symbols completed. ASA took 20.5s. Estimated remaining: 3h 43m 14s. Rate: 9.9 symbols/min [2025-09-15T17:15:28.246628] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:15:28.278794] [DEBUG] [LOCAL ] ASC: Loaded 28033 existing records from primary storage. [2025-09-15T17:15:28.278950] [INFO ] [MAIN ] ASC: Loaded 28033 existing records. [2025-09-15T17:15:28.380844] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-15T17:15:28.465209] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-09-15T17:15:28.465559] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:15:28.466875] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-09-15T17:15:28.466942] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-09-15T17:15:28.468089] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-09-15T17:15:28.468139] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-09-15T17:15:28.818044] [INFO ] [REMOTE ] ASC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:15:28.897858] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-15T17:15:29.257916] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-09-15T17:15:29.791105] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-15T17:15:30.057913] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-09-15T17:15:30.857908] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-09-15T17:15:31.223855] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-15T17:15:31.657919] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-09-15T17:15:32.378791] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T17:15:32.457832] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-09-15T17:15:33.017022] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T17:15:33.257872] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-09-15T17:15:34.057846] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-09-15T17:15:34.299407] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-15T17:15:34.383368] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-15T17:15:34.857884] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-09-15T17:15:35.657878] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-09-15T17:15:35.816171] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-15T17:15:36.082548] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-15T17:15:36.428909] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T17:15:36.457828] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-09-15T17:15:37.257906] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-09-15T17:15:38.040967] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T17:15:38.057852] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-09-15T17:15:38.475426] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T17:15:38.857898] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-09-15T17:15:39.657881] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-09-15T17:15:39.699078] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T17:15:39.705230] [INFO ] [REMOTE ] ASAN: Full fetch complete (57366 records). [2025-09-15T17:15:39.705374] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-09-15T17:15:40.105497] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-09-15T17:15:40.105582] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-09-15T17:15:40.106250] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-09-15T17:15:40.106313] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-09-15T17:15:40.107593] [DEBUG] [LOCAL ] ASAN: Trimmed 57366 records to 38828 (keeping 150 days of data) [2025-09-15T17:15:40.358785] [DEBUG] [LOCAL ] ASAN: Primary data saved (38828 records). [2025-09-15T17:15:40.358940] [INFO ] [MAIN ] ASAN: Full history saved. [2025-09-15T17:15:40.359038] [INFO ] [MAIN ] Update Progress: 154/2369 symbols completed. ASAN took 24.9s. Estimated remaining: 3h 44m 37s. Rate: 9.9 symbols/min [2025-09-15T17:15:40.464263] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-09-15T17:15:40.572664] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-15T17:15:40.575023] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:15:40.603266] [DEBUG] [LOCAL ] ASG: Loaded 14539 existing records from primary storage. [2025-09-15T17:15:40.603416] [INFO ] [MAIN ] ASG: Loaded 14539 existing records. [2025-09-15T17:15:40.787834] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:15:40.788096] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-09-15T17:15:40.788146] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-09-15T17:15:40.788678] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-09-15T17:15:40.788751] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-09-15T17:15:41.086119] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-15T17:15:41.168419] [INFO ] [REMOTE ] ASG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:15:41.194773] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-15T17:15:41.257863] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-09-15T17:15:42.057901] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-09-15T17:15:42.608272] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-15T17:15:42.656763] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-15T17:15:42.857877] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-09-15T17:15:43.657878] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-09-15T17:15:44.428306] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T17:15:44.457832] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-09-15T17:15:44.750993] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-15T17:15:45.257893] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-09-15T17:15:46.057944] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-09-15T17:15:46.143529] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T17:15:46.444185] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-15T17:15:46.565750] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-15T17:15:46.857906] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-09-15T17:15:47.657889] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-09-15T17:15:48.464294] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-09-15T17:15:48.467444] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-15T17:15:48.471576] [INFO ] [REMOTE ] ASC: Full fetch complete (42045 records). [2025-09-15T17:15:48.471681] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-09-15T17:15:48.864661] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-09-15T17:15:48.865233] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-09-15T17:15:48.865769] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-09-15T17:15:48.866217] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T17:15:48.866314] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-09-15T17:15:48.871824] [DEBUG] [LOCAL ] ASC: Trimmed 42045 records to 27506 (keeping 150 days of data) [2025-09-15T17:15:49.040053] [DEBUG] [LOCAL ] ASC: Primary data saved (27506 records). [2025-09-15T17:15:49.040174] [INFO ] [MAIN ] ASC: Full history saved. [2025-09-15T17:15:49.040255] [INFO ] [MAIN ] Update Progress: 155/2369 symbols completed. ASC took 21.0s. Estimated remaining: 3h 45m 8s. Rate: 9.8 symbols/min [2025-09-15T17:15:49.211135] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:15:49.213502] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-15T17:15:49.214673] [INFO ] [REMOTE ] ASBA: Full fetch complete (3752 records). [2025-09-15T17:15:49.214741] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-09-15T17:15:49.263189] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-09-15T17:15:49.422368] [DEBUG] [LOCAL ] ASGI: Loaded 16822 existing records from primary storage. [2025-09-15T17:15:49.476937] [INFO ] [MAIN ] ASGI: Loaded 16822 existing records. [2025-09-15T17:15:49.790741] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:15:49.790930] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-09-15T17:15:49.791084] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-09-15T17:15:49.791166] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-09-15T17:15:49.791316] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-09-15T17:15:49.791366] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-09-15T17:15:49.791418] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-09-15T17:15:49.791917] [DEBUG] [LOCAL ] ASBA: Trimmed 3752 records to 2512 (keeping 150 days of data) [2025-09-15T17:15:49.799094] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-09-15T17:15:49.800438] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-09-15T17:15:49.920969] [DEBUG] [LOCAL ] ASBA: Primary data saved (2512 records). [2025-09-15T17:15:49.931313] [INFO ] [MAIN ] ASBA: Full history saved. [2025-09-15T17:15:49.959856] [INFO ] [MAIN ] Update Progress: 156/2369 symbols completed. ASBA took 23.2s. Estimated remaining: 3h 43m 49s. Rate: 9.9 symbols/min [2025-09-15T17:15:50.072120] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-09-15T17:15:50.283635] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:15:50.338735] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:15:50.366719] [DEBUG] [LOCAL ] ASGN: Loaded 26592 existing records from primary storage. [2025-09-15T17:15:50.366884] [INFO ] [MAIN ] ASGN: Loaded 26592 existing records. [2025-09-15T17:15:50.543664] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:15:50.543909] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-09-15T17:15:50.543956] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-09-15T17:15:50.545239] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-09-15T17:15:50.545299] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-09-15T17:15:50.876789] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-09-15T17:15:50.909725] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:15:50.967237] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T17:15:51.002602] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-15T17:15:51.657913] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-09-15T17:15:52.056492] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-15T17:15:52.457931] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-09-15T17:15:53.112251] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-15T17:15:53.257880] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-09-15T17:15:54.057873] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-09-15T17:15:54.117761] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-15T17:15:54.787468] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T17:15:54.793356] [INFO ] [REMOTE ] ASB: Full fetch complete (53972 records). [2025-09-15T17:15:54.793479] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-09-15T17:15:54.862986] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-09-15T17:15:55.198490] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-09-15T17:15:55.199089] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-09-15T17:15:55.199504] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-15T17:15:55.200172] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-09-15T17:15:55.204334] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-09-15T17:15:55.206017] [DEBUG] [LOCAL ] ASB: Trimmed 53972 records to 36181 (keeping 150 days of data) [2025-09-15T17:15:55.434611] [DEBUG] [LOCAL ] ASB: Primary data saved (36181 records). [2025-09-15T17:15:55.434783] [INFO ] [MAIN ] ASB: Full history saved. [2025-09-15T17:15:55.437067] [INFO ] [MAIN ] Update Progress: 157/2369 symbols completed. ASB took 29.6s. Estimated remaining: 3h 43m 34s. Rate: 9.9 symbols/min [2025-09-15T17:15:55.657887] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-09-15T17:15:56.095107] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-15T17:15:56.390923] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-15T17:15:56.457890] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-09-15T17:15:57.257878] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-09-15T17:15:57.762572] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T17:15:58.057892] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-09-15T17:15:58.350495] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-15T17:15:58.857951] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-09-15T17:15:59.328362] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-15T17:15:59.505308] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-15T17:15:59.657981] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-09-15T17:16:00.457968] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-09-15T17:16:00.894598] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T17:16:01.257873] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-09-15T17:16:01.536754] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-15T17:16:01.947352] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-15T17:16:02.057917] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-09-15T17:16:02.857912] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-09-15T17:16:03.221257] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-15T17:16:03.581558] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-15T17:16:03.657868] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-09-15T17:16:04.336420] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T17:16:04.457874] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-09-15T17:16:05.257882] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-09-15T17:16:06.057855] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-09-15T17:16:06.273165] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T17:16:06.387414] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-15T17:16:06.863396] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-09-15T17:16:06.865478] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T17:16:06.868828] [INFO ] [REMOTE ] ASG: Full fetch complete (23113 records). [2025-09-15T17:16:06.869016] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-09-15T17:16:07.254407] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-09-15T17:16:07.254527] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-09-15T17:16:07.254940] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-09-15T17:16:07.254987] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-09-15T17:16:07.255664] [DEBUG] [LOCAL ] ASG: Trimmed 23113 records to 14252 (keeping 150 days of data) [2025-09-15T17:16:07.337756] [DEBUG] [LOCAL ] ASG: Primary data saved (14252 records). [2025-09-15T17:16:07.337903] [INFO ] [MAIN ] ASG: Full history saved. [2025-09-15T17:16:07.338011] [INFO ] [MAIN ] Update Progress: 158/2369 symbols completed. ASG took 27.0s. Estimated remaining: 3h 44m 50s. Rate: 9.8 symbols/min [2025-09-15T17:16:07.657886] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-09-15T17:16:08.113818] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-15T17:16:08.118130] [INFO ] [REMOTE ] ASGN: Full fetch complete (39745 records). [2025-09-15T17:16:08.118289] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-09-15T17:16:08.530678] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-09-15T17:16:08.530794] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-09-15T17:16:08.531292] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-09-15T17:16:08.531345] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-09-15T17:16:08.532526] [DEBUG] [LOCAL ] ASGN: Trimmed 39745 records to 26147 (keeping 150 days of data) [2025-09-15T17:16:08.692753] [DEBUG] [LOCAL ] ASGN: Primary data saved (26147 records). [2025-09-15T17:16:08.692923] [INFO ] [MAIN ] ASGN: Full history saved. [2025-09-15T17:16:08.693027] [INFO ] [MAIN ] Update Progress: 159/2369 symbols completed. ASGN took 18.7s. Estimated remaining: 3h 43m 38s. Rate: 9.9 symbols/min [2025-09-15T17:16:08.770952] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-15T17:16:08.777932] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-09-15T17:16:09.472362] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-15T17:16:09.477927] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-09-15T17:16:10.288942] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T17:16:10.291857] [INFO ] [REMOTE ] ASGI: Full fetch complete (23807 records). [2025-09-15T17:16:10.291962] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-09-15T17:16:10.292555] [FATAL] [VALIDATOR ] ASGI: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:16:10.292672] [FATAL] [MAIN ] ASGI: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:16:10.292713] [WARN ] [MAIN ] ASGI: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:16:10.292751] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-09-15T17:16:10.292811] [DEBUG] [LOCAL ] ASGI: No primary data file found to delete. [2025-09-15T17:16:10.292875] [INFO ] [LOCAL ] ASGI: Starting deletion of derivative data. [2025-09-15T17:16:10.293256] [DEBUG] [LOCAL ] ASGI: Deleted derivative data file. [2025-09-15T17:16:10.293349] [INFO ] [MAIN ] Update Progress: 160/2369 symbols completed. ASGI took 21.3s. Estimated remaining: 3h 42m 30s. Rate: 9.9 symbols/min [2025-09-15T17:16:10.900733] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:16:10.940427] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:16:11.022483] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:16:11.063290] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:16:11.072383] [DEBUG] [LOCAL ] ASR: Loaded 7112 existing records from primary storage. [2025-09-15T17:16:11.072684] [INFO ] [MAIN ] ASR: Loaded 7112 existing records. [2025-09-15T17:16:11.154041] [DEBUG] [LOCAL ] ASIX: Loaded 17222 existing records from primary storage. [2025-09-15T17:16:11.194994] [INFO ] [MAIN ] ASIX: Loaded 17222 existing records. [2025-09-15T17:16:11.388101] [DEBUG] [LOCAL ] ASH: Loaded 27620 existing records from primary storage. [2025-09-15T17:16:11.407672] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:16:11.413680] [INFO ] [MAIN ] ASH: Loaded 27620 existing records. [2025-09-15T17:16:11.522212] [DEBUG] [LOCAL ] ASPN: Loaded 37369 existing records from primary storage. [2025-09-15T17:16:11.567090] [INFO ] [MAIN ] ASPN: Loaded 37369 existing records. [2025-09-15T17:16:11.567006] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-09-15T17:16:11.581090] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-09-15T17:16:11.580978] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:16:11.646428] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-09-15T17:16:11.635609] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-09-15T17:16:11.701022] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-09-15T17:16:11.701161] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-09-15T17:16:11.800372] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-09-15T17:16:11.825123] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-09-15T17:16:11.815310] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:16:12.017720] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-09-15T17:16:12.101207] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-09-15T17:16:12.101113] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:16:12.101574] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-09-15T17:16:12.122456] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-09-15T17:16:12.189708] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-09-15T17:16:12.210326] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-09-15T17:16:12.246707] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-09-15T17:16:12.277760] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-09-15T17:16:13.018121] [INFO ] [REMOTE ] ASR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:16:13.007347] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:16:13.059137] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-09-15T17:16:13.096045] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-09-15T17:16:13.365059] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:16:13.376920] [INFO ] [REMOTE ] ASH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:16:13.377249] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-09-15T17:16:13.377474] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-09-15T17:16:14.163391] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-15T17:16:14.167153] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-09-15T17:16:14.533087] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T17:16:14.545042] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-09-15T17:16:15.012672] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-15T17:16:15.014782] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-09-15T17:16:15.218738] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-15T17:16:15.283323] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-15T17:16:15.657820] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-09-15T17:16:15.668059] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-15T17:16:15.891984] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T17:16:16.457834] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-09-15T17:16:16.847268] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-15T17:16:17.257944] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-09-15T17:16:17.900710] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-15T17:16:18.057785] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-09-15T17:16:18.083308] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-15T17:16:18.531471] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-15T17:16:18.857913] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-09-15T17:16:19.610287] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-15T17:16:19.657867] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-09-15T17:16:20.311808] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-15T17:16:20.457875] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-09-15T17:16:21.257853] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-09-15T17:16:21.278110] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-15T17:16:22.057971] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-09-15T17:16:22.298515] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-15T17:16:22.857912] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-09-15T17:16:23.657926] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-09-15T17:16:23.747269] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T17:16:23.982469] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-15T17:16:24.095853] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-15T17:16:24.457933] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-09-15T17:16:25.257878] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-09-15T17:16:25.765332] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-15T17:16:26.057932] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-09-15T17:16:26.857845] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-09-15T17:16:26.981825] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-15T17:16:26.983437] [INFO ] [REMOTE ] ASR: Full fetch complete (9548 records). [2025-09-15T17:16:26.983506] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-09-15T17:16:26.984001] [FATAL] [VALIDATOR ] ASR: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:16:26.984078] [FATAL] [MAIN ] ASR: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:16:26.984114] [WARN ] [MAIN ] ASR: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:16:26.984215] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-09-15T17:16:26.984293] [DEBUG] [LOCAL ] ASR: No primary data file found to delete. [2025-09-15T17:16:26.984336] [INFO ] [LOCAL ] ASR: Starting deletion of derivative data. [2025-09-15T17:16:26.984587] [DEBUG] [LOCAL ] ASR: Deleted derivative data file. [2025-09-15T17:16:26.984684] [INFO ] [MAIN ] Update Progress: 161/2369 symbols completed. ASR took 16.7s. Estimated remaining: 3h 44m 50s. Rate: 9.8 symbols/min [2025-09-15T17:16:27.162339] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:16:27.204137] [DEBUG] [LOCAL ] ASX: Loaded 39787 existing records from primary storage. [2025-09-15T17:16:27.204317] [INFO ] [MAIN ] ASX: Loaded 39787 existing records. [2025-09-15T17:16:27.396075] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:16:27.396665] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-09-15T17:16:27.396773] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-09-15T17:16:27.443261] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-09-15T17:16:27.463017] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-09-15T17:16:27.542746] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-15T17:16:27.660847] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-09-15T17:16:27.893486] [INFO ] [REMOTE ] ASX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:16:28.002912] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-15T17:16:28.457924] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-09-15T17:16:28.867811] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T17:16:29.257926] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-09-15T17:16:30.057887] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-09-15T17:16:30.308403] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-15T17:16:30.701358] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T17:16:30.857906] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-09-15T17:16:31.207951] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T17:16:31.211149] [INFO ] [REMOTE ] ASIX: Full fetch complete (23842 records). [2025-09-15T17:16:31.211250] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-09-15T17:16:31.588572] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-09-15T17:16:31.588691] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-09-15T17:16:31.589059] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-09-15T17:16:31.589105] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-09-15T17:16:31.590048] [DEBUG] [LOCAL ] ASIX: Trimmed 23842 records to 16877 (keeping 150 days of data) [2025-09-15T17:16:31.681066] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-09-15T17:16:31.714839] [DEBUG] [LOCAL ] ASIX: Primary data saved (16877 records). [2025-09-15T17:16:31.715035] [INFO ] [MAIN ] ASIX: Full history saved. [2025-09-15T17:16:31.715153] [INFO ] [MAIN ] Update Progress: 162/2369 symbols completed. ASIX took 21.4s. Estimated remaining: 3h 44m 25s. Rate: 9.8 symbols/min [2025-09-15T17:16:31.901240] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:16:31.937007] [DEBUG] [LOCAL ] ATEN: Loaded 29040 existing records from primary storage. [2025-09-15T17:16:31.937176] [INFO ] [MAIN ] ATEN: Loaded 29040 existing records. [2025-09-15T17:16:32.132882] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:16:32.133167] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-09-15T17:16:32.133218] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-09-15T17:16:32.134691] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-09-15T17:16:32.134751] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-09-15T17:16:32.466308] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-09-15T17:16:32.508257] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:16:32.570360] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-15T17:16:33.002970] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T17:16:33.257889] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-09-15T17:16:34.057905] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-09-15T17:16:34.294095] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-15T17:16:34.367915] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-15T17:16:34.857954] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-09-15T17:16:35.156051] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-15T17:16:35.159804] [INFO ] [REMOTE ] ASH: Full fetch complete (41296 records). [2025-09-15T17:16:35.159918] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-09-15T17:16:35.160566] [FATAL] [VALIDATOR ] ASH: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:16:35.160669] [FATAL] [MAIN ] ASH: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:16:35.160708] [WARN ] [MAIN ] ASH: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:16:35.160746] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-09-15T17:16:35.160806] [DEBUG] [LOCAL ] ASH: No primary data file found to delete. [2025-09-15T17:16:35.160841] [INFO ] [LOCAL ] ASH: Starting deletion of derivative data. [2025-09-15T17:16:35.161084] [DEBUG] [LOCAL ] ASH: Deleted derivative data file. [2025-09-15T17:16:35.161188] [INFO ] [MAIN ] Update Progress: 163/2369 symbols completed. ASH took 24.9s. Estimated remaining: 3h 43m 43s. Rate: 9.9 symbols/min [2025-09-15T17:16:35.331925] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:16:35.357326] [DEBUG] [LOCAL ] ATGE: Loaded 23587 existing records from primary storage. [2025-09-15T17:16:35.357476] [INFO ] [MAIN ] ATGE: Loaded 23587 existing records. [2025-09-15T17:16:35.533317] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:16:35.533586] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-09-15T17:16:35.533632] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-09-15T17:16:35.534811] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-09-15T17:16:35.534882] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-09-15T17:16:35.663128] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-09-15T17:16:35.913199] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:16:36.457941] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-09-15T17:16:36.512593] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T17:16:36.899547] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-15T17:16:37.257865] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-09-15T17:16:38.057969] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-09-15T17:16:38.342480] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-15T17:16:38.456423] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-15T17:16:38.857870] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-09-15T17:16:39.517836] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-15T17:16:39.657876] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-09-15T17:16:40.457937] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-09-15T17:16:40.627993] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-15T17:16:41.123668] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T17:16:41.257902] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-09-15T17:16:41.714466] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-15T17:16:42.057875] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-09-15T17:16:42.315419] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-15T17:16:42.858006] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-09-15T17:16:43.418682] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-15T17:16:43.657869] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-09-15T17:16:44.457869] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-09-15T17:16:44.667738] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-15T17:16:45.155579] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T17:16:45.257862] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-09-15T17:16:45.798293] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-15T17:16:45.803355] [INFO ] [REMOTE ] ASPN: Full fetch complete (53977 records). [2025-09-15T17:16:45.803458] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-09-15T17:16:45.804222] [FATAL] [VALIDATOR ] ASPN: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:16:45.804308] [FATAL] [MAIN ] ASPN: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:16:45.804346] [WARN ] [MAIN ] ASPN: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:16:45.804384] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-09-15T17:16:45.804442] [DEBUG] [LOCAL ] ASPN: No primary data file found to delete. [2025-09-15T17:16:45.804479] [INFO ] [LOCAL ] ASPN: Starting deletion of derivative data. [2025-09-15T17:16:45.804731] [DEBUG] [LOCAL ] ASPN: Deleted derivative data file. [2025-09-15T17:16:45.805084] [INFO ] [MAIN ] Update Progress: 164/2369 symbols completed. ASPN took 35.5s. Estimated remaining: 3h 44m 38s. Rate: 9.8 symbols/min [2025-09-15T17:16:45.978464] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:16:46.003082] [DEBUG] [LOCAL ] ATHM: Loaded 23577 existing records from primary storage. [2025-09-15T17:16:46.003250] [INFO ] [MAIN ] ATHM: Loaded 23577 existing records. [2025-09-15T17:16:46.068280] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-09-15T17:16:46.189866] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:16:46.190167] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-09-15T17:16:46.190215] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-09-15T17:16:46.191496] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-09-15T17:16:46.191562] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-09-15T17:16:46.551019] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:16:46.676171] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-15T17:16:46.857875] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-09-15T17:16:47.233564] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-15T17:16:47.657879] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-09-15T17:16:48.248802] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-15T17:16:48.253144] [INFO ] [REMOTE ] ATEN: Full fetch complete (43694 records). [2025-09-15T17:16:48.253245] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-09-15T17:16:48.463819] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-09-15T17:16:48.653129] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-09-15T17:16:48.653259] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-09-15T17:16:48.654077] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-09-15T17:16:48.654154] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-09-15T17:16:48.655694] [DEBUG] [LOCAL ] ATEN: Trimmed 43694 records to 28427 (keeping 150 days of data) [2025-09-15T17:16:48.792049] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-15T17:16:48.878850] [DEBUG] [LOCAL ] ATEN: Primary data saved (28427 records). [2025-09-15T17:16:48.879026] [INFO ] [MAIN ] ATEN: Full history saved. [2025-09-15T17:16:48.879124] [INFO ] [MAIN ] Update Progress: 165/2369 symbols completed. ATEN took 17.2s. Estimated remaining: 3h 43m 52s. Rate: 9.8 symbols/min [2025-09-15T17:16:49.046717] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:16:49.053985] [DEBUG] [LOCAL ] ATHS: Loaded 5007 existing records from primary storage. [2025-09-15T17:16:49.054106] [INFO ] [MAIN ] ATHS: Loaded 5007 existing records. [2025-09-15T17:16:49.227710] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:16:49.227982] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-09-15T17:16:49.228028] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-09-15T17:16:49.228343] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-09-15T17:16:49.228395] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-09-15T17:16:49.263182] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-09-15T17:16:49.605047] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:16:50.057926] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-09-15T17:16:50.446354] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-15T17:16:50.485534] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-15T17:16:50.857895] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-09-15T17:16:51.577767] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T17:16:51.657887] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-09-15T17:16:52.457899] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-09-15T17:16:52.658159] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-15T17:16:52.794046] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-15T17:16:53.057399] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-15T17:16:53.257898] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-09-15T17:16:54.057882] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-09-15T17:16:54.857895] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-09-15T17:16:54.999383] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-15T17:16:55.049907] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-15T17:16:55.055713] [INFO ] [REMOTE ] ASX: Full fetch complete (57160 records). [2025-09-15T17:16:55.055837] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-09-15T17:16:55.056713] [FATAL] [VALIDATOR ] ASX: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:16:55.056815] [FATAL] [MAIN ] ASX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:16:55.056858] [WARN ] [MAIN ] ASX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:16:55.056907] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-09-15T17:16:55.056968] [DEBUG] [LOCAL ] ASX: No primary data file found to delete. [2025-09-15T17:16:55.057005] [INFO ] [LOCAL ] ASX: Starting deletion of derivative data. [2025-09-15T17:16:55.057287] [DEBUG] [LOCAL ] ASX: Deleted derivative data file. [2025-09-15T17:16:55.058763] [INFO ] [MAIN ] Update Progress: 166/2369 symbols completed. ASX took 28.1s. Estimated remaining: 3h 43m 47s. Rate: 9.8 symbols/min [2025-09-15T17:16:55.239938] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:16:55.285660] [DEBUG] [LOCAL ] ATI: Loaded 39009 existing records from primary storage. [2025-09-15T17:16:55.285837] [INFO ] [MAIN ] ATI: Loaded 39009 existing records. [2025-09-15T17:16:55.466319] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:16:55.466599] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-09-15T17:16:55.466668] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-09-15T17:16:55.468334] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-09-15T17:16:55.468400] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-09-15T17:16:55.666112] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-09-15T17:16:55.845137] [INFO ] [REMOTE ] ATI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:16:55.863827] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T17:16:56.457871] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-09-15T17:16:56.998993] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-15T17:16:57.257901] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-09-15T17:16:57.296013] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-15T17:16:58.057872] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-09-15T17:16:58.561382] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-15T17:16:58.605883] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T17:16:58.857883] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-09-15T17:16:59.657828] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-09-15T17:17:00.118533] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T17:17:00.457899] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-09-15T17:17:00.884616] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-15T17:17:01.257883] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-09-15T17:17:01.325601] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T17:17:02.057876] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-09-15T17:17:02.169634] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-15T17:17:02.172911] [INFO ] [REMOTE ] ATGE: Full fetch complete (35276 records). [2025-09-15T17:17:02.172998] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-09-15T17:17:02.558588] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-09-15T17:17:02.558766] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-09-15T17:17:02.559435] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-09-15T17:17:02.559507] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-09-15T17:17:02.560918] [DEBUG] [LOCAL ] ATGE: Trimmed 35276 records to 22888 (keeping 150 days of data) [2025-09-15T17:17:02.717143] [DEBUG] [LOCAL ] ATGE: Primary data saved (22888 records). [2025-09-15T17:17:02.717344] [INFO ] [MAIN ] ATGE: Full history saved. [2025-09-15T17:17:02.717453] [INFO ] [MAIN ] Update Progress: 167/2369 symbols completed. ATGE took 27.6s. Estimated remaining: 3h 44m 1s. Rate: 9.8 symbols/min [2025-09-15T17:17:02.863814] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-09-15T17:17:02.897530] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:17:02.928091] [DEBUG] [LOCAL ] ATKR: Loaded 25920 existing records from primary storage. [2025-09-15T17:17:02.928304] [INFO ] [MAIN ] ATKR: Loaded 25920 existing records. [2025-09-15T17:17:03.123172] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:17:03.123512] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-09-15T17:17:03.123565] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-09-15T17:17:03.125278] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-09-15T17:17:03.125341] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-09-15T17:17:03.494746] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:17:03.503947] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-15T17:17:03.663327] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-09-15T17:17:03.677486] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T17:17:04.457859] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-09-15T17:17:04.965445] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-15T17:17:05.085482] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-15T17:17:05.257869] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-09-15T17:17:05.955981] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T17:17:05.957247] [INFO ] [REMOTE ] ATHS: Full fetch complete (7679 records). [2025-09-15T17:17:05.957318] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-09-15T17:17:05.957729] [FATAL] [VALIDATOR ] ATHS: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:17:05.957810] [FATAL] [MAIN ] ATHS: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:17:05.957850] [WARN ] [MAIN ] ATHS: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:17:05.957909] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-09-15T17:17:05.957973] [DEBUG] [LOCAL ] ATHS: No primary data file found to delete. [2025-09-15T17:17:05.958011] [INFO ] [LOCAL ] ATHS: Starting deletion of derivative data. [2025-09-15T17:17:05.958251] [DEBUG] [LOCAL ] ATHS: Deleted derivative data file. [2025-09-15T17:17:05.958330] [INFO ] [MAIN ] Update Progress: 168/2369 symbols completed. ATHS took 17.1s. Estimated remaining: 3h 43m 18s. Rate: 9.9 symbols/min [2025-09-15T17:17:06.062691] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-09-15T17:17:06.134085] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:17:06.169309] [DEBUG] [LOCAL ] ATMU: Loaded 28868 existing records from primary storage. [2025-09-15T17:17:06.169480] [INFO ] [MAIN ] ATMU: Loaded 28868 existing records. [2025-09-15T17:17:06.345182] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:17:06.345448] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-09-15T17:17:06.345496] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-09-15T17:17:06.347080] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-09-15T17:17:06.347137] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-09-15T17:17:06.705354] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:17:06.857893] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-09-15T17:17:07.635086] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T17:17:07.657920] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-09-15T17:17:08.384173] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-15T17:17:08.457892] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-09-15T17:17:08.587510] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-15T17:17:09.257924] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-09-15T17:17:09.855258] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T17:17:10.057874] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-09-15T17:17:10.264124] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T17:17:10.857889] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-09-15T17:17:11.603448] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T17:17:11.657910] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-09-15T17:17:12.295446] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-15T17:17:12.457896] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-09-15T17:17:13.257836] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-09-15T17:17:13.474953] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-15T17:17:13.635962] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-15T17:17:14.057951] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-09-15T17:17:14.654939] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-15T17:17:14.857883] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-09-15T17:17:15.095558] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T17:17:15.098572] [INFO ] [REMOTE ] ATHM: Full fetch complete (37046 records). [2025-09-15T17:17:15.098687] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-09-15T17:17:15.470779] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-09-15T17:17:15.470862] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-09-15T17:17:15.471313] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-09-15T17:17:15.471356] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-09-15T17:17:15.472268] [DEBUG] [LOCAL ] ATHM: Trimmed 37046 records to 22614 (keeping 150 days of data) [2025-09-15T17:17:15.611475] [DEBUG] [LOCAL ] ATHM: Primary data saved (22614 records). [2025-09-15T17:17:15.611615] [INFO ] [MAIN ] ATHM: Full history saved. [2025-09-15T17:17:15.611749] [INFO ] [MAIN ] Update Progress: 169/2369 symbols completed. ATHM took 29.8s. Estimated remaining: 3h 43m 58s. Rate: 9.8 symbols/min [2025-09-15T17:17:15.663016] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-09-15T17:17:15.789638] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:17:15.832410] [DEBUG] [LOCAL ] ATO: Loaded 31430 existing records from primary storage. [2025-09-15T17:17:15.844113] [INFO ] [MAIN ] ATO: Loaded 31430 existing records. [2025-09-15T17:17:15.876856] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T17:17:16.029473] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:17:16.029753] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-09-15T17:17:16.029801] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-09-15T17:17:16.031306] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-09-15T17:17:16.031359] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-09-15T17:17:16.389880] [INFO ] [REMOTE ] ATO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:17:16.457874] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-09-15T17:17:17.100890] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-15T17:17:17.257869] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-09-15T17:17:18.057937] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-09-15T17:17:18.185681] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-15T17:17:18.716521] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T17:17:18.857870] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-09-15T17:17:19.564951] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T17:17:19.657849] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-09-15T17:17:20.457908] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-09-15T17:17:20.676179] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-15T17:17:20.948172] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T17:17:21.257923] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-09-15T17:17:21.740274] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-15T17:17:22.057930] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-09-15T17:17:22.857934] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-09-15T17:17:22.901816] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T17:17:23.028956] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-15T17:17:23.657895] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-09-15T17:17:23.829552] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-15T17:17:23.834247] [INFO ] [REMOTE ] ATMU: Full fetch complete (42993 records). [2025-09-15T17:17:23.834449] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-09-15T17:17:23.835153] [FATAL] [VALIDATOR ] ATMU: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:17:23.835242] [FATAL] [MAIN ] ATMU: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:17:23.835289] [WARN ] [MAIN ] ATMU: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:17:23.835338] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-09-15T17:17:23.835406] [DEBUG] [LOCAL ] ATMU: No primary data file found to delete. [2025-09-15T17:17:23.835459] [INFO ] [LOCAL ] ATMU: Starting deletion of derivative data. [2025-09-15T17:17:23.835706] [DEBUG] [LOCAL ] ATMU: Deleted derivative data file. [2025-09-15T17:17:23.835803] [INFO ] [MAIN ] Update Progress: 170/2369 symbols completed. ATMU took 17.9s. Estimated remaining: 3h 44m 19s. Rate: 9.8 symbols/min [2025-09-15T17:17:24.017961] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:17:24.050089] [DEBUG] [LOCAL ] ATR: Loaded 23237 existing records from primary storage. [2025-09-15T17:17:24.050236] [INFO ] [MAIN ] ATR: Loaded 23237 existing records. [2025-09-15T17:17:24.234176] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:17:24.234576] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-09-15T17:17:24.234633] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-09-15T17:17:24.235407] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-09-15T17:17:24.235457] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-09-15T17:17:24.463046] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-09-15T17:17:24.599272] [INFO ] [REMOTE ] ATR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:17:24.981764] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-15T17:17:25.257902] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-09-15T17:17:25.935892] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-15T17:17:26.057887] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-09-15T17:17:26.857929] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-09-15T17:17:26.889322] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T17:17:27.449128] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-15T17:17:27.455090] [INFO ] [REMOTE ] ATI: Full fetch complete (56286 records). [2025-09-15T17:17:27.455258] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-09-15T17:17:27.667843] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-09-15T17:17:27.840080] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-09-15T17:17:27.840158] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-09-15T17:17:27.840763] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-09-15T17:17:27.840819] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-09-15T17:17:27.842002] [DEBUG] [LOCAL ] ATI: Trimmed 56286 records to 38269 (keeping 150 days of data) [2025-09-15T17:17:27.981166] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-15T17:17:28.098155] [DEBUG] [LOCAL ] ATI: Primary data saved (38269 records). [2025-09-15T17:17:28.098296] [INFO ] [MAIN ] ATI: Full history saved. [2025-09-15T17:17:28.099409] [INFO ] [MAIN ] Update Progress: 171/2369 symbols completed. ATI took 33.0s. Estimated remaining: 3h 43m 49s. Rate: 9.8 symbols/min [2025-09-15T17:17:28.266719] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:17:28.282772] [DEBUG] [LOCAL ] ATS: Loaded 13232 existing records from primary storage. [2025-09-15T17:17:28.282901] [INFO ] [MAIN ] ATS: Loaded 13232 existing records. [2025-09-15T17:17:28.466525] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-09-15T17:17:28.471992] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:17:28.473111] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-09-15T17:17:28.473166] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-09-15T17:17:28.473732] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-09-15T17:17:28.473815] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-09-15T17:17:28.859566] [INFO ] [REMOTE ] ATS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:17:29.097971] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T17:17:29.257877] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-09-15T17:17:29.903611] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-15T17:17:30.057895] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-09-15T17:17:30.521455] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-15T17:17:30.857935] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-09-15T17:17:31.299134] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-15T17:17:31.515810] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-15T17:17:31.657938] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-09-15T17:17:32.457968] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-09-15T17:17:32.914188] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-15T17:17:33.257884] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-09-15T17:17:33.516691] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-15T17:17:34.057875] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-09-15T17:17:34.218422] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-15T17:17:34.857894] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-09-15T17:17:35.406098] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T17:17:35.657941] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-09-15T17:17:36.054510] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-15T17:17:36.457907] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-09-15T17:17:36.627547] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-15T17:17:37.257900] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-09-15T17:17:37.440505] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T17:17:37.444898] [INFO ] [REMOTE ] ATKR: Full fetch complete (39895 records). [2025-09-15T17:17:37.445021] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-09-15T17:17:37.817845] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-09-15T17:17:37.817931] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-09-15T17:17:37.818411] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-09-15T17:17:37.818453] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-09-15T17:17:37.819465] [DEBUG] [LOCAL ] ATKR: Trimmed 39895 records to 25276 (keeping 150 days of data) [2025-09-15T17:17:37.983274] [DEBUG] [LOCAL ] ATKR: Primary data saved (25276 records). [2025-09-15T17:17:37.983426] [INFO ] [MAIN ] ATKR: Full history saved. [2025-09-15T17:17:37.983523] [INFO ] [MAIN ] Update Progress: 172/2369 symbols completed. ATKR took 35.3s. Estimated remaining: 3h 44m 31s. Rate: 9.8 symbols/min [2025-09-15T17:17:38.062990] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-09-15T17:17:38.156675] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:17:38.198004] [DEBUG] [LOCAL ] ATUS: Loaded 37778 existing records from primary storage. [2025-09-15T17:17:38.198204] [INFO ] [MAIN ] ATUS: Loaded 37778 existing records. [2025-09-15T17:17:38.386248] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:17:38.386765] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-09-15T17:17:38.386909] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-09-15T17:17:38.388400] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-09-15T17:17:38.388513] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-09-15T17:17:38.515327] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-15T17:17:38.794477] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:17:38.857940] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-09-15T17:17:39.568541] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-15T17:17:39.657836] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-09-15T17:17:39.952388] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-15T17:17:40.457910] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-09-15T17:17:40.905912] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-15T17:17:40.910498] [INFO ] [REMOTE ] ATO: Full fetch complete (45734 records). [2025-09-15T17:17:40.910606] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-09-15T17:17:41.270280] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-09-15T17:17:41.294193] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-09-15T17:17:41.294326] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-09-15T17:17:41.295089] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-09-15T17:17:41.295281] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-09-15T17:17:41.296748] [DEBUG] [LOCAL ] ATO: Trimmed 45734 records to 30687 (keeping 150 days of data) [2025-09-15T17:17:41.506131] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-15T17:17:41.530257] [DEBUG] [LOCAL ] ATO: Primary data saved (30687 records). [2025-09-15T17:17:41.530465] [INFO ] [MAIN ] ATO: Full history saved. [2025-09-15T17:17:41.531090] [INFO ] [MAIN ] Update Progress: 173/2369 symbols completed. ATO took 25.9s. Estimated remaining: 3h 43m 52s. Rate: 9.8 symbols/min [2025-09-15T17:17:41.708447] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:17:41.750679] [DEBUG] [LOCAL ] AU: Loaded 39866 existing records from primary storage. [2025-09-15T17:17:41.750852] [INFO ] [MAIN ] AU: Loaded 39866 existing records. [2025-09-15T17:17:41.937401] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:17:41.937783] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-09-15T17:17:41.937834] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-09-15T17:17:41.939560] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-09-15T17:17:41.939830] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-09-15T17:17:42.062998] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-09-15T17:17:42.296826] [INFO ] [REMOTE ] AU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:17:42.510084] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T17:17:42.857881] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-09-15T17:17:43.412726] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T17:17:43.416686] [INFO ] [REMOTE ] ATR: Full fetch complete (33428 records). [2025-09-15T17:17:43.416778] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-09-15T17:17:43.667928] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-09-15T17:17:43.790206] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-09-15T17:17:43.790288] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-09-15T17:17:43.790750] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-09-15T17:17:43.790799] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-09-15T17:17:43.791673] [DEBUG] [LOCAL ] ATR: Trimmed 33428 records to 22944 (keeping 150 days of data) [2025-09-15T17:17:43.903680] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-15T17:17:43.959930] [DEBUG] [LOCAL ] ATR: Primary data saved (22944 records). [2025-09-15T17:17:43.960107] [INFO ] [MAIN ] ATR: Full history saved. [2025-09-15T17:17:43.960210] [INFO ] [MAIN ] Update Progress: 174/2369 symbols completed. ATR took 20.1s. Estimated remaining: 3h 42m 60s. Rate: 9.8 symbols/min [2025-09-15T17:17:44.139711] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:17:44.177528] [DEBUG] [LOCAL ] AUB: Loaded 34357 existing records from primary storage. [2025-09-15T17:17:44.177712] [INFO ] [MAIN ] AUB: Loaded 34357 existing records. [2025-09-15T17:17:44.362928] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:17:44.363206] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-09-15T17:17:44.363253] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-09-15T17:17:44.364364] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-09-15T17:17:44.364416] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-09-15T17:17:44.462983] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-09-15T17:17:44.724064] [INFO ] [REMOTE ] AUB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:17:44.942038] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-15T17:17:45.257942] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-09-15T17:17:46.057908] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-09-15T17:17:46.510459] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-15T17:17:46.814338] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T17:17:46.857821] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-09-15T17:17:47.635837] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T17:17:47.657840] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-09-15T17:17:48.059339] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-15T17:17:48.457869] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-09-15T17:17:49.257900] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-09-15T17:17:49.608027] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-15T17:17:49.696737] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T17:17:50.057872] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-09-15T17:17:50.613321] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-15T17:17:50.857878] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-09-15T17:17:51.657887] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-09-15T17:17:51.709138] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-15T17:17:52.262039] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-15T17:17:52.457846] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-09-15T17:17:52.491757] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T17:17:53.257889] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-09-15T17:17:53.972535] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T17:17:54.057894] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-09-15T17:17:54.857895] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-09-15T17:17:55.359249] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-15T17:17:55.397334] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-15T17:17:55.657877] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-09-15T17:17:55.919246] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-15T17:17:56.457895] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-09-15T17:17:57.257963] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-09-15T17:17:57.351316] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-15T17:17:58.057898] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-09-15T17:17:58.205980] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-15T17:17:58.857834] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-09-15T17:17:58.919378] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-15T17:17:59.024986] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-15T17:17:59.657880] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-09-15T17:18:00.457879] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-09-15T17:18:00.904344] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-15T17:18:00.953162] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-15T17:18:01.257924] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-09-15T17:18:02.057889] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-09-15T17:18:02.150084] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-15T17:18:02.155881] [INFO ] [REMOTE ] ATUS: Full fetch complete (53510 records). [2025-09-15T17:18:02.156043] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-09-15T17:18:02.565429] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-09-15T17:18:02.565530] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-09-15T17:18:02.566126] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-09-15T17:18:02.566174] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-09-15T17:18:02.567511] [DEBUG] [LOCAL ] ATUS: Trimmed 53510 records to 37048 (keeping 150 days of data) [2025-09-15T17:18:02.790379] [DEBUG] [LOCAL ] ATUS: Primary data saved (37048 records). [2025-09-15T17:18:02.790539] [INFO ] [MAIN ] ATUS: Full history saved. [2025-09-15T17:18:02.791924] [INFO ] [MAIN ] Update Progress: 175/2369 symbols completed. ATUS took 24.8s. Estimated remaining: 3h 45m 33s. Rate: 9.7 symbols/min [2025-09-15T17:18:02.864520] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-09-15T17:18:02.971174] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:18:02.977380] [DEBUG] [LOCAL ] AUNA: Loaded 3632 existing records from primary storage. [2025-09-15T17:18:02.977489] [INFO ] [MAIN ] AUNA: Loaded 3632 existing records. [2025-09-15T17:18:03.153852] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:18:03.154119] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-09-15T17:18:03.154165] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-09-15T17:18:03.154382] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-09-15T17:18:03.154426] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-09-15T17:18:03.525886] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:18:03.657895] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-09-15T17:18:03.774794] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-09-15T17:18:03.779658] [INFO ] [REMOTE ] AUB: Full fetch complete (50210 records). [2025-09-15T17:18:03.779762] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-09-15T17:18:04.157258] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-09-15T17:18:04.157359] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-09-15T17:18:04.157945] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-09-15T17:18:04.157995] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-09-15T17:18:04.159314] [DEBUG] [LOCAL ] AUB: Trimmed 50210 records to 33612 (keeping 150 days of data) [2025-09-15T17:18:04.415634] [DEBUG] [LOCAL ] AUB: Primary data saved (33612 records). [2025-09-15T17:18:04.415871] [INFO ] [MAIN ] AUB: Full history saved. [2025-09-15T17:18:04.416016] [INFO ] [MAIN ] Update Progress: 176/2369 symbols completed. AUB took 20.5s. Estimated remaining: 3h 44m 31s. Rate: 9.8 symbols/min [2025-09-15T17:18:04.639814] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:18:04.685742] [DEBUG] [LOCAL ] AVA: Loaded 29173 existing records from primary storage. [2025-09-15T17:18:04.685944] [INFO ] [MAIN ] AVA: Loaded 29173 existing records. [2025-09-15T17:18:04.973909] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:18:04.974338] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-09-15T17:18:04.974408] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-09-15T17:18:04.945038] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-15T17:18:04.979919] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-09-15T17:18:04.980093] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-09-15T17:18:04.979830] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-09-15T17:18:05.173370] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-15T17:18:05.259699] [INFO ] [REMOTE ] ATS: Full fetch complete (19574 records). [2025-09-15T17:18:05.274093] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-09-15T17:18:05.664526] [INFO ] [REMOTE ] AVA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:18:05.707941] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-09-15T17:18:05.773063] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-15T17:18:05.882864] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-09-15T17:18:05.883078] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-09-15T17:18:05.883337] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-09-15T17:18:05.883408] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-09-15T17:18:05.884021] [DEBUG] [LOCAL ] ATS: Trimmed 19574 records to 12990 (keeping 150 days of data) [2025-09-15T17:18:05.973471] [DEBUG] [LOCAL ] ATS: Primary data saved (12990 records). [2025-09-15T17:18:05.973632] [INFO ] [MAIN ] ATS: Full history saved. [2025-09-15T17:18:05.973739] [INFO ] [MAIN ] Update Progress: 177/2369 symbols completed. ATS took 37.9s. Estimated remaining: 3h 43m 28s. Rate: 9.8 symbols/min [2025-09-15T17:18:06.063089] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-09-15T17:18:06.143486] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:18:06.150272] [DEBUG] [LOCAL ] AVAL: Loaded 6001 existing records from primary storage. [2025-09-15T17:18:06.150362] [INFO ] [MAIN ] AVAL: Loaded 6001 existing records. [2025-09-15T17:18:06.326507] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:18:06.326919] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-09-15T17:18:06.327017] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-09-15T17:18:06.327374] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-09-15T17:18:06.327508] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-09-15T17:18:06.514346] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-15T17:18:06.670702] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (4.61 seconds). [2025-09-15T17:18:06.734577] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:18:06.857839] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-09-15T17:18:06.919947] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T17:18:07.657879] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-09-15T17:18:08.457870] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-09-15T17:18:08.723457] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-15T17:18:09.022019] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-15T17:18:09.082620] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-15T17:18:09.257876] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-09-15T17:18:10.057872] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-09-15T17:18:10.633043] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-15T17:18:10.658380] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T17:18:10.857827] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-09-15T17:18:11.657865] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-09-15T17:18:12.457866] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-09-15T17:18:12.922377] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-15T17:18:13.257851] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-09-15T17:18:13.311899] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-15T17:18:13.646237] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-15T17:18:14.057897] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-09-15T17:18:14.857933] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-09-15T17:18:14.958290] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T17:18:15.130101] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-15T17:18:15.136140] [INFO ] [REMOTE ] AU: Full fetch complete (57430 records). [2025-09-15T17:18:15.136252] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-09-15T17:18:15.446773] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-15T17:18:15.520984] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-09-15T17:18:15.521057] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-09-15T17:18:15.521656] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-09-15T17:18:15.521699] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-09-15T17:18:15.522816] [DEBUG] [LOCAL ] AU: Trimmed 57430 records to 39087 (keeping 150 days of data) [2025-09-15T17:18:15.704015] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-09-15T17:18:15.775512] [DEBUG] [LOCAL ] AU: Primary data saved (39087 records). [2025-09-15T17:18:15.775691] [INFO ] [MAIN ] AU: Full history saved. [2025-09-15T17:18:15.776000] [INFO ] [MAIN ] Update Progress: 178/2369 symbols completed. AU took 34.2s. Estimated remaining: 3h 44m 7s. Rate: 9.8 symbols/min [2025-09-15T17:18:15.950421] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:18:15.984599] [DEBUG] [LOCAL ] AVB: Loaded 31412 existing records from primary storage. [2025-09-15T17:18:15.984794] [INFO ] [MAIN ] AVB: Loaded 31412 existing records. [2025-09-15T17:18:16.159601] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:18:16.159867] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-09-15T17:18:16.159913] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-09-15T17:18:16.161227] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-09-15T17:18:16.161286] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-09-15T17:18:16.419360] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-15T17:18:16.462967] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-09-15T17:18:16.531583] [INFO ] [REMOTE ] AVB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:18:17.124329] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-15T17:18:17.257937] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-09-15T17:18:18.057892] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-09-15T17:18:18.452907] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T17:18:18.857968] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-09-15T17:18:19.465141] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-15T17:18:19.466548] [INFO ] [REMOTE ] AUNA: Full fetch complete (5179 records). [2025-09-15T17:18:19.466657] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-09-15T17:18:19.668053] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-09-15T17:18:19.836122] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-09-15T17:18:19.836261] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-09-15T17:18:19.836450] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-09-15T17:18:19.836527] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-09-15T17:18:19.837149] [DEBUG] [LOCAL ] AUNA: Trimmed 5179 records to 3616 (keeping 150 days of data) [2025-09-15T17:18:19.884969] [DEBUG] [LOCAL ] AUNA: Primary data saved (3616 records). [2025-09-15T17:18:19.884333] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-15T17:18:19.885173] [INFO ] [MAIN ] AUNA: Full history saved. [2025-09-15T17:18:19.892943] [INFO ] [MAIN ] Update Progress: 179/2369 symbols completed. AUNA took 17.1s. Estimated remaining: 3h 43m 36s. Rate: 9.8 symbols/min [2025-09-15T17:18:20.061023] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:18:20.061219] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-09-15T17:18:20.061258] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-09-15T17:18:20.061375] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-09-15T17:18:20.061413] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-15T17:18:20.061452] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-15T17:18:20.061485] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-09-15T17:18:20.317204] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-15T17:18:20.452424] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:18:20.457850] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-09-15T17:18:21.257885] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-02. [2025-09-15T17:18:21.469833] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:18:21.470135] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-02 [2025-09-15T17:18:22.065712] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-03. [2025-09-15T17:18:22.070973] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T17:18:22.347156] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:18:22.347453] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-03 [2025-09-15T17:18:22.857871] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-09-15T17:18:23.657872] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-09-15T17:18:24.440221] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T17:18:24.457852] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-09-15T17:18:24.631964] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-15T17:18:25.257929] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-09-15T17:18:25.805146] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T17:18:25.809750] [INFO ] [REMOTE ] AVA: Full fetch complete (42852 records). [2025-09-15T17:18:25.809892] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-09-15T17:18:26.063056] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-09-15T17:18:26.199918] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-09-15T17:18:26.200004] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-09-15T17:18:26.200515] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-09-15T17:18:26.200558] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-09-15T17:18:26.201538] [DEBUG] [LOCAL ] AVA: Trimmed 42852 records to 28643 (keeping 150 days of data) [2025-09-15T17:18:26.379737] [DEBUG] [LOCAL ] AVA: Primary data saved (28643 records). [2025-09-15T17:18:26.379887] [INFO ] [MAIN ] AVA: Full history saved. [2025-09-15T17:18:26.379975] [INFO ] [MAIN ] Update Progress: 180/2369 symbols completed. AVA took 22.0s. Estimated remaining: 3h 43m 34s. Rate: 9.8 symbols/min [2025-09-15T17:18:26.550798] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:18:26.568193] [DEBUG] [LOCAL ] AVD: Loaded 16581 existing records from primary storage. [2025-09-15T17:18:26.568353] [INFO ] [MAIN ] AVD: Loaded 16581 existing records. [2025-09-15T17:18:26.742991] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T17:18:26.766214] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:18:26.766625] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-09-15T17:18:26.766786] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-09-15T17:18:26.767741] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-09-15T17:18:26.767802] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-09-15T17:18:26.858778] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-09-15T17:18:27.104894] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-15T17:18:27.210110] [INFO ] [REMOTE ] AVD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:18:27.541455] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-15T17:18:27.542900] [INFO ] [REMOTE ] AVAL: Full fetch complete (11020 records). [2025-09-15T17:18:27.542981] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-09-15T17:18:27.662983] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-09-15T17:18:27.919226] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-09-15T17:18:27.919329] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-09-15T17:18:27.919746] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-09-15T17:18:27.919818] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-09-15T17:18:27.920388] [DEBUG] [LOCAL ] AVAL: Trimmed 11020 records to 5769 (keeping 150 days of data) [2025-09-15T17:18:27.954747] [DEBUG] [LOCAL ] AVAL: Primary data saved (5769 records). [2025-09-15T17:18:27.954864] [INFO ] [MAIN ] AVAL: Full history saved. [2025-09-15T17:18:27.954963] [INFO ] [MAIN ] Update Progress: 181/2369 symbols completed. AVAL took 22.0s. Estimated remaining: 3h 42m 33s. Rate: 9.8 symbols/min [2025-09-15T17:18:28.123437] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:18:28.137689] [DEBUG] [LOCAL ] AVK: Loaded 13507 existing records from primary storage. [2025-09-15T17:18:28.137820] [INFO ] [MAIN ] AVK: Loaded 13507 existing records. [2025-09-15T17:18:28.314794] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:18:28.315093] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-09-15T17:18:28.315145] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-09-15T17:18:28.315811] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-09-15T17:18:28.315867] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-09-15T17:18:28.463267] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-04. [2025-09-15T17:18:28.672677] [INFO ] [REMOTE ] AVK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:18:28.723536] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:18:28.723917] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-04 [2025-09-15T17:18:29.257923] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-05. [2025-09-15T17:18:29.439762] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-15T17:18:29.449775] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:18:29.450882] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-05 [2025-09-15T17:18:30.057901] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-06. [2025-09-15T17:18:30.297187] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:18:30.297494] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-06 [2025-09-15T17:18:30.857883] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-09-15T17:18:31.657923] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-07. [2025-09-15T17:18:31.849797] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:18:31.850131] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-07 [2025-09-15T17:18:32.361713] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-15T17:18:32.457930] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-09-15T17:18:33.257936] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-08. [2025-09-15T17:18:33.690724] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T17:18:33.990028] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T17:18:34.057869] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-09. [2025-09-15T17:18:34.857873] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-09-15T17:18:35.038488] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T17:18:35.040573] [INFO ] [REMOTE ] AVBC: Full fetch complete (3974 records). [2025-09-15T17:18:35.040678] [DEBUG] [VALIDATOR ] AVBC: Validating primary data. [2025-09-15T17:18:35.220333] [WARN ] [VALIDATOR ] AVBC: Validation failed - insufficient historical data. Have 31 unique days, need 150 days [2025-09-15T17:18:35.220566] [FATAL] [MAIN ] AVBC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:18:35.220626] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:18:35.220687] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-15T17:18:35.220755] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-15T17:18:35.220804] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-09-15T17:18:35.220856] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-09-15T17:18:35.220923] [INFO ] [MAIN ] Update Progress: 182/2369 symbols completed. AVBC took 15.3s. Estimated remaining: 3h 42m 41s. Rate: 9.8 symbols/min [2025-09-15T17:18:35.391084] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:18:35.418369] [DEBUG] [LOCAL ] AVNS: Loaded 25223 existing records from primary storage. [2025-09-15T17:18:35.418535] [INFO ] [MAIN ] AVNS: Loaded 25223 existing records. [2025-09-15T17:18:35.598217] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:18:35.598457] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-09-15T17:18:35.598508] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-09-15T17:18:35.599236] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-09-15T17:18:35.599289] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-09-15T17:18:35.663007] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-09-15T17:18:35.969335] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:18:35.970502] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-15T17:18:36.457872] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-09-15T17:18:36.526305] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T17:18:37.257869] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-09-15T17:18:37.681518] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-15T17:18:38.057910] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-09-15T17:18:38.388436] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-15T17:18:38.857888] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-09-15T17:18:38.944820] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-15T17:18:39.657884] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-09-15T17:18:40.036735] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-15T17:18:40.457897] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-09-15T17:18:40.915702] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-15T17:18:41.162956] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-15T17:18:41.257874] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-09-15T17:18:42.057879] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-09-15T17:18:42.358136] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-15T17:18:42.820118] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-15T17:18:42.857875] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-09-15T17:18:43.657881] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-09-15T17:18:43.872237] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-15T17:18:44.457862] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-09-15T17:18:44.600772] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-15T17:18:45.257927] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-09-15T17:18:45.504229] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-15T17:18:46.057902] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-09-15T17:18:46.857885] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-09-15T17:18:46.906955] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-15T17:18:46.968148] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-15T17:18:47.657867] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-09-15T17:18:48.119875] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-15T17:18:48.457917] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-09-15T17:18:48.676175] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-15T17:18:49.257904] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-09-15T17:18:49.705549] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-15T17:18:50.057917] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-09-15T17:18:50.382096] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-15T17:18:50.594437] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-15T17:18:50.857871] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-09-15T17:18:51.657878] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-09-15T17:18:52.022417] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-15T17:18:52.376042] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-15T17:18:52.457875] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-09-15T17:18:53.257968] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-09-15T17:18:53.409617] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T17:18:54.057880] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-09-15T17:18:54.208813] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-15T17:18:54.214504] [INFO ] [REMOTE ] AVNS: Full fetch complete (36259 records). [2025-09-15T17:18:54.214734] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-09-15T17:18:54.600494] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-09-15T17:18:54.600598] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-09-15T17:18:54.601232] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-09-15T17:18:54.601303] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-09-15T17:18:54.602456] [DEBUG] [LOCAL ] AVNS: Trimmed 36259 records to 24755 (keeping 150 days of data) [2025-09-15T17:18:54.752300] [DEBUG] [LOCAL ] AVNS: Primary data saved (24755 records). [2025-09-15T17:18:54.752523] [INFO ] [MAIN ] AVNS: Full history saved. [2025-09-15T17:18:54.752665] [INFO ] [MAIN ] Update Progress: 183/2369 symbols completed. AVNS took 19.5s. Estimated remaining: 3h 45m 15s. Rate: 9.7 symbols/min [2025-09-15T17:18:54.858629] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-09-15T17:18:54.933165] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:18:54.964964] [DEBUG] [LOCAL ] AVNT: Loaded 29154 existing records from primary storage. [2025-09-15T17:18:54.965106] [INFO ] [MAIN ] AVNT: Loaded 29154 existing records. [2025-09-15T17:18:55.142876] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:18:55.143312] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-09-15T17:18:55.150817] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-09-15T17:18:55.152615] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-09-15T17:18:55.152537] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-15T17:18:55.152738] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-09-15T17:18:55.203865] [INFO ] [REMOTE ] AVD: Full fetch complete (24763 records). [2025-09-15T17:18:55.237332] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-09-15T17:18:55.660333] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-09-15T17:18:55.744910] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:18:55.924605] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-09-15T17:18:55.924712] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-09-15T17:18:55.925077] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-09-15T17:18:55.925122] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-09-15T17:18:55.926003] [DEBUG] [LOCAL ] AVD: Trimmed 24763 records to 16275 (keeping 150 days of data) [2025-09-15T17:18:56.018665] [DEBUG] [LOCAL ] AVD: Primary data saved (16275 records). [2025-09-15T17:18:56.018831] [INFO ] [MAIN ] AVD: Full history saved. [2025-09-15T17:18:56.018921] [INFO ] [MAIN ] Update Progress: 184/2369 symbols completed. AVD took 29.6s. Estimated remaining: 3h 44m 11s. Rate: 9.7 symbols/min [2025-09-15T17:18:56.201826] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:18:56.216451] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-15T17:18:56.221355] [INFO ] [REMOTE ] AVB: Full fetch complete (44670 records). [2025-09-15T17:18:56.221557] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-09-15T17:18:56.473571] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-09-15T17:18:56.509662] [DEBUG] [LOCAL ] AVTR: Loaded 40334 existing records from primary storage. [2025-09-15T17:18:56.526533] [INFO ] [MAIN ] AVTR: Loaded 40334 existing records. [2025-09-15T17:18:56.872966] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-09-15T17:18:56.880387] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:18:56.880971] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-09-15T17:18:56.882071] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-09-15T17:18:56.881249] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-09-15T17:18:56.882189] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-09-15T17:18:56.882265] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-09-15T17:18:56.890922] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-09-15T17:18:56.892379] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T17:18:56.892505] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-09-15T17:18:56.901621] [INFO ] [REMOTE ] AVK: Full fetch complete (19692 records). [2025-09-15T17:18:56.909867] [DEBUG] [LOCAL ] AVB: Trimmed 44670 records to 30819 (keeping 150 days of data) [2025-09-15T17:18:56.925520] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-09-15T17:18:57.981509] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:18:57.993062] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-09-15T17:18:58.122073] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-09-15T17:18:58.122464] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-09-15T17:18:58.123148] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-09-15T17:18:58.123955] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-09-15T17:18:58.135171] [DEBUG] [LOCAL ] AVK: Trimmed 19692 records to 13357 (keeping 150 days of data) [2025-09-15T17:18:58.156631] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T17:18:58.204389] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-09-15T17:18:58.326791] [DEBUG] [LOCAL ] AVB: Primary data saved (30819 records). [2025-09-15T17:18:58.328098] [INFO ] [MAIN ] AVB: Full history saved. [2025-09-15T17:18:58.328537] [INFO ] [MAIN ] Update Progress: 185/2369 symbols completed. AVB took 42.6s. Estimated remaining: 3h 43m 19s. Rate: 9.8 symbols/min [2025-09-15T17:18:58.517786] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:18:58.521888] [DEBUG] [LOCAL ] AVK: Primary data saved (13357 records). [2025-09-15T17:18:58.522221] [INFO ] [MAIN ] AVK: Full history saved. [2025-09-15T17:18:58.522338] [INFO ] [MAIN ] Update Progress: 186/2369 symbols completed. AVK took 30.6s. Estimated remaining: 3h 42m 3s. Rate: 9.8 symbols/min [2025-09-15T17:18:58.706007] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:18:58.716897] [DEBUG] [LOCAL ] AVY: Loaded 27556 existing records from primary storage. [2025-09-15T17:18:58.717135] [INFO ] [MAIN ] AVY: Loaded 27556 existing records. [2025-09-15T17:18:58.882082] [DEBUG] [LOCAL ] AWF: Loaded 17314 existing records from primary storage. [2025-09-15T17:18:58.890880] [INFO ] [MAIN ] AWF: Loaded 17314 existing records. [2025-09-15T17:18:58.989773] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:18:59.016181] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-09-15T17:18:59.021913] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-09-15T17:18:59.073420] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-09-15T17:18:59.092435] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-09-15T17:18:59.092352] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:18:59.097754] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-09-15T17:18:59.150354] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-09-15T17:18:59.176233] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-09-15T17:18:59.193468] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-09-15T17:18:59.807783] [INFO ] [REMOTE ] AVY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:18:59.814823] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-09-15T17:18:59.906443] [INFO ] [REMOTE ] AWF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:18:59.907384] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-09-15T17:18:59.942990] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-15T17:18:59.968822] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-15T17:19:00.457906] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-09-15T17:19:01.088548] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-15T17:19:01.215994] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-15T17:19:01.257861] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-09-15T17:19:02.057863] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-09-15T17:19:02.384348] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-15T17:19:02.464676] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-15T17:19:02.857867] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-09-15T17:19:03.400839] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T17:19:03.657907] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-09-15T17:19:04.349555] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T17:19:04.457887] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-09-15T17:19:04.742960] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-15T17:19:05.257891] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-09-15T17:19:05.832160] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T17:19:06.057868] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-09-15T17:19:06.652517] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-15T17:19:06.857890] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-09-15T17:19:07.516698] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T17:19:07.581480] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-15T17:19:07.657874] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-09-15T17:19:08.283387] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-15T17:19:08.457875] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-09-15T17:19:09.225508] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-15T17:19:09.257874] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-09-15T17:19:10.057869] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-09-15T17:19:10.730437] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T17:19:10.857955] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-09-15T17:19:11.375765] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T17:19:11.657875] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-09-15T17:19:11.806352] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-15T17:19:12.427553] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T17:19:12.430437] [INFO ] [REMOTE ] AWF: Full fetch complete (26374 records). [2025-09-15T17:19:12.430526] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-09-15T17:19:12.431325] [FATAL] [VALIDATOR ] AWF: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:19:12.431422] [FATAL] [MAIN ] AWF: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:19:12.431480] [WARN ] [MAIN ] AWF: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:19:12.431535] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-09-15T17:19:12.431615] [DEBUG] [LOCAL ] AWF: No primary data file found to delete. [2025-09-15T17:19:12.431676] [INFO ] [LOCAL ] AWF: Starting deletion of derivative data. [2025-09-15T17:19:12.432141] [DEBUG] [LOCAL ] AWF: Deleted derivative data file. [2025-09-15T17:19:12.432239] [INFO ] [MAIN ] Update Progress: 187/2369 symbols completed. AWF took 13.9s. Estimated remaining: 3h 43m 28s. Rate: 9.8 symbols/min [2025-09-15T17:19:12.467180] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-09-15T17:19:12.627720] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:19:12.654078] [DEBUG] [LOCAL ] AWI: Loaded 19432 existing records from primary storage. [2025-09-15T17:19:12.654273] [INFO ] [MAIN ] AWI: Loaded 19432 existing records. [2025-09-15T17:19:12.838286] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:19:12.838635] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-09-15T17:19:12.838707] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-09-15T17:19:12.839575] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-09-15T17:19:12.839629] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-09-15T17:19:13.206299] [INFO ] [REMOTE ] AWI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:19:13.257928] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-09-15T17:19:14.057910] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-09-15T17:19:14.127960] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T17:19:14.709434] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-15T17:19:14.857881] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-09-15T17:19:15.555134] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-15T17:19:15.657890] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-09-15T17:19:15.868528] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T17:19:16.457880] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-09-15T17:19:17.208096] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T17:19:17.257915] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-09-15T17:19:17.704406] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-15T17:19:18.057928] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-09-15T17:19:18.840263] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T17:19:18.857814] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-09-15T17:19:19.075529] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T17:19:19.657923] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-09-15T17:19:20.263107] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T17:19:20.272663] [INFO ] [REMOTE ] AVTR: Full fetch complete (58235 records). [2025-09-15T17:19:20.272865] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-09-15T17:19:20.467860] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-09-15T17:19:20.660543] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-09-15T17:19:20.660632] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-09-15T17:19:20.661288] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-09-15T17:19:20.661341] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-09-15T17:19:20.662695] [DEBUG] [LOCAL ] AVTR: Trimmed 58235 records to 39554 (keeping 150 days of data) [2025-09-15T17:19:20.913454] [DEBUG] [LOCAL ] AVTR: Primary data saved (39554 records). [2025-09-15T17:19:20.913681] [INFO ] [MAIN ] AVTR: Full history saved. [2025-09-15T17:19:20.913814] [INFO ] [MAIN ] Update Progress: 188/2369 symbols completed. AVTR took 24.9s. Estimated remaining: 3h 43m 49s. Rate: 9.7 symbols/min [2025-09-15T17:19:21.080533] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:19:21.121872] [DEBUG] [LOCAL ] AWK: Loaded 36312 existing records from primary storage. [2025-09-15T17:19:21.122032] [INFO ] [MAIN ] AWK: Loaded 36312 existing records. [2025-09-15T17:19:21.262837] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-09-15T17:19:21.302871] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:19:21.303342] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-09-15T17:19:21.303461] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-09-15T17:19:21.305172] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-09-15T17:19:21.305236] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-09-15T17:19:21.436664] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-15T17:19:21.769567] [INFO ] [REMOTE ] AWK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:19:21.780416] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-15T17:19:21.785024] [INFO ] [REMOTE ] AVY: Full fetch complete (40901 records). [2025-09-15T17:19:21.785148] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-09-15T17:19:21.785828] [FATAL] [VALIDATOR ] AVY: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:19:21.785910] [FATAL] [MAIN ] AVY: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:19:21.785960] [WARN ] [MAIN ] AVY: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:19:21.786003] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-09-15T17:19:21.786071] [DEBUG] [LOCAL ] AVY: No primary data file found to delete. [2025-09-15T17:19:21.786149] [INFO ] [LOCAL ] AVY: Starting deletion of derivative data. [2025-09-15T17:19:21.786381] [DEBUG] [LOCAL ] AVY: Deleted derivative data file. [2025-09-15T17:19:21.786478] [INFO ] [MAIN ] Update Progress: 189/2369 symbols completed. AVY took 23.5s. Estimated remaining: 3h 42m 42s. Rate: 9.8 symbols/min [2025-09-15T17:19:21.957718] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:19:21.975501] [DEBUG] [LOCAL ] AWP: Loaded 16752 existing records from primary storage. [2025-09-15T17:19:21.975636] [INFO ] [MAIN ] AWP: Loaded 16752 existing records. [2025-09-15T17:19:22.066806] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-09-15T17:19:22.155437] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:19:22.155709] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-09-15T17:19:22.155761] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-09-15T17:19:22.156406] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-09-15T17:19:22.156469] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-09-15T17:19:22.529093] [INFO ] [REMOTE ] AWP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:19:22.548015] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-15T17:19:22.857897] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-09-15T17:19:23.631556] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T17:19:23.657833] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-09-15T17:19:24.457857] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-09-15T17:19:24.511935] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-15T17:19:25.263246] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-09-15T17:19:25.287139] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-15T17:19:25.315247] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T17:19:26.057891] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-09-15T17:19:26.460557] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T17:19:26.857877] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-09-15T17:19:27.335581] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-15T17:19:27.340269] [INFO ] [REMOTE ] AVNT: Full fetch complete (43026 records). [2025-09-15T17:19:27.340385] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-09-15T17:19:27.662983] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-09-15T17:19:27.730454] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-09-15T17:19:27.730540] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-09-15T17:19:27.731077] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-09-15T17:19:27.731133] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-09-15T17:19:27.732303] [DEBUG] [LOCAL ] AVNT: Trimmed 43026 records to 28547 (keeping 150 days of data) [2025-09-15T17:19:27.918816] [DEBUG] [LOCAL ] AVNT: Primary data saved (28547 records). [2025-09-15T17:19:27.918974] [INFO ] [MAIN ] AVNT: Full history saved. [2025-09-15T17:19:27.919076] [INFO ] [MAIN ] Update Progress: 190/2369 symbols completed. AVNT took 33.2s. Estimated remaining: 3h 42m 36s. Rate: 9.8 symbols/min [2025-09-15T17:19:28.092857] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:19:28.111390] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-15T17:19:28.130166] [DEBUG] [LOCAL ] AWR: Loaded 16385 existing records from primary storage. [2025-09-15T17:19:28.130371] [INFO ] [MAIN ] AWR: Loaded 16385 existing records. [2025-09-15T17:19:28.321301] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:19:28.321627] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-09-15T17:19:28.321698] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-09-15T17:19:28.323464] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-09-15T17:19:28.323524] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-09-15T17:19:28.464952] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-09-15T17:19:28.681156] [INFO ] [REMOTE ] AWR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:19:28.694220] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-15T17:19:29.257894] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-09-15T17:19:29.672394] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T17:19:30.057889] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-09-15T17:19:30.583593] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-15T17:19:30.857883] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-09-15T17:19:31.021167] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-15T17:19:31.657905] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-09-15T17:19:32.434925] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T17:19:32.458072] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-09-15T17:19:32.464088] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-15T17:19:33.257905] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-09-15T17:19:33.954855] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-15T17:19:34.057834] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-09-15T17:19:34.077725] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-15T17:19:34.857878] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-09-15T17:19:35.010997] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T17:19:35.657934] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-09-15T17:19:36.423522] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T17:19:36.457821] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-09-15T17:19:36.485668] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-15T17:19:37.257882] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-09-15T17:19:38.057896] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-09-15T17:19:38.124852] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-15T17:19:38.184319] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-15T17:19:38.857917] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-09-15T17:19:39.404838] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T17:19:39.657875] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-09-15T17:19:40.457850] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-09-15T17:19:40.501090] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T17:19:40.506765] [INFO ] [REMOTE ] AWK: Full fetch complete (53226 records). [2025-09-15T17:19:40.506961] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-09-15T17:19:40.903050] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-09-15T17:19:40.903580] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-09-15T17:19:40.903875] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-15T17:19:40.904452] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-09-15T17:19:40.907374] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-09-15T17:19:40.907999] [INFO ] [REMOTE ] AWI: Full fetch complete (28507 records). [2025-09-15T17:19:40.908264] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-09-15T17:19:40.940112] [DEBUG] [LOCAL ] AWK: Trimmed 53226 records to 35633 (keeping 150 days of data) [2025-09-15T17:19:41.259603] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-09-15T17:19:41.443805] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-09-15T17:19:41.444148] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-09-15T17:19:41.446980] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-09-15T17:19:41.448429] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-09-15T17:19:41.459605] [DEBUG] [LOCAL ] AWI: Trimmed 28507 records to 18971 (keeping 150 days of data) [2025-09-15T17:19:41.588964] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-15T17:19:41.721181] [DEBUG] [LOCAL ] AWK: Primary data saved (35633 records). [2025-09-15T17:19:41.721819] [INFO ] [MAIN ] AWK: Full history saved. [2025-09-15T17:19:41.722137] [INFO ] [MAIN ] Update Progress: 191/2369 symbols completed. AWK took 20.8s. Estimated remaining: 3h 43m 57s. Rate: 9.7 symbols/min [2025-09-15T17:19:41.907946] [DEBUG] [LOCAL ] AWI: Primary data saved (18971 records). [2025-09-15T17:19:41.911207] [INFO ] [MAIN ] AWI: Full history saved. [2025-09-15T17:19:41.911353] [INFO ] [MAIN ] Update Progress: 192/2369 symbols completed. AWI took 29.5s. Estimated remaining: 3h 42m 43s. Rate: 9.8 symbols/min [2025-09-15T17:19:41.911107] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:19:42.061296] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-09-15T17:19:42.094557] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:19:42.103851] [DEBUG] [LOCAL ] AX: Loaded 20596 existing records from primary storage. [2025-09-15T17:19:42.104084] [INFO ] [MAIN ] AX: Loaded 20596 existing records. [2025-09-15T17:19:42.293269] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:19:42.293577] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-09-15T17:19:42.293633] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-09-15T17:19:42.295687] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-09-15T17:19:42.296372] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-09-15T17:19:42.402551] [DEBUG] [LOCAL ] AXL: Loaded 37892 existing records from primary storage. [2025-09-15T17:19:42.413737] [INFO ] [MAIN ] AXL: Loaded 37892 existing records. [2025-09-15T17:19:42.705621] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T17:19:42.819268] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:19:42.836228] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-09-15T17:19:42.841438] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-09-15T17:19:42.860581] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-09-15T17:19:42.866338] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-09-15T17:19:42.903063] [INFO ] [REMOTE ] AX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:19:42.903331] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-09-15T17:19:43.267708] [INFO ] [REMOTE ] AXL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:19:43.284331] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-15T17:19:43.657931] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-09-15T17:19:44.007488] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-15T17:19:44.457878] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-09-15T17:19:45.174830] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-15T17:19:45.257847] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-09-15T17:19:45.439407] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-15T17:19:46.057881] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-09-15T17:19:46.254502] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-15T17:19:46.857871] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-09-15T17:19:47.009929] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T17:19:47.657881] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-09-15T17:19:48.233917] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T17:19:48.457858] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-09-15T17:19:48.767008] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-15T17:19:49.257889] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-09-15T17:19:49.759935] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T17:19:50.058121] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-09-15T17:19:50.857951] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-09-15T17:19:50.982786] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-15T17:19:51.119064] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T17:19:51.657864] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-09-15T17:19:51.828434] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-15T17:19:52.457919] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-09-15T17:19:53.229712] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-15T17:19:53.257879] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-09-15T17:19:53.296457] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-15T17:19:54.057909] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-09-15T17:19:54.479855] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T17:19:54.857873] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-09-15T17:19:55.486209] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T17:19:55.657882] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-09-15T17:19:56.052499] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-15T17:19:56.055682] [INFO ] [REMOTE ] AWR: Full fetch complete (24215 records). [2025-09-15T17:19:56.055770] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-09-15T17:19:56.436046] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-09-15T17:19:56.436178] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-09-15T17:19:56.436673] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-09-15T17:19:56.436779] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-09-15T17:19:56.438097] [DEBUG] [LOCAL ] AWR: Trimmed 24215 records to 16093 (keeping 150 days of data) [2025-09-15T17:19:56.490236] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-09-15T17:19:56.557001] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T17:19:56.563608] [INFO ] [REMOTE ] AWP: Full fetch complete (23908 records). [2025-09-15T17:19:56.564404] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-09-15T17:19:56.709069] [DEBUG] [LOCAL ] AWR: Primary data saved (16093 records). [2025-09-15T17:19:56.744560] [INFO ] [MAIN ] AWR: Full history saved. [2025-09-15T17:19:56.762184] [INFO ] [MAIN ] Update Progress: 193/2369 symbols completed. AWR took 28.8s. Estimated remaining: 3h 44m 15s. Rate: 9.7 symbols/min [2025-09-15T17:19:57.150298] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:19:57.177762] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-09-15T17:19:57.177881] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-09-15T17:19:57.178289] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-09-15T17:19:57.178355] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-09-15T17:19:57.179518] [DEBUG] [LOCAL ] AWP: Trimmed 23908 records to 16615 (keeping 150 days of data) [2025-09-15T17:19:57.258325] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-09-15T17:19:57.310972] [DEBUG] [LOCAL ] AWP: Primary data saved (16615 records). [2025-09-15T17:19:57.313009] [INFO ] [MAIN ] AWP: Full history saved. [2025-09-15T17:19:57.313192] [INFO ] [MAIN ] Update Progress: 194/2369 symbols completed. AWP took 35.5s. Estimated remaining: 3h 43m 6s. Rate: 9.7 symbols/min [2025-09-15T17:19:57.312873] [DEBUG] [LOCAL ] AXP: Loaded 40062 existing records from primary storage. [2025-09-15T17:19:57.313607] [INFO ] [MAIN ] AXP: Loaded 40062 existing records. [2025-09-15T17:19:57.675992] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:19:57.707228] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:19:57.708463] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-09-15T17:19:57.711767] [DEBUG] [LOCAL ] AXR: Loaded 2176 existing records from primary storage. [2025-09-15T17:19:57.711856] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-09-15T17:19:57.712219] [INFO ] [MAIN ] AXR: Loaded 2176 existing records. [2025-09-15T17:19:57.717520] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-09-15T17:19:57.729700] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-09-15T17:19:58.082326] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:19:58.098625] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-09-15T17:19:58.110134] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-09-15T17:19:58.112628] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-15T17:19:58.118087] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-09-15T17:19:58.130088] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-09-15T17:19:58.211414] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-09-15T17:19:58.736044] [INFO ] [REMOTE ] AXP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:19:58.831961] [INFO ] [REMOTE ] AXR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:19:58.859403] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-09-15T17:19:58.866096] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T17:19:59.341130] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-15T17:19:59.344705] [INFO ] [REMOTE ] AX: Full fetch complete (31207 records). [2025-09-15T17:19:59.344840] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-09-15T17:19:59.478923] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-15T17:19:59.662997] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-09-15T17:19:59.731114] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-09-15T17:19:59.731203] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-09-15T17:19:59.731611] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-09-15T17:19:59.731670] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-09-15T17:19:59.732589] [DEBUG] [LOCAL ] AX: Trimmed 31207 records to 20149 (keeping 150 days of data) [2025-09-15T17:19:59.855377] [DEBUG] [LOCAL ] AX: Primary data saved (20149 records). [2025-09-15T17:19:59.855509] [INFO ] [MAIN ] AX: Full history saved. [2025-09-15T17:19:59.855596] [INFO ] [MAIN ] Update Progress: 195/2369 symbols completed. AX took 18.1s. Estimated remaining: 3h 42m 20s. Rate: 9.8 symbols/min [2025-09-15T17:20:00.033572] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:20:00.069727] [DEBUG] [LOCAL ] AXS: Loaded 28568 existing records from primary storage. [2025-09-15T17:20:00.069913] [INFO ] [MAIN ] AXS: Loaded 28568 existing records. [2025-09-15T17:20:00.248343] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:20:00.248599] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-09-15T17:20:00.248662] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-09-15T17:20:00.250828] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-09-15T17:20:00.250886] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-09-15T17:20:00.464123] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-09-15T17:20:00.599802] [INFO ] [REMOTE ] AXS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:20:01.257887] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-09-15T17:20:01.597665] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-15T17:20:02.057894] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-09-15T17:20:02.382938] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-15T17:20:02.430013] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-15T17:20:02.493007] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T17:20:02.857885] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-09-15T17:20:03.657930] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-09-15T17:20:04.333264] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-15T17:20:04.457879] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-09-15T17:20:05.257883] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-09-15T17:20:05.637767] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-15T17:20:05.824752] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-15T17:20:06.057873] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-09-15T17:20:06.843761] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-15T17:20:06.849788] [INFO ] [REMOTE ] AXL: Full fetch complete (55030 records). [2025-09-15T17:20:06.849964] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-09-15T17:20:06.863949] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-09-15T17:20:07.235479] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-09-15T17:20:07.235578] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-09-15T17:20:07.236198] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-09-15T17:20:07.236247] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-09-15T17:20:07.237547] [DEBUG] [LOCAL ] AXL: Trimmed 55030 records to 37150 (keeping 150 days of data) [2025-09-15T17:20:07.432252] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-15T17:20:07.462982] [DEBUG] [LOCAL ] AXL: Primary data saved (37150 records). [2025-09-15T17:20:07.463151] [INFO ] [MAIN ] AXL: Full history saved. [2025-09-15T17:20:07.463890] [INFO ] [MAIN ] Update Progress: 196/2369 symbols completed. AXL took 25.6s. Estimated remaining: 3h 42m 30s. Rate: 9.8 symbols/min [2025-09-15T17:20:07.637422] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:20:07.660522] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-09-15T17:20:07.678151] [DEBUG] [LOCAL ] AXTA: Loaded 39189 existing records from primary storage. [2025-09-15T17:20:07.678290] [INFO ] [MAIN ] AXTA: Loaded 39189 existing records. [2025-09-15T17:20:07.868944] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:20:07.869254] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-09-15T17:20:07.869310] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-09-15T17:20:07.870155] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-09-15T17:20:07.870206] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-09-15T17:20:08.224150] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:20:08.428392] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-15T17:20:08.457835] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-09-15T17:20:08.660772] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-15T17:20:09.257905] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-09-15T17:20:10.057928] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-09-15T17:20:10.313768] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-15T17:20:10.363413] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-15T17:20:10.658957] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-15T17:20:10.857868] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-09-15T17:20:11.381979] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-15T17:20:11.657910] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-09-15T17:20:12.457925] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-09-15T17:20:13.184876] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-15T17:20:13.257851] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-09-15T17:20:13.824553] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-15T17:20:14.057902] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-09-15T17:20:14.391018] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-15T17:20:14.857872] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-09-15T17:20:15.413412] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-15T17:20:15.657869] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-09-15T17:20:16.327856] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T17:20:16.457872] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-09-15T17:20:16.831404] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-15T17:20:17.257911] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-09-15T17:20:17.398247] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-15T17:20:17.700938] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-15T17:20:18.057999] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-09-15T17:20:18.611607] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-15T17:20:18.612717] [INFO ] [REMOTE ] AXR: Full fetch complete (3338 records). [2025-09-15T17:20:18.612790] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-09-15T17:20:18.863057] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-09-15T17:20:18.973656] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-09-15T17:20:18.973733] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-09-15T17:20:18.973841] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-09-15T17:20:18.973877] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-09-15T17:20:18.974220] [DEBUG] [LOCAL ] AXR: Trimmed 3338 records to 2129 (keeping 150 days of data) [2025-09-15T17:20:18.987479] [DEBUG] [LOCAL ] AXR: Primary data saved (2129 records). [2025-09-15T17:20:18.987538] [INFO ] [MAIN ] AXR: Full history saved. [2025-09-15T17:20:18.987617] [INFO ] [MAIN ] Update Progress: 197/2369 symbols completed. AXR took 21.7s. Estimated remaining: 3h 43m 23s. Rate: 9.7 symbols/min [2025-09-15T17:20:19.657897] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-09-15T17:20:20.457867] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-09-15T17:20:21.039465] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-15T17:20:21.182805] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T17:20:21.257905] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-09-15T17:20:21.766401] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-15T17:20:21.771011] [INFO ] [REMOTE ] AXS: Full fetch complete (41426 records). [2025-09-15T17:20:21.771153] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-09-15T17:20:22.063892] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-09-15T17:20:22.158353] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-09-15T17:20:22.158461] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-09-15T17:20:22.159161] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-09-15T17:20:22.159212] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-09-15T17:20:22.160433] [DEBUG] [LOCAL ] AXS: Trimmed 41426 records to 28095 (keeping 150 days of data) [2025-09-15T17:20:22.338469] [DEBUG] [LOCAL ] AXS: Primary data saved (28095 records). [2025-09-15T17:20:22.338634] [INFO ] [MAIN ] AXS: Full history saved. [2025-09-15T17:20:22.338781] [INFO ] [MAIN ] Update Progress: 198/2369 symbols completed. AXS took 22.5s. Estimated remaining: 3h 42m 46s. Rate: 9.7 symbols/min [2025-09-15T17:20:23.031102] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-15T17:20:23.042361] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-09-15T17:20:23.753107] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T17:20:23.763941] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-09-15T17:20:24.717470] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-15T17:20:24.722971] [INFO ] [REMOTE ] AXP: Full fetch complete (57478 records). [2025-09-15T17:20:24.723113] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-09-15T17:20:24.724016] [FATAL] [VALIDATOR ] AXP: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:20:24.724111] [FATAL] [MAIN ] AXP: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:20:24.724149] [WARN ] [MAIN ] AXP: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:20:24.724187] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-09-15T17:20:24.724248] [DEBUG] [LOCAL ] AXP: No primary data file found to delete. [2025-09-15T17:20:24.724296] [INFO ] [LOCAL ] AXP: Starting deletion of derivative data. [2025-09-15T17:20:24.724696] [DEBUG] [LOCAL ] AXP: Deleted derivative data file. [2025-09-15T17:20:24.726083] [INFO ] [MAIN ] Update Progress: 199/2369 symbols completed. AXP took 28.0s. Estimated remaining: 3h 41m 59s. Rate: 9.8 symbols/min [2025-09-15T17:20:25.274869] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T17:20:25.286844] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-09-15T17:20:26.946317] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-15T17:20:26.958796] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-09-15T17:20:28.329150] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-15T17:20:28.334777] [INFO ] [REMOTE ] AXTA: Full fetch complete (56563 records). [2025-09-15T17:20:28.334883] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-09-15T17:20:28.720625] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-09-15T17:20:28.720738] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-09-15T17:20:28.721342] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-09-15T17:20:28.721384] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-09-15T17:20:28.722762] [DEBUG] [LOCAL ] AXTA: Trimmed 56563 records to 38451 (keeping 150 days of data) [2025-09-15T17:20:28.952570] [DEBUG] [LOCAL ] AXTA: Primary data saved (38451 records). [2025-09-15T17:20:28.952770] [INFO ] [MAIN ] AXTA: Full history saved. [2025-09-15T17:20:28.953498] [INFO ] [MAIN ] Update Progress: 200/2369 symbols completed. AXTA took 21.5s. Estimated remaining: 3h 41m 32s. Rate: 9.8 symbols/min [2025-09-15T17:20:29.608419] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:20:29.621138] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:20:29.617698] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:20:29.621317] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-09-15T17:20:29.643887] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-09-15T17:20:29.645967] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-09-15T17:20:29.646052] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-15T17:20:29.646110] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-15T17:20:29.646163] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-09-15T17:20:29.652346] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:20:29.745254] [DEBUG] [LOCAL ] AZO: Loaded 7902 existing records from primary storage. [2025-09-15T17:20:29.756891] [INFO ] [MAIN ] AZO: Loaded 7902 existing records. [2025-09-15T17:20:29.875469] [DEBUG] [LOCAL ] AZZ: Loaded 16871 existing records from primary storage. [2025-09-15T17:20:29.901420] [INFO ] [MAIN ] AZZ: Loaded 16871 existing records. [2025-09-15T17:20:30.056811] [DEBUG] [LOCAL ] AYI: Loaded 17957 existing records from primary storage. [2025-09-15T17:20:30.208166] [INFO ] [MAIN ] AYI: Loaded 17957 existing records. [2025-09-15T17:20:30.235014] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:20:30.339887] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-09-15T17:20:30.455511] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:20:30.443429] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-09-15T17:20:30.490447] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-09-15T17:20:30.504834] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-09-15T17:20:30.523858] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-09-15T17:20:30.543661] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-09-15T17:20:30.533684] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-09-15T17:20:30.584471] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-09-15T17:20:30.579279] [INFO ] [REMOTE ] B: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:20:30.647359] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-09-15T17:20:30.701578] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:20:30.860837] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-09-15T17:20:30.910893] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-09-15T17:20:30.953422] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:20:30.983311] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-09-15T17:20:31.017215] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-09-15T17:20:31.025062] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-09-15T17:20:31.101046] [INFO ] [REMOTE ] B: Fetching primary data for 2025-03. [2025-09-15T17:20:31.412007] [INFO ] [REMOTE ] AZO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:20:31.437344] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-09-15T17:20:31.467813] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:20:31.570713] [WARN ] [REMOTE ] B: No data returned for month 2025-03 [2025-09-15T17:20:31.595680] [INFO ] [REMOTE ] B: Fetching primary data for 2025-04. [2025-09-15T17:20:31.643802] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:20:31.669872] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-09-15T17:20:31.768280] [INFO ] [REMOTE ] AYI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:20:31.768583] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-09-15T17:20:31.886432] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:20:31.886718] [WARN ] [REMOTE ] B: No data returned for month 2025-04 [2025-09-15T17:20:31.887128] [INFO ] [REMOTE ] B: Fetching primary data for 2025-05. [2025-09-15T17:20:32.479384] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-15T17:20:32.481608] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-09-15T17:20:32.803054] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-15T17:20:32.807593] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-09-15T17:20:33.040932] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-15T17:20:33.118833] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-15T17:20:33.243806] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-15T17:20:33.257861] [INFO ] [REMOTE ] B: Fetching primary data for 2025-06. [2025-09-15T17:20:33.626249] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-15T17:20:34.057879] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-09-15T17:20:34.857891] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-09-15T17:20:35.001378] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-15T17:20:35.228117] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-15T17:20:35.533009] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-15T17:20:35.657867] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-09-15T17:20:36.458078] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-09-15T17:20:36.734460] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-15T17:20:37.010470] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-15T17:20:37.257916] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-09-15T17:20:38.057934] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-09-15T17:20:38.080316] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T17:20:38.857876] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-09-15T17:20:39.132312] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-15T17:20:39.584296] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-15T17:20:39.657896] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-09-15T17:20:40.457898] [INFO ] [REMOTE ] B: Fetching primary data for 2025-07. [2025-09-15T17:20:40.500981] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-15T17:20:41.257904] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-09-15T17:20:42.057879] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-09-15T17:20:42.473082] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T17:20:42.621429] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-15T17:20:42.857897] [INFO ] [REMOTE ] B: Fetching primary data for 2025-08. [2025-09-15T17:20:43.599092] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-15T17:20:43.657830] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-09-15T17:20:44.457840] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-09-15T17:20:44.741240] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-15T17:20:44.847869] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-15T17:20:45.257875] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-09-15T17:20:45.379590] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-15T17:20:46.057926] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-09-15T17:20:46.541772] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T17:20:46.857874] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-09-15T17:20:46.869411] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T17:20:46.871050] [INFO ] [REMOTE ] AZO: Full fetch complete (12168 records). [2025-09-15T17:20:46.871119] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-09-15T17:20:47.230413] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-09-15T17:20:47.230495] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-09-15T17:20:47.230780] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-09-15T17:20:47.230833] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-09-15T17:20:47.231312] [DEBUG] [LOCAL ] AZO: Trimmed 12168 records to 7801 (keeping 150 days of data) [2025-09-15T17:20:47.280700] [DEBUG] [LOCAL ] AZO: Primary data saved (7801 records). [2025-09-15T17:20:47.280798] [INFO ] [MAIN ] AZO: Full history saved. [2025-09-15T17:20:47.280879] [INFO ] [MAIN ] Update Progress: 201/2369 symbols completed. AZO took 18.3s. Estimated remaining: 3h 43m 37s. Rate: 9.7 symbols/min [2025-09-15T17:20:47.448710] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:20:47.448921] [DEBUG] [LOCAL ] BA: No existing data file found in primary storage. [2025-09-15T17:20:47.448960] [WARN ] [MAIN ] BA: No existing data found, performing full refresh instead. [2025-09-15T17:20:47.449078] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-09-15T17:20:47.449116] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-09-15T17:20:47.449157] [DEBUG] [LOCAL ] BA: No primary data file found to delete. [2025-09-15T17:20:47.449189] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-09-15T17:20:47.665747] [INFO ] [REMOTE ] B: Fetching primary data for 2025-09. [2025-09-15T17:20:47.818067] [INFO ] [REMOTE ] BA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:20:47.940702] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-15T17:20:48.457875] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-09-15T17:20:49.257831] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-09-15T17:20:49.501796] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T17:20:49.505607] [INFO ] [REMOTE ] AZZ: Full fetch complete (23997 records). [2025-09-15T17:20:49.505722] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-09-15T17:20:49.882967] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-09-15T17:20:49.883141] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-09-15T17:20:49.883532] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-09-15T17:20:49.883607] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-09-15T17:20:49.899917] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-15T17:20:49.900076] [DEBUG] [LOCAL ] AZZ: Trimmed 23997 records to 16542 (keeping 150 days of data) [2025-09-15T17:20:49.906706] [INFO ] [REMOTE ] B: Full fetch complete (34240 records). [2025-09-15T17:20:49.906838] [DEBUG] [VALIDATOR ] B: Validating primary data. [2025-09-15T17:20:50.061719] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-09-15T17:20:50.182887] [WARN ] [VALIDATOR ] B: Validation failed - insufficient historical data. Have 88 unique days, need 150 days [2025-09-15T17:20:50.185222] [FATAL] [MAIN ] B: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:20:50.185901] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:20:50.186476] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-15T17:20:50.186910] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-15T17:20:50.187527] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-09-15T17:20:50.188430] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-09-15T17:20:50.189136] [INFO ] [MAIN ] Update Progress: 202/2369 symbols completed. B took 21.2s. Estimated remaining: 3h 42m 56s. Rate: 9.7 symbols/min [2025-09-15T17:20:50.383099] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:20:50.402832] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-15T17:20:50.416440] [DEBUG] [LOCAL ] AZZ: Primary data saved (16542 records). [2025-09-15T17:20:50.416583] [INFO ] [MAIN ] AZZ: Full history saved. [2025-09-15T17:20:50.416711] [INFO ] [MAIN ] Update Progress: 203/2369 symbols completed. AZZ took 21.5s. Estimated remaining: 3h 41m 46s. Rate: 9.8 symbols/min [2025-09-15T17:20:50.625361] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:20:50.626322] [DEBUG] [LOCAL ] BABA: Loaded 40560 existing records from primary storage. [2025-09-15T17:20:50.626751] [INFO ] [MAIN ] BABA: Loaded 40560 existing records. [2025-09-15T17:20:50.818631] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:20:50.828117] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-09-15T17:20:50.828209] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-09-15T17:20:50.829525] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-09-15T17:20:50.829594] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-09-15T17:20:50.862462] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-09-15T17:20:50.952844] [DEBUG] [LOCAL ] BAC: Loaded 40548 existing records from primary storage. [2025-09-15T17:20:50.958724] [INFO ] [MAIN ] BAC: Loaded 40548 existing records. [2025-09-15T17:20:51.331002] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:20:51.356989] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-09-15T17:20:51.381745] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-09-15T17:20:51.405083] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-09-15T17:20:51.409416] [INFO ] [REMOTE ] BABA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:20:51.409557] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-09-15T17:20:51.674319] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-09-15T17:20:51.804953] [INFO ] [REMOTE ] BAC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:20:51.915922] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-15T17:20:52.087121] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-15T17:20:52.457887] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-09-15T17:20:53.257884] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-09-15T17:20:53.748167] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-15T17:20:54.057935] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-09-15T17:20:54.682610] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-15T17:20:54.857987] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-09-15T17:20:55.149230] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-15T17:20:55.657910] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-09-15T17:20:56.133395] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-15T17:20:56.457889] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-09-15T17:20:57.257876] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-09-15T17:20:57.356124] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T17:20:57.359237] [INFO ] [REMOTE ] AYI: Full fetch complete (27630 records). [2025-09-15T17:20:57.359376] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-09-15T17:20:57.779672] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-09-15T17:20:57.779989] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-09-15T17:20:57.780588] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-09-15T17:20:57.780728] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-09-15T17:20:57.783928] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.93 seconds). [2025-09-15T17:20:57.796990] [DEBUG] [LOCAL ] AYI: Trimmed 27630 records to 17494 (keeping 150 days of data) [2025-09-15T17:20:57.912054] [DEBUG] [LOCAL ] AYI: Primary data saved (17494 records). [2025-09-15T17:20:57.912367] [INFO ] [MAIN ] AYI: Full history saved. [2025-09-15T17:20:57.912462] [INFO ] [MAIN ] Update Progress: 204/2369 symbols completed. AYI took 29.0s. Estimated remaining: 3h 41m 55s. Rate: 9.8 symbols/min [2025-09-15T17:20:58.065108] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-15T17:20:58.075679] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-09-15T17:20:58.146071] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:20:58.187050] [DEBUG] [LOCAL ] BAH: Loaded 38796 existing records from primary storage. [2025-09-15T17:20:58.187204] [INFO ] [MAIN ] BAH: Loaded 38796 existing records. [2025-09-15T17:20:58.362875] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:20:58.363114] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-09-15T17:20:58.363159] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-09-15T17:20:58.364182] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-09-15T17:20:58.364241] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-09-15T17:20:58.718903] [INFO ] [REMOTE ] BAH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:20:58.857899] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-09-15T17:20:59.657907] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-09-15T17:20:59.852183] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-15T17:21:00.459724] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-09-15T17:21:00.465876] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-15T17:21:01.178090] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-15T17:21:01.257833] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-09-15T17:21:02.041185] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-09-15T17:21:02.057825] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-09-15T17:21:02.857928] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-09-15T17:21:04.138501] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (3.68 seconds). [2025-09-15T17:21:04.151401] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-09-15T17:21:04.363501] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (3.11 seconds). [2025-09-15T17:21:04.457868] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-09-15T17:21:04.626505] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-09-15T17:21:05.257909] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-09-15T17:21:05.554007] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-09-15T17:21:06.057880] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-09-15T17:21:06.104063] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-15T17:21:06.626275] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-15T17:21:06.858792] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-09-15T17:21:06.865726] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-15T17:21:07.657891] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-09-15T17:21:08.181333] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-15T17:21:08.457889] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-09-15T17:21:09.257881] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-09-15T17:21:09.314675] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-15T17:21:10.035971] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-15T17:21:10.057827] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-09-15T17:21:10.511664] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-15T17:21:10.862943] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-09-15T17:21:10.883593] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T17:21:11.657924] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-09-15T17:21:12.457850] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-09-15T17:21:12.571933] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-09-15T17:21:13.257919] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-09-15T17:21:13.804357] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-15T17:21:13.810695] [INFO ] [REMOTE ] BA: Full fetch complete (58471 records). [2025-09-15T17:21:13.810846] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-09-15T17:21:14.214557] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-09-15T17:21:14.214701] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-09-15T17:21:14.215637] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-09-15T17:21:14.215775] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-09-15T17:21:14.218307] [DEBUG] [LOCAL ] BA: Trimmed 58471 records to 39751 (keeping 150 days of data) [2025-09-15T17:21:14.363698] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (3.50 seconds). [2025-09-15T17:21:14.379959] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-09-15T17:21:14.526297] [DEBUG] [LOCAL ] BA: Primary data saved (39751 records). [2025-09-15T17:21:14.526445] [INFO ] [MAIN ] BA: Full history saved. [2025-09-15T17:21:14.526541] [INFO ] [MAIN ] Update Progress: 205/2369 symbols completed. BA took 27.2s. Estimated remaining: 3h 43m 39s. Rate: 9.7 symbols/min [2025-09-15T17:21:14.701384] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:21:14.728588] [DEBUG] [LOCAL ] BAK: Loaded 29310 existing records from primary storage. [2025-09-15T17:21:14.728759] [INFO ] [MAIN ] BAK: Loaded 29310 existing records. [2025-09-15T17:21:14.904431] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:21:14.904682] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-09-15T17:21:14.904757] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-09-15T17:21:14.905492] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-09-15T17:21:14.905549] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-09-15T17:21:15.260464] [INFO ] [REMOTE ] BAK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:21:15.261007] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-09-15T17:21:15.302375] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (2.84 seconds). [2025-09-15T17:21:15.657966] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-09-15T17:21:16.066246] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-09-15T17:21:16.072770] [INFO ] [REMOTE ] BABA: Full fetch complete (58500 records). [2025-09-15T17:21:16.072928] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-09-15T17:21:16.469192] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-09-15T17:21:16.469279] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-09-15T17:21:16.469906] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-09-15T17:21:16.469953] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-09-15T17:21:16.471245] [DEBUG] [LOCAL ] BABA: Trimmed 58500 records to 39780 (keeping 150 days of data) [2025-09-15T17:21:16.741037] [DEBUG] [LOCAL ] BABA: Primary data saved (39780 records). [2025-09-15T17:21:16.741242] [INFO ] [MAIN ] BABA: Full history saved. [2025-09-15T17:21:16.742103] [INFO ] [MAIN ] Update Progress: 206/2369 symbols completed. BABA took 26.6s. Estimated remaining: 3h 42m 51s. Rate: 9.7 symbols/min [2025-09-15T17:21:16.920335] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:21:16.967858] [DEBUG] [LOCAL ] BALL: Loaded 38898 existing records from primary storage. [2025-09-15T17:21:16.968003] [INFO ] [MAIN ] BALL: Loaded 38898 existing records. [2025-09-15T17:21:17.154162] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:21:17.154732] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-09-15T17:21:17.155219] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-09-15T17:21:17.156442] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-09-15T17:21:17.156976] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-09-15T17:21:17.431549] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-15T17:21:17.455133] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (3.08 seconds). [2025-09-15T17:21:17.465177] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-09-15T17:21:17.543345] [INFO ] [REMOTE ] BAC: Full fetch complete (58488 records). [2025-09-15T17:21:17.570291] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-09-15T17:21:17.593146] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-15T17:21:17.671861] [INFO ] [REMOTE ] BALL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:21:17.705620] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-09-15T17:21:18.031249] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-09-15T17:21:18.031330] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-09-15T17:21:18.031952] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-09-15T17:21:18.031996] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-09-15T17:21:18.033262] [DEBUG] [LOCAL ] BAC: Trimmed 58488 records to 39768 (keeping 150 days of data) [2025-09-15T17:21:18.092276] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-09-15T17:21:18.292169] [DEBUG] [LOCAL ] BAC: Primary data saved (39768 records). [2025-09-15T17:21:18.292396] [INFO ] [MAIN ] BAC: Full history saved. [2025-09-15T17:21:18.293207] [INFO ] [MAIN ] Update Progress: 207/2369 symbols completed. BAC took 27.9s. Estimated remaining: 3h 41m 56s. Rate: 9.7 symbols/min [2025-09-15T17:21:18.469116] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:21:18.469294] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-09-15T17:21:18.469334] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-09-15T17:21:18.469494] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-09-15T17:21:18.469542] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-15T17:21:18.469586] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-15T17:21:18.469621] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-09-15T17:21:18.872261] [INFO ] [REMOTE ] BALY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:21:18.872746] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-09-15T17:21:18.897352] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-15T17:21:19.655915] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-15T17:21:19.665844] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-09-15T17:21:19.705902] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T17:21:19.780713] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-15T17:21:20.457876] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-09-15T17:21:21.152862] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T17:21:21.257884] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-09-15T17:21:21.812487] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T17:21:21.818469] [INFO ] [REMOTE ] BAH: Full fetch complete (56419 records). [2025-09-15T17:21:21.818590] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-09-15T17:21:22.067815] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-09-15T17:21:22.225477] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-09-15T17:21:22.225586] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-09-15T17:21:22.226217] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-09-15T17:21:22.226280] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-09-15T17:21:22.228123] [DEBUG] [LOCAL ] BAH: Trimmed 56419 records to 38077 (keeping 150 days of data) [2025-09-15T17:21:22.361102] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-15T17:21:22.524098] [DEBUG] [LOCAL ] BAH: Primary data saved (38077 records). [2025-09-15T17:21:22.524265] [INFO ] [MAIN ] BAH: Full history saved. [2025-09-15T17:21:22.524619] [INFO ] [MAIN ] Update Progress: 208/2369 symbols completed. BAH took 24.6s. Estimated remaining: 3h 41m 30s. Rate: 9.8 symbols/min [2025-09-15T17:21:22.699984] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:21:22.746520] [DEBUG] [LOCAL ] BAM: Loaded 38990 existing records from primary storage. [2025-09-15T17:21:22.746788] [INFO ] [MAIN ] BAM: Loaded 38990 existing records. [2025-09-15T17:21:22.863040] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-09-15T17:21:22.932600] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:21:22.932948] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-09-15T17:21:22.933012] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-09-15T17:21:22.933998] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-09-15T17:21:22.934073] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-09-15T17:21:23.291134] [INFO ] [REMOTE ] BAM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:21:23.550377] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-15T17:21:23.657928] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-09-15T17:21:23.678343] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-15T17:21:24.457925] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-09-15T17:21:25.035737] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-15T17:21:25.049676] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-15T17:21:25.257914] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-09-15T17:21:26.057975] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-09-15T17:21:26.857928] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-09-15T17:21:27.564790] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-15T17:21:27.614224] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-15T17:21:27.657811] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-15T17:21:27.657923] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-09-15T17:21:28.457881] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-09-15T17:21:29.007999] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-15T17:21:29.257920] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-09-15T17:21:29.867360] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-15T17:21:30.057891] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-09-15T17:21:30.685941] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-15T17:21:30.857891] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-09-15T17:21:30.925868] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-15T17:21:31.657889] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-09-15T17:21:32.272095] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T17:21:32.276772] [INFO ] [REMOTE ] BAK: Full fetch complete (42223 records). [2025-09-15T17:21:32.276943] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-09-15T17:21:32.458066] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-09-15T17:21:32.659928] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-09-15T17:21:32.660016] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-09-15T17:21:32.660490] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-09-15T17:21:32.660542] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-09-15T17:21:32.661504] [DEBUG] [LOCAL ] BAK: Trimmed 42223 records to 28792 (keeping 150 days of data) [2025-09-15T17:21:32.829375] [DEBUG] [LOCAL ] BAK: Primary data saved (28792 records). [2025-09-15T17:21:32.829525] [INFO ] [MAIN ] BAK: Full history saved. [2025-09-15T17:21:32.829611] [INFO ] [MAIN ] Update Progress: 209/2369 symbols completed. BAK took 18.3s. Estimated remaining: 3h 42m 7s. Rate: 9.7 symbols/min [2025-09-15T17:21:33.007184] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:21:33.052941] [DEBUG] [LOCAL ] BANC: Loaded 38316 existing records from primary storage. [2025-09-15T17:21:33.053099] [INFO ] [MAIN ] BANC: Loaded 38316 existing records. [2025-09-15T17:21:33.230385] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:21:33.230676] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-09-15T17:21:33.230726] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-09-15T17:21:33.231751] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-09-15T17:21:33.231806] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-09-15T17:21:33.262932] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-09-15T17:21:33.596942] [INFO ] [REMOTE ] BANC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:21:33.625623] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-15T17:21:34.057874] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-09-15T17:21:34.092605] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-15T17:21:34.137566] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T17:21:34.857889] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-09-15T17:21:35.381819] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T17:21:35.657908] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-09-15T17:21:36.232625] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-15T17:21:36.377679] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-15T17:21:36.457890] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-09-15T17:21:37.257887] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-09-15T17:21:37.909306] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-15T17:21:38.057914] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-09-15T17:21:38.731338] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-15T17:21:38.733277] [INFO ] [REMOTE ] BALY: Full fetch complete (9100 records). [2025-09-15T17:21:38.733388] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-09-15T17:21:38.862940] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-09-15T17:21:39.131673] [DEBUG] [VALIDATOR ] BALY: All expected trading days are present. [2025-09-15T17:21:39.131796] [DEBUG] [VALIDATOR ] BALY: Primary data validation passed. [2025-09-15T17:21:39.132179] [INFO ] [MAIN ] BALY: Fetched primary data is valid. [2025-09-15T17:21:39.132350] [DEBUG] [LOCAL ] BALY: Saving primary data. [2025-09-15T17:21:39.133144] [DEBUG] [LOCAL ] BALY: Trimmed 9100 records to 7145 (keeping 150 days of data) [2025-09-15T17:21:39.198399] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-15T17:21:39.218970] [DEBUG] [LOCAL ] BALY: Primary data saved (7145 records). [2025-09-15T17:21:39.219117] [INFO ] [MAIN ] BALY: Full history saved. [2025-09-15T17:21:39.219196] [INFO ] [MAIN ] Update Progress: 210/2369 symbols completed. BALY took 20.9s. Estimated remaining: 3h 42m 3s. Rate: 9.7 symbols/min [2025-09-15T17:21:39.384601] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:21:39.410220] [DEBUG] [LOCAL ] BAP: Loaded 19263 existing records from primary storage. [2025-09-15T17:21:39.410371] [INFO ] [MAIN ] BAP: Loaded 19263 existing records. [2025-09-15T17:21:39.590010] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:21:39.590309] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-09-15T17:21:39.590357] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-09-15T17:21:39.590979] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-09-15T17:21:39.591050] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-09-15T17:21:39.663195] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-09-15T17:21:39.957848] [INFO ] [REMOTE ] BAP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:21:40.457900] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-09-15T17:21:40.616601] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-15T17:21:40.890085] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-15T17:21:41.257882] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-09-15T17:21:41.435070] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-15T17:21:42.057948] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-09-15T17:21:42.857877] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-09-15T17:21:43.042007] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-15T17:21:43.070804] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-15T17:21:43.657899] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-09-15T17:21:44.457949] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-09-15T17:21:44.569758] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-15T17:21:44.682409] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-15T17:21:45.257875] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-09-15T17:21:45.932207] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-15T17:21:46.057845] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-09-15T17:21:46.663079] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-15T17:21:46.857886] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-09-15T17:21:47.383635] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-15T17:21:47.657873] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-09-15T17:21:47.851048] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T17:21:48.457921] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-09-15T17:21:48.880118] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-15T17:21:49.257867] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-09-15T17:21:49.931797] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T17:21:49.937539] [INFO ] [REMOTE ] BAM: Full fetch complete (56537 records). [2025-09-15T17:21:49.937672] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-09-15T17:21:50.062986] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-09-15T17:21:50.318456] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-09-15T17:21:50.318541] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-09-15T17:21:50.319136] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-09-15T17:21:50.319182] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-09-15T17:21:50.320340] [DEBUG] [LOCAL ] BAM: Trimmed 56537 records to 38250 (keeping 150 days of data) [2025-09-15T17:21:50.441535] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-15T17:21:50.449850] [INFO ] [REMOTE ] BALL: Full fetch complete (56479 records). [2025-09-15T17:21:50.454806] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-09-15T17:21:50.889275] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-09-15T17:21:50.938250] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-09-15T17:21:50.939100] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-09-15T17:21:50.941373] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-09-15T17:21:50.941715] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-09-15T17:21:50.947752] [DEBUG] [LOCAL ] BALL: Trimmed 56479 records to 38150 (keeping 150 days of data) [2025-09-15T17:21:51.182807] [DEBUG] [LOCAL ] BAM: Primary data saved (38250 records). [2025-09-15T17:21:51.184514] [INFO ] [MAIN ] BAM: Full history saved. [2025-09-15T17:21:51.185448] [INFO ] [MAIN ] Update Progress: 211/2369 symbols completed. BAM took 28.7s. Estimated remaining: 3h 42m 56s. Rate: 9.7 symbols/min [2025-09-15T17:21:51.384534] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:21:51.396377] [DEBUG] [LOCAL ] BALL: Primary data saved (38150 records). [2025-09-15T17:21:51.396602] [INFO ] [MAIN ] BALL: Full history saved. [2025-09-15T17:21:51.397724] [INFO ] [MAIN ] Update Progress: 212/2369 symbols completed. BALL took 34.7s. Estimated remaining: 3h 41m 49s. Rate: 9.7 symbols/min [2025-09-15T17:21:51.593638] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:21:51.596205] [DEBUG] [LOCAL ] BARK: Loaded 28961 existing records from primary storage. [2025-09-15T17:21:51.596416] [INFO ] [MAIN ] BARK: Loaded 28961 existing records. [2025-09-15T17:21:51.794117] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:21:51.794495] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-09-15T17:21:51.794591] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-09-15T17:21:51.795398] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-09-15T17:21:51.795453] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-09-15T17:21:51.915381] [DEBUG] [LOCAL ] BAX: Loaded 40292 existing records from primary storage. [2025-09-15T17:21:51.968457] [INFO ] [MAIN ] BAX: Loaded 40292 existing records. [2025-09-15T17:21:51.995184] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-15T17:21:52.171876] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-09-15T17:21:52.376494] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:21:52.380336] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-09-15T17:21:52.398039] [INFO ] [REMOTE ] BARK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:21:52.398440] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-09-15T17:21:52.404828] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-09-15T17:21:52.413893] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-09-15T17:21:52.471025] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-09-15T17:21:52.470896] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-15T17:21:52.770310] [INFO ] [REMOTE ] BAX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:21:53.257893] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-09-15T17:21:53.585498] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-15T17:21:53.807147] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-15T17:21:54.057934] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-09-15T17:21:54.548865] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-15T17:21:54.857893] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-09-15T17:21:55.063162] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-15T17:21:55.657908] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-09-15T17:21:56.457952] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-09-15T17:21:56.567368] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-15T17:21:56.953839] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-15T17:21:56.963413] [INFO ] [REMOTE ] BANC: Full fetch complete (55603 records). [2025-09-15T17:21:56.963630] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-09-15T17:21:57.265382] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-09-15T17:21:57.405026] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-09-15T17:21:57.405158] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-09-15T17:21:57.405765] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-09-15T17:21:57.405823] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-09-15T17:21:57.420970] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T17:21:57.426446] [DEBUG] [LOCAL ] BANC: Trimmed 55603 records to 37542 (keeping 150 days of data) [2025-09-15T17:21:57.657487] [DEBUG] [LOCAL ] BANC: Primary data saved (37542 records). [2025-09-15T17:21:57.657635] [INFO ] [MAIN ] BANC: Full history saved. [2025-09-15T17:21:57.659726] [INFO ] [MAIN ] Update Progress: 213/2369 symbols completed. BANC took 24.8s. Estimated remaining: 3h 41m 44s. Rate: 9.7 symbols/min [2025-09-15T17:21:57.826553] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:21:57.867225] [DEBUG] [LOCAL ] BB: Loaded 39734 existing records from primary storage. [2025-09-15T17:21:57.867369] [INFO ] [MAIN ] BB: Loaded 39734 existing records. [2025-09-15T17:21:58.045087] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:21:58.045346] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-09-15T17:21:58.045391] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-09-15T17:21:58.046290] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-09-15T17:21:58.046341] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-09-15T17:21:58.066493] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-09-15T17:21:58.394078] [INFO ] [REMOTE ] BB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:21:58.857898] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-09-15T17:21:59.101082] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-15T17:21:59.153784] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-15T17:21:59.657877] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-09-15T17:22:00.457895] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-09-15T17:22:00.783810] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-15T17:22:00.815760] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-15T17:22:01.257881] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-09-15T17:22:01.419620] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-15T17:22:01.423383] [INFO ] [REMOTE ] BAP: Full fetch complete (28650 records). [2025-09-15T17:22:01.423545] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-09-15T17:22:01.822208] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-09-15T17:22:01.822297] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-09-15T17:22:01.822702] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-09-15T17:22:01.822764] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-09-15T17:22:01.823591] [DEBUG] [LOCAL ] BAP: Trimmed 28650 records to 18874 (keeping 150 days of data) [2025-09-15T17:22:01.944447] [DEBUG] [LOCAL ] BAP: Primary data saved (18874 records). [2025-09-15T17:22:01.944610] [INFO ] [MAIN ] BAP: Full history saved. [2025-09-15T17:22:01.944757] [INFO ] [MAIN ] Update Progress: 214/2369 symbols completed. BAP took 22.7s. Estimated remaining: 3h 41m 19s. Rate: 9.7 symbols/min [2025-09-15T17:22:02.063075] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-09-15T17:22:02.123285] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:22:02.168979] [DEBUG] [LOCAL ] BBAI: Loaded 40560 existing records from primary storage. [2025-09-15T17:22:02.169134] [INFO ] [MAIN ] BBAI: Loaded 40560 existing records. [2025-09-15T17:22:02.354903] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:22:02.355184] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-09-15T17:22:02.355234] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-09-15T17:22:02.356229] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-09-15T17:22:02.356284] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-09-15T17:22:02.734068] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:22:02.822052] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T17:22:02.857821] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-09-15T17:22:03.323432] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-15T17:22:03.657874] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-09-15T17:22:04.283873] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T17:22:04.457869] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-09-15T17:22:05.257877] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-09-15T17:22:05.345440] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-15T17:22:06.057868] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-09-15T17:22:06.318714] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-15T17:22:06.857883] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-09-15T17:22:06.933535] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-09-15T17:22:07.657884] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-09-15T17:22:07.815424] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-15T17:22:07.903672] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-15T17:22:08.457853] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-09-15T17:22:09.257888] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-09-15T17:22:09.457448] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-15T17:22:10.057891] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-09-15T17:22:10.272178] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-15T17:22:10.276131] [INFO ] [REMOTE ] BARK: Full fetch complete (41914 records). [2025-09-15T17:22:10.276237] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-09-15T17:22:10.276906] [FATAL] [VALIDATOR ] BARK: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:22:10.276990] [FATAL] [MAIN ] BARK: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:22:10.277053] [WARN ] [MAIN ] BARK: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:22:10.277105] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-09-15T17:22:10.277168] [DEBUG] [LOCAL ] BARK: No primary data file found to delete. [2025-09-15T17:22:10.277207] [INFO ] [LOCAL ] BARK: Starting deletion of derivative data. [2025-09-15T17:22:10.277501] [DEBUG] [LOCAL ] BARK: Deleted derivative data file. [2025-09-15T17:22:10.277586] [INFO ] [MAIN ] Update Progress: 215/2369 symbols completed. BARK took 19.1s. Estimated remaining: 3h 41m 34s. Rate: 9.7 symbols/min [2025-09-15T17:22:10.461029] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:22:10.525740] [DEBUG] [LOCAL ] BBAR: Loaded 31093 existing records from primary storage. [2025-09-15T17:22:10.527340] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-15T17:22:10.538116] [INFO ] [MAIN ] BBAR: Loaded 31093 existing records. [2025-09-15T17:22:10.722639] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:22:10.722926] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-09-15T17:22:10.722976] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-09-15T17:22:10.723905] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-09-15T17:22:10.723959] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-09-15T17:22:10.866914] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-09-15T17:22:11.092565] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:22:11.647376] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T17:22:11.657881] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-09-15T17:22:12.457861] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-09-15T17:22:13.127905] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-15T17:22:13.257856] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-09-15T17:22:13.332729] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-15T17:22:14.057926] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-09-15T17:22:14.236432] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-15T17:22:14.754588] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-15T17:22:14.857825] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-09-15T17:22:15.657919] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-09-15T17:22:16.462983] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-09-15T17:22:16.484434] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-15T17:22:16.552381] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-15T17:22:17.257913] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-09-15T17:22:18.059145] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-09-15T17:22:18.059062] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-15T17:22:18.336430] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-15T17:22:18.857865] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-09-15T17:22:19.044100] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-09-15T17:22:19.657898] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-09-15T17:22:19.887529] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-15T17:22:20.265436] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-15T17:22:20.457866] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-09-15T17:22:21.257874] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-09-15T17:22:21.595718] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-15T17:22:21.602495] [INFO ] [REMOTE ] BAX: Full fetch complete (57770 records). [2025-09-15T17:22:21.602853] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-09-15T17:22:21.604089] [FATAL] [VALIDATOR ] BAX: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:22:21.604218] [FATAL] [MAIN ] BAX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:22:21.604265] [WARN ] [MAIN ] BAX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:22:21.604341] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-09-15T17:22:21.604440] [DEBUG] [LOCAL ] BAX: No primary data file found to delete. [2025-09-15T17:22:21.604483] [INFO ] [LOCAL ] BAX: Starting deletion of derivative data. [2025-09-15T17:22:21.604916] [DEBUG] [LOCAL ] BAX: Deleted derivative data file. [2025-09-15T17:22:21.605039] [INFO ] [MAIN ] Update Progress: 216/2369 symbols completed. BAX took 30.2s. Estimated remaining: 3h 42m 19s. Rate: 9.7 symbols/min [2025-09-15T17:22:21.794782] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:22:21.840690] [DEBUG] [LOCAL ] BBD: Loaded 40069 existing records from primary storage. [2025-09-15T17:22:21.841083] [INFO ] [MAIN ] BBD: Loaded 40069 existing records. [2025-09-15T17:22:22.031284] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:22:22.059272] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-09-15T17:22:22.060065] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-09-15T17:22:22.063462] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-09-15T17:22:22.063703] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-09-15T17:22:22.075303] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-09-15T17:22:22.075413] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-09-15T17:22:22.472294] [INFO ] [REMOTE ] BBD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:22:22.641734] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-15T17:22:22.857884] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-09-15T17:22:23.479329] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-15T17:22:23.485363] [INFO ] [REMOTE ] BB: Full fetch complete (57614 records). [2025-09-15T17:22:23.485490] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-09-15T17:22:23.664744] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-09-15T17:22:23.876574] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-09-15T17:22:23.876790] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-09-15T17:22:23.877507] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-09-15T17:22:23.877565] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-09-15T17:22:23.878838] [DEBUG] [LOCAL ] BB: Trimmed 57614 records to 38976 (keeping 150 days of data) [2025-09-15T17:22:24.113032] [DEBUG] [LOCAL ] BB: Primary data saved (38976 records). [2025-09-15T17:22:24.113186] [INFO ] [MAIN ] BB: Full history saved. [2025-09-15T17:22:24.114114] [INFO ] [MAIN ] Update Progress: 217/2369 symbols completed. BB took 26.5s. Estimated remaining: 3h 41m 37s. Rate: 9.7 symbols/min [2025-09-15T17:22:24.294359] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:22:24.319461] [DEBUG] [LOCAL ] BBDC: Loaded 23732 existing records from primary storage. [2025-09-15T17:22:24.319667] [INFO ] [MAIN ] BBDC: Loaded 23732 existing records. [2025-09-15T17:22:24.463157] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-09-15T17:22:24.505549] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:22:24.506087] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-09-15T17:22:24.506157] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-09-15T17:22:24.507039] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-09-15T17:22:24.507095] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-09-15T17:22:24.727735] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-15T17:22:24.921251] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:22:24.978131] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-15T17:22:25.257898] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-09-15T17:22:26.057927] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-09-15T17:22:26.516502] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T17:22:26.857903] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-09-15T17:22:26.958769] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-15T17:22:27.225856] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-15T17:22:27.657935] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-09-15T17:22:28.366732] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-15T17:22:28.457870] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-09-15T17:22:29.257916] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-09-15T17:22:29.877552] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-15T17:22:29.923664] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T17:22:29.928730] [INFO ] [REMOTE ] BBAR: Full fetch complete (44682 records). [2025-09-15T17:22:29.928821] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-09-15T17:22:30.070604] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-09-15T17:22:30.304437] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-09-15T17:22:30.304521] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-09-15T17:22:30.305055] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-09-15T17:22:30.305101] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-09-15T17:22:30.306128] [DEBUG] [LOCAL ] BBAR: Trimmed 44682 records to 30538 (keeping 150 days of data) [2025-09-15T17:22:30.506364] [DEBUG] [LOCAL ] BBAR: Primary data saved (30538 records). [2025-09-15T17:22:30.506519] [INFO ] [MAIN ] BBAR: Full history saved. [2025-09-15T17:22:30.506860] [INFO ] [MAIN ] Update Progress: 218/2369 symbols completed. BBAR took 20.2s. Estimated remaining: 3h 41m 33s. Rate: 9.7 symbols/min [2025-09-15T17:22:30.685343] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:22:30.691332] [DEBUG] [LOCAL ] BBDO: Loaded 3603 existing records from primary storage. [2025-09-15T17:22:30.691451] [INFO ] [MAIN ] BBDO: Loaded 3603 existing records. [2025-09-15T17:22:30.870025] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-09-15T17:22:30.874359] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:22:30.875704] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-09-15T17:22:30.875759] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-09-15T17:22:30.875999] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-09-15T17:22:30.876045] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-09-15T17:22:31.263312] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:22:31.294077] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-15T17:22:31.657914] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-09-15T17:22:31.844963] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-15T17:22:32.193835] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-15T17:22:32.457876] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-09-15T17:22:32.487195] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-15T17:22:32.493736] [INFO ] [REMOTE ] BBAI: Full fetch complete (58500 records). [2025-09-15T17:22:32.493831] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-09-15T17:22:32.872112] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-09-15T17:22:32.872210] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-09-15T17:22:32.872843] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-09-15T17:22:32.872888] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-09-15T17:22:32.874098] [DEBUG] [LOCAL ] BBAI: Trimmed 58500 records to 39780 (keeping 150 days of data) [2025-09-15T17:22:33.122400] [DEBUG] [LOCAL ] BBAI: Primary data saved (39780 records). [2025-09-15T17:22:33.122594] [INFO ] [MAIN ] BBAI: Full history saved. [2025-09-15T17:22:33.123289] [INFO ] [MAIN ] Update Progress: 219/2369 symbols completed. BBAI took 31.2s. Estimated remaining: 3h 40m 51s. Rate: 9.7 symbols/min [2025-09-15T17:22:33.263093] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-09-15T17:22:33.313029] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:22:33.329667] [DEBUG] [LOCAL ] BBN: Loaded 13604 existing records from primary storage. [2025-09-15T17:22:33.329819] [INFO ] [MAIN ] BBN: Loaded 13604 existing records. [2025-09-15T17:22:33.506045] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:22:33.506334] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-09-15T17:22:33.506382] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-09-15T17:22:33.506946] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-09-15T17:22:33.507001] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-09-15T17:22:33.866905] [INFO ] [REMOTE ] BBN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:22:34.057846] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-09-15T17:22:34.174108] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-15T17:22:34.322608] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-15T17:22:34.683298] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-15T17:22:34.857876] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-09-15T17:22:35.657946] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-09-15T17:22:35.780997] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-15T17:22:36.457879] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-09-15T17:22:37.149762] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-15T17:22:37.257892] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-09-15T17:22:37.309873] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-15T17:22:38.057911] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-09-15T17:22:38.762112] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-15T17:22:38.857871] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-09-15T17:22:39.657849] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-09-15T17:22:39.733527] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-15T17:22:39.797910] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T17:22:40.133264] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-15T17:22:40.457875] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-09-15T17:22:41.042290] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-15T17:22:41.258060] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-09-15T17:22:42.057882] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-09-15T17:22:42.606524] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-15T17:22:42.693618] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-15T17:22:42.857876] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-09-15T17:22:43.593115] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-15T17:22:43.657860] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-09-15T17:22:44.457890] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-09-15T17:22:45.257903] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-09-15T17:22:45.440058] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-15T17:22:45.447586] [INFO ] [REMOTE ] BBD: Full fetch complete (57836 records). [2025-09-15T17:22:45.447951] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-09-15T17:22:45.845366] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-09-15T17:22:45.845493] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-09-15T17:22:45.846422] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-09-15T17:22:45.846594] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-09-15T17:22:45.866293] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-15T17:22:45.873364] [DEBUG] [LOCAL ] BBD: Trimmed 57836 records to 39316 (keeping 150 days of data) [2025-09-15T17:22:46.079768] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-09-15T17:22:46.114194] [DEBUG] [LOCAL ] BBD: Primary data saved (39316 records). [2025-09-15T17:22:46.114350] [INFO ] [MAIN ] BBD: Full history saved. [2025-09-15T17:22:46.114884] [INFO ] [MAIN ] Update Progress: 220/2369 symbols completed. BBD took 24.5s. Estimated remaining: 3h 41m 52s. Rate: 9.7 symbols/min [2025-09-15T17:22:46.290869] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:22:46.296333] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-09-15T17:22:46.304038] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-09-15T17:22:46.304533] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-15T17:22:46.304941] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-09-15T17:22:46.309660] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-15T17:22:46.310051] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-15T17:22:46.310096] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-09-15T17:22:46.669209] [INFO ] [REMOTE ] BBT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:22:46.857884] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-02. [2025-09-15T17:22:47.071746] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:22:47.072059] [WARN ] [REMOTE ] BBT: No data returned for month 2025-02 [2025-09-15T17:22:47.363023] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-15T17:22:47.367794] [INFO ] [REMOTE ] BBDC: Full fetch complete (36836 records). [2025-09-15T17:22:47.367892] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-09-15T17:22:47.663089] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-09-15T17:22:47.744739] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-09-15T17:22:47.744824] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-09-15T17:22:47.745299] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-09-15T17:22:47.745340] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-09-15T17:22:47.746246] [DEBUG] [LOCAL ] BBDC: Trimmed 36836 records to 23228 (keeping 150 days of data) [2025-09-15T17:22:47.900544] [DEBUG] [LOCAL ] BBDC: Primary data saved (23228 records). [2025-09-15T17:22:47.900733] [INFO ] [MAIN ] BBDC: Full history saved. [2025-09-15T17:22:47.900835] [INFO ] [MAIN ] Update Progress: 221/2369 symbols completed. BBDC took 23.8s. Estimated remaining: 3h 41m 3s. Rate: 9.7 symbols/min [2025-09-15T17:22:48.072729] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:22:48.078095] [DEBUG] [LOCAL ] BBU: Loaded 3202 existing records from primary storage. [2025-09-15T17:22:48.078196] [INFO ] [MAIN ] BBU: Loaded 3202 existing records. [2025-09-15T17:22:48.264357] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:22:48.264666] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-09-15T17:22:48.264740] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-09-15T17:22:48.265021] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-09-15T17:22:48.265073] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-09-15T17:22:48.468247] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-03. [2025-09-15T17:22:48.648776] [INFO ] [REMOTE ] BBU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:22:48.972438] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:22:48.972879] [WARN ] [REMOTE ] BBT: No data returned for month 2025-03 [2025-09-15T17:22:48.985431] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T17:22:49.257901] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-09-15T17:22:49.663820] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-15T17:22:50.057899] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-04. [2025-09-15T17:22:50.256819] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:22:50.257235] [WARN ] [REMOTE ] BBT: No data returned for month 2025-04 [2025-09-15T17:22:50.857887] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-09-15T17:22:51.478256] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-15T17:22:51.657908] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-09-15T17:22:52.187446] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-15T17:22:52.457930] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-09-15T17:22:53.012667] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-15T17:22:53.013594] [INFO ] [REMOTE ] BBDO: Full fetch complete (5497 records). [2025-09-15T17:22:53.013680] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-09-15T17:22:53.262977] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-09-15T17:22:53.364467] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-09-15T17:22:53.364538] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-09-15T17:22:53.364720] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-09-15T17:22:53.364763] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-09-15T17:22:53.365128] [DEBUG] [LOCAL ] BBDO: Trimmed 5497 records to 3549 (keeping 150 days of data) [2025-09-15T17:22:53.386225] [DEBUG] [LOCAL ] BBDO: Primary data saved (3549 records). [2025-09-15T17:22:53.386296] [INFO ] [MAIN ] BBDO: Full history saved. [2025-09-15T17:22:53.386367] [INFO ] [MAIN ] Update Progress: 222/2369 symbols completed. BBDO took 22.9s. Estimated remaining: 3h 40m 50s. Rate: 9.7 symbols/min [2025-09-15T17:22:53.554194] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:22:53.570965] [DEBUG] [LOCAL ] BBUC: Loaded 9469 existing records from primary storage. [2025-09-15T17:22:53.571117] [INFO ] [MAIN ] BBUC: Loaded 9469 existing records. [2025-09-15T17:22:53.753269] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:22:53.753563] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-09-15T17:22:53.753627] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-09-15T17:22:53.754138] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-09-15T17:22:53.754213] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-09-15T17:22:53.864585] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-15T17:22:54.062956] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-09-15T17:22:54.127584] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:22:54.752547] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-15T17:22:54.857825] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-09-15T17:22:55.657883] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-09-15T17:22:55.894234] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-15T17:22:56.457903] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-09-15T17:22:56.546939] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-15T17:22:57.100381] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-15T17:22:57.257836] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-09-15T17:22:58.057882] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-09-15T17:22:58.196881] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-15T17:22:58.591735] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-15T17:22:58.857958] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-09-15T17:22:59.309948] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-15T17:22:59.657888] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-09-15T17:23:00.311925] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-15T17:23:00.457870] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-09-15T17:23:01.124632] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-15T17:23:01.257878] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-09-15T17:23:01.760478] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-15T17:23:02.057875] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-09-15T17:23:02.857883] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-09-15T17:23:03.657932] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-09-15T17:23:03.944165] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-15T17:23:03.946871] [INFO ] [REMOTE ] BBN: Full fetch complete (19512 records). [2025-09-15T17:23:03.946965] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-09-15T17:23:04.284232] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-15T17:23:04.375405] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-09-15T17:23:04.375532] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-09-15T17:23:04.375968] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-09-15T17:23:04.376084] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-09-15T17:23:04.384800] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-15T17:23:04.385091] [DEBUG] [LOCAL ] BBN: Trimmed 19512 records to 13404 (keeping 150 days of data) [2025-09-15T17:23:04.461420] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-09-15T17:23:04.486633] [DEBUG] [LOCAL ] BBN: Primary data saved (13404 records). [2025-09-15T17:23:04.486801] [INFO ] [MAIN ] BBN: Full history saved. [2025-09-15T17:23:04.486898] [INFO ] [MAIN ] Update Progress: 223/2369 symbols completed. BBN took 31.4s. Estimated remaining: 3h 41m 31s. Rate: 9.7 symbols/min [2025-09-15T17:23:04.660416] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:23:04.701352] [DEBUG] [LOCAL ] BBVA: Loaded 36749 existing records from primary storage. [2025-09-15T17:23:04.701501] [INFO ] [MAIN ] BBVA: Loaded 36749 existing records. [2025-09-15T17:23:04.884051] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:23:04.884322] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-09-15T17:23:04.884369] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-09-15T17:23:04.885251] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-09-15T17:23:04.885311] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-09-15T17:23:05.194772] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T17:23:05.264038] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-09-15T17:23:05.277927] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:23:05.924746] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-15T17:23:05.925983] [INFO ] [REMOTE ] BBU: Full fetch complete (4377 records). [2025-09-15T17:23:05.926057] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-09-15T17:23:05.926582] [FATAL] [VALIDATOR ] BBU: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:23:05.926711] [FATAL] [MAIN ] BBU: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:23:05.926776] [WARN ] [MAIN ] BBU: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:23:05.926839] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-09-15T17:23:05.926919] [DEBUG] [LOCAL ] BBU: No primary data file found to delete. [2025-09-15T17:23:05.927078] [INFO ] [LOCAL ] BBU: Starting deletion of derivative data. [2025-09-15T17:23:05.927377] [DEBUG] [LOCAL ] BBU: Deleted derivative data file. [2025-09-15T17:23:05.927465] [INFO ] [MAIN ] Update Progress: 224/2369 symbols completed. BBU took 18.0s. Estimated remaining: 3h 40m 40s. Rate: 9.7 symbols/min [2025-09-15T17:23:06.064838] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-05. [2025-09-15T17:23:06.095464] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:23:06.114793] [DEBUG] [LOCAL ] BBW: Loaded 19034 existing records from primary storage. [2025-09-15T17:23:06.114942] [INFO ] [MAIN ] BBW: Loaded 19034 existing records. [2025-09-15T17:23:06.293069] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:23:06.297090] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:23:06.297446] [WARN ] [REMOTE ] BBT: No data returned for month 2025-05 [2025-09-15T17:23:06.297596] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-09-15T17:23:06.298005] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-09-15T17:23:06.298604] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-09-15T17:23:06.298684] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-09-15T17:23:06.649104] [INFO ] [REMOTE ] BBW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:23:06.857881] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-09-15T17:23:07.657920] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-06. [2025-09-15T17:23:07.856938] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-15T17:23:07.862992] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:23:07.863301] [WARN ] [REMOTE ] BBT: No data returned for month 2025-06 [2025-09-15T17:23:08.457933] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-09-15T17:23:09.257889] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-15T17:23:09.257957] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-09-15T17:23:10.057928] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-07. [2025-09-15T17:23:10.534809] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:23:10.535127] [WARN ] [REMOTE ] BBT: No data returned for month 2025-07 [2025-09-15T17:23:10.552677] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-15T17:23:10.857872] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-08. [2025-09-15T17:23:11.048565] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:23:11.048947] [WARN ] [REMOTE ] BBT: No data returned for month 2025-08 [2025-09-15T17:23:11.657894] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-09-15T17:23:12.457886] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-09-15T17:23:13.257831] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-09-15T17:23:13.297364] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-15T17:23:13.335603] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-15T17:23:14.057940] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-09. [2025-09-15T17:23:14.175988] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-15T17:23:14.857884] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-09-15T17:23:15.212594] [INFO ] [REMOTE ] BBT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T17:23:15.217147] [INFO ] [REMOTE ] BBT: Full fetch complete (3064 records). [2025-09-15T17:23:15.217225] [DEBUG] [VALIDATOR ] BBT: Validating primary data. [2025-09-15T17:23:15.397449] [WARN ] [VALIDATOR ] BBT: Validation failed - insufficient historical data. Have 10 unique days, need 150 days [2025-09-15T17:23:15.397719] [FATAL] [MAIN ] BBT: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:23:15.397801] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:23:15.397871] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-15T17:23:15.397945] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-15T17:23:15.397983] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-09-15T17:23:15.398025] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-09-15T17:23:15.398100] [INFO ] [MAIN ] Update Progress: 225/2369 symbols completed. BBT took 29.3s. Estimated remaining: 3h 41m 5s. Rate: 9.7 symbols/min [2025-09-15T17:23:15.572170] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:23:15.627949] [DEBUG] [LOCAL ] BBWI: Loaded 40331 existing records from primary storage. [2025-09-15T17:23:15.628125] [INFO ] [MAIN ] BBWI: Loaded 40331 existing records. [2025-09-15T17:23:15.662973] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-09-15T17:23:15.811853] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:23:15.812381] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-09-15T17:23:15.812497] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-09-15T17:23:15.818708] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-09-15T17:23:15.827443] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-09-15T17:23:15.852703] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T17:23:16.190401] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:23:16.457911] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-09-15T17:23:16.977973] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-15T17:23:17.257941] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-09-15T17:23:17.334116] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-15T17:23:17.337286] [INFO ] [REMOTE ] BBUC: Full fetch complete (14120 records). [2025-09-15T17:23:17.337474] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-09-15T17:23:17.701420] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-09-15T17:23:17.701540] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-09-15T17:23:17.701984] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-09-15T17:23:17.702198] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-09-15T17:23:17.703627] [DEBUG] [LOCAL ] BBUC: Trimmed 14120 records to 9248 (keeping 150 days of data) [2025-09-15T17:23:17.765198] [DEBUG] [LOCAL ] BBUC: Primary data saved (9248 records). [2025-09-15T17:23:17.765366] [INFO ] [MAIN ] BBUC: Full history saved. [2025-09-15T17:23:17.765489] [INFO ] [MAIN ] Update Progress: 226/2369 symbols completed. BBUC took 24.4s. Estimated remaining: 3h 40m 22s. Rate: 9.7 symbols/min [2025-09-15T17:23:17.934054] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:23:17.978172] [DEBUG] [LOCAL ] BBY: Loaded 40251 existing records from primary storage. [2025-09-15T17:23:17.978349] [INFO ] [MAIN ] BBY: Loaded 40251 existing records. [2025-09-15T17:23:18.058431] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-09-15T17:23:18.166227] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:23:18.166582] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-09-15T17:23:18.166665] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-09-15T17:23:18.175064] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-09-15T17:23:18.188715] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-09-15T17:23:18.260721] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-15T17:23:18.551103] [INFO ] [REMOTE ] BBY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:23:18.857876] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-09-15T17:23:19.657942] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-09-15T17:23:19.813231] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-15T17:23:19.841923] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-15T17:23:20.457907] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-09-15T17:23:21.082036] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T17:23:21.257868] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-09-15T17:23:22.023517] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T17:23:22.057893] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-09-15T17:23:22.579800] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-15T17:23:22.857905] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-09-15T17:23:23.251108] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-15T17:23:23.657934] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-09-15T17:23:24.450354] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T17:23:24.459389] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-09-15T17:23:24.643451] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T17:23:24.647504] [INFO ] [REMOTE ] BBW: Full fetch complete (28462 records). [2025-09-15T17:23:24.647584] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-09-15T17:23:25.015760] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-09-15T17:23:25.015837] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-09-15T17:23:25.016206] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-09-15T17:23:25.016246] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-09-15T17:23:25.016974] [DEBUG] [LOCAL ] BBW: Trimmed 28462 records to 18611 (keeping 150 days of data) [2025-09-15T17:23:25.135844] [DEBUG] [LOCAL ] BBW: Primary data saved (18611 records). [2025-09-15T17:23:25.135994] [INFO ] [MAIN ] BBW: Full history saved. [2025-09-15T17:23:25.136095] [INFO ] [MAIN ] Update Progress: 227/2369 symbols completed. BBW took 19.2s. Estimated remaining: 3h 40m 28s. Rate: 9.7 symbols/min [2025-09-15T17:23:25.262942] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-09-15T17:23:25.321335] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:23:25.365566] [DEBUG] [LOCAL ] BC: Loaded 33445 existing records from primary storage. [2025-09-15T17:23:25.365764] [INFO ] [MAIN ] BC: Loaded 33445 existing records. [2025-09-15T17:23:25.541707] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:23:25.541982] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-09-15T17:23:25.542037] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-09-15T17:23:25.543020] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-09-15T17:23:25.543071] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-09-15T17:23:25.892110] [INFO ] [REMOTE ] BC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:23:26.012517] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T17:23:26.057848] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-09-15T17:23:26.857923] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-09-15T17:23:26.991725] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-15T17:23:27.658005] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-09-15T17:23:27.896364] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-15T17:23:28.144994] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-15T17:23:28.457877] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-09-15T17:23:29.042214] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T17:23:29.257951] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-09-15T17:23:29.694547] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-15T17:23:30.057917] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-09-15T17:23:30.857954] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-09-15T17:23:31.069130] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-15T17:23:31.398717] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T17:23:31.657936] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-09-15T17:23:32.457958] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-09-15T17:23:32.616303] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-15T17:23:33.258351] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-09-15T17:23:33.265487] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-15T17:23:33.620515] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-15T17:23:34.057927] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-09-15T17:23:34.857881] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-09-15T17:23:34.951007] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-15T17:23:35.264036] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T17:23:35.657891] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-09-15T17:23:36.457907] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-09-15T17:23:36.651824] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-15T17:23:37.227626] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T17:23:37.257826] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-09-15T17:23:37.741728] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-15T17:23:37.747753] [INFO ] [REMOTE ] BBVA: Full fetch complete (53886 records). [2025-09-15T17:23:37.747859] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-09-15T17:23:38.063020] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-09-15T17:23:38.123833] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-09-15T17:23:38.123911] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-09-15T17:23:38.124488] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-09-15T17:23:38.124540] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-09-15T17:23:38.125901] [DEBUG] [LOCAL ] BBVA: Trimmed 53886 records to 36011 (keeping 150 days of data) [2025-09-15T17:23:38.350374] [DEBUG] [LOCAL ] BBVA: Primary data saved (36011 records). [2025-09-15T17:23:38.350539] [INFO ] [MAIN ] BBVA: Full history saved. [2025-09-15T17:23:38.353036] [INFO ] [MAIN ] Update Progress: 228/2369 symbols completed. BBVA took 33.9s. Estimated remaining: 3h 41m 28s. Rate: 9.7 symbols/min [2025-09-15T17:23:38.522823] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:23:38.552237] [DEBUG] [LOCAL ] BCAT: Loaded 25422 existing records from primary storage. [2025-09-15T17:23:38.552388] [INFO ] [MAIN ] BCAT: Loaded 25422 existing records. [2025-09-15T17:23:38.726833] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:23:38.727107] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-09-15T17:23:38.727153] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-09-15T17:23:38.727848] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-09-15T17:23:38.727900] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-09-15T17:23:38.865598] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-09-15T17:23:39.081568] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:23:39.113145] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-15T17:23:39.210858] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-15T17:23:39.657884] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-09-15T17:23:40.457891] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-09-15T17:23:40.939771] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-15T17:23:40.967892] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-15T17:23:40.974017] [INFO ] [REMOTE ] BBWI: Full fetch complete (58231 records). [2025-09-15T17:23:40.974165] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-09-15T17:23:41.266370] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-09-15T17:23:41.363187] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-09-15T17:23:41.363314] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-09-15T17:23:41.364023] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-09-15T17:23:41.364074] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-09-15T17:23:41.365474] [DEBUG] [LOCAL ] BBWI: Trimmed 58231 records to 39551 (keeping 150 days of data) [2025-09-15T17:23:41.617550] [DEBUG] [LOCAL ] BBWI: Primary data saved (39551 records). [2025-09-15T17:23:41.617730] [INFO ] [MAIN ] BBWI: Full history saved. [2025-09-15T17:23:41.619459] [INFO ] [MAIN ] Update Progress: 229/2369 symbols completed. BBWI took 26.2s. Estimated remaining: 3h 40m 54s. Rate: 9.7 symbols/min [2025-09-15T17:23:41.790888] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:23:41.812728] [DEBUG] [LOCAL ] BCC: Loaded 20555 existing records from primary storage. [2025-09-15T17:23:41.812915] [INFO ] [MAIN ] BCC: Loaded 20555 existing records. [2025-09-15T17:23:41.993994] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:23:41.994342] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-09-15T17:23:41.994417] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-09-15T17:23:42.001413] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-09-15T17:23:42.013045] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-09-15T17:23:42.070272] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-09-15T17:23:42.081262] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T17:23:42.392599] [INFO ] [REMOTE ] BCC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:23:42.681092] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T17:23:42.857938] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-09-15T17:23:43.112185] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T17:23:43.117075] [INFO ] [REMOTE ] BC: Full fetch complete (48513 records). [2025-09-15T17:23:43.117204] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-09-15T17:23:43.666519] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-09-15T17:23:43.670491] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-09-15T17:23:43.670601] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-09-15T17:23:43.671350] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-09-15T17:23:43.671433] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-09-15T17:23:43.672973] [DEBUG] [LOCAL ] BC: Trimmed 48513 records to 32606 (keeping 150 days of data) [2025-09-15T17:23:43.923754] [DEBUG] [LOCAL ] BC: Primary data saved (32606 records). [2025-09-15T17:23:43.923919] [INFO ] [MAIN ] BC: Full history saved. [2025-09-15T17:23:43.924014] [INFO ] [MAIN ] Update Progress: 230/2369 symbols completed. BC took 18.8s. Estimated remaining: 3h 40m 11s. Rate: 9.7 symbols/min [2025-09-15T17:23:44.110141] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:23:44.149474] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-15T17:23:44.203217] [DEBUG] [LOCAL ] BCE: Loaded 39338 existing records from primary storage. [2025-09-15T17:23:44.203392] [INFO ] [MAIN ] BCE: Loaded 39338 existing records. [2025-09-15T17:23:44.378686] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:23:44.378920] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-09-15T17:23:44.378965] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-09-15T17:23:44.380061] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-09-15T17:23:44.380114] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-09-15T17:23:44.468077] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-09-15T17:23:44.730753] [INFO ] [REMOTE ] BCE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:23:45.067316] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T17:23:45.257880] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-09-15T17:23:45.418438] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-15T17:23:46.057871] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-09-15T17:23:46.857905] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-09-15T17:23:46.974329] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-15T17:23:47.467488] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-15T17:23:47.657910] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-09-15T17:23:47.842784] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-15T17:23:48.457909] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-09-15T17:23:49.014097] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T17:23:49.257947] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-09-15T17:23:49.772278] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-15T17:23:50.057876] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-09-15T17:23:50.197071] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-15T17:23:50.857943] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-09-15T17:23:51.284300] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T17:23:51.657936] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-09-15T17:23:52.290138] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T17:23:52.298347] [INFO ] [REMOTE ] BBY: Full fetch complete (57694 records). [2025-09-15T17:23:52.298549] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-09-15T17:23:52.299529] [FATAL] [VALIDATOR ] BBY: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:23:52.299674] [FATAL] [MAIN ] BBY: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:23:52.299740] [WARN ] [MAIN ] BBY: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:23:52.299805] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-09-15T17:23:52.299942] [DEBUG] [LOCAL ] BBY: No primary data file found to delete. [2025-09-15T17:23:52.300006] [INFO ] [LOCAL ] BBY: Starting deletion of derivative data. [2025-09-15T17:23:52.300364] [DEBUG] [LOCAL ] BBY: Deleted derivative data file. [2025-09-15T17:23:52.300856] [INFO ] [MAIN ] Update Progress: 231/2369 symbols completed. BBY took 34.5s. Estimated remaining: 3h 40m 26s. Rate: 9.7 symbols/min [2025-09-15T17:23:52.473059] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-09-15T17:23:52.510240] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:23:52.537569] [DEBUG] [LOCAL ] BCH: Loaded 21766 existing records from primary storage. [2025-09-15T17:23:52.538002] [INFO ] [MAIN ] BCH: Loaded 21766 existing records. [2025-09-15T17:23:52.714599] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:23:52.714912] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-09-15T17:23:52.714960] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-09-15T17:23:52.715573] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-09-15T17:23:52.715625] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-09-15T17:23:53.066536] [INFO ] [REMOTE ] BCH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:23:53.257884] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-09-15T17:23:53.394543] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-15T17:23:53.882779] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-15T17:23:54.057884] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-09-15T17:23:54.086418] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-15T17:23:54.857913] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-09-15T17:23:55.657898] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-09-15T17:23:55.816757] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T17:23:56.246990] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-15T17:23:56.457894] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-09-15T17:23:56.515550] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T17:23:57.257920] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-09-15T17:23:58.057927] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-09-15T17:23:58.209706] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-15T17:23:58.416356] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-15T17:23:58.857880] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-09-15T17:23:58.959978] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T17:23:59.657847] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-09-15T17:24:00.120759] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-15T17:24:00.457885] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-09-15T17:24:01.070699] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-15T17:24:01.257892] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-09-15T17:24:02.057876] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-09-15T17:24:02.419916] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-15T17:24:02.492988] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T17:24:02.857865] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-09-15T17:24:03.657881] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-09-15T17:24:04.306330] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-15T17:24:04.457853] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-09-15T17:24:04.752948] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-15T17:24:05.208070] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-15T17:24:05.257832] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-09-15T17:24:05.346630] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-15T17:24:05.349861] [INFO ] [REMOTE ] BCC: Full fetch complete (31023 records). [2025-09-15T17:24:05.349946] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-09-15T17:24:05.711903] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-09-15T17:24:05.711984] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-09-15T17:24:05.712385] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-09-15T17:24:05.712425] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-09-15T17:24:05.713261] [DEBUG] [LOCAL ] BCC: Trimmed 31023 records to 20178 (keeping 150 days of data) [2025-09-15T17:24:05.845608] [DEBUG] [LOCAL ] BCC: Primary data saved (20178 records). [2025-09-15T17:24:05.845776] [INFO ] [MAIN ] BCC: Full history saved. [2025-09-15T17:24:05.845867] [INFO ] [MAIN ] Update Progress: 232/2369 symbols completed. BCC took 24.2s. Estimated remaining: 3h 41m 27s. Rate: 9.6 symbols/min [2025-09-15T17:24:06.017595] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:24:06.038105] [DEBUG] [LOCAL ] BCO: Loaded 19472 existing records from primary storage. [2025-09-15T17:24:06.038284] [INFO ] [MAIN ] BCO: Loaded 19472 existing records. [2025-09-15T17:24:06.063012] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-09-15T17:24:06.218767] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:24:06.218999] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-09-15T17:24:06.219043] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-09-15T17:24:06.219725] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-09-15T17:24:06.219776] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-09-15T17:24:06.588070] [INFO ] [REMOTE ] BCO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:24:06.857886] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-09-15T17:24:07.010611] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-15T17:24:07.121980] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-15T17:24:07.657875] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-09-15T17:24:07.748434] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-15T17:24:08.457940] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-09-15T17:24:08.681597] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-15T17:24:09.257883] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-09-15T17:24:09.878527] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-15T17:24:09.884390] [INFO ] [REMOTE ] BCE: Full fetch complete (57001 records). [2025-09-15T17:24:09.884515] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-09-15T17:24:10.061614] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-09-15T17:24:10.272269] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-09-15T17:24:10.272372] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-09-15T17:24:10.273061] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-09-15T17:24:10.273116] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-09-15T17:24:10.274454] [DEBUG] [LOCAL ] BCE: Trimmed 57001 records to 38550 (keeping 150 days of data) [2025-09-15T17:24:10.395146] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-15T17:24:10.544160] [DEBUG] [LOCAL ] BCE: Primary data saved (38550 records). [2025-09-15T17:24:10.544501] [INFO ] [MAIN ] BCE: Full history saved. [2025-09-15T17:24:10.546034] [INFO ] [MAIN ] Update Progress: 233/2369 symbols completed. BCE took 26.6s. Estimated remaining: 3h 41m 7s. Rate: 9.7 symbols/min [2025-09-15T17:24:10.716207] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:24:10.759823] [DEBUG] [LOCAL ] BCS: Loaded 40235 existing records from primary storage. [2025-09-15T17:24:10.759968] [INFO ] [MAIN ] BCS: Loaded 40235 existing records. [2025-09-15T17:24:10.860707] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-09-15T17:24:10.947522] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:24:10.947863] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-09-15T17:24:10.947917] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-09-15T17:24:10.949089] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-09-15T17:24:10.949149] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-09-15T17:24:11.308733] [INFO ] [REMOTE ] BCS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:24:11.320243] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T17:24:11.324611] [INFO ] [REMOTE ] BCAT: Full fetch complete (37512 records). [2025-09-15T17:24:11.324832] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-09-15T17:24:11.664000] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-09-15T17:24:11.704084] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-09-15T17:24:11.704181] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-09-15T17:24:11.704743] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-09-15T17:24:11.704793] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-09-15T17:24:11.705945] [DEBUG] [LOCAL ] BCAT: Trimmed 37512 records to 25058 (keeping 150 days of data) [2025-09-15T17:24:11.873554] [DEBUG] [LOCAL ] BCAT: Primary data saved (25058 records). [2025-09-15T17:24:11.873711] [INFO ] [MAIN ] BCAT: Full history saved. [2025-09-15T17:24:11.873798] [INFO ] [MAIN ] Update Progress: 234/2369 symbols completed. BCAT took 33.5s. Estimated remaining: 3h 40m 16s. Rate: 9.7 symbols/min [2025-09-15T17:24:12.051168] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:24:12.071158] [DEBUG] [LOCAL ] BCSF: Loaded 19447 existing records from primary storage. [2025-09-15T17:24:12.071293] [INFO ] [MAIN ] BCSF: Loaded 19447 existing records. [2025-09-15T17:24:12.247339] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:24:12.247717] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-09-15T17:24:12.247818] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-09-15T17:24:12.248390] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-09-15T17:24:12.248441] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-09-15T17:24:12.461881] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-09-15T17:24:12.526683] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T17:24:12.678269] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:24:13.194322] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-15T17:24:13.257866] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-09-15T17:24:14.057914] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-09-15T17:24:14.337770] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-15T17:24:14.341303] [INFO ] [REMOTE ] BCH: Full fetch complete (31906 records). [2025-09-15T17:24:14.341395] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-09-15T17:24:14.740481] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-09-15T17:24:14.740584] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-09-15T17:24:14.741081] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-09-15T17:24:14.741130] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-09-15T17:24:14.742102] [DEBUG] [LOCAL ] BCH: Trimmed 31906 records to 21393 (keeping 150 days of data) [2025-09-15T17:24:14.858354] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-09-15T17:24:14.889750] [DEBUG] [LOCAL ] BCH: Primary data saved (21393 records). [2025-09-15T17:24:14.889874] [INFO ] [MAIN ] BCH: Full history saved. [2025-09-15T17:24:14.889958] [INFO ] [MAIN ] Update Progress: 235/2369 symbols completed. BCH took 22.6s. Estimated remaining: 3h 39m 41s. Rate: 9.7 symbols/min [2025-09-15T17:24:15.078789] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:24:15.095507] [DEBUG] [LOCAL ] BCX: Loaded 15656 existing records from primary storage. [2025-09-15T17:24:15.095662] [INFO ] [MAIN ] BCX: Loaded 15656 existing records. [2025-09-15T17:24:15.295603] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:24:15.312104] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-15T17:24:15.310856] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-09-15T17:24:15.322926] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-09-15T17:24:15.323996] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-09-15T17:24:15.324064] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-09-15T17:24:15.661933] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-09-15T17:24:15.715017] [INFO ] [REMOTE ] BCX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:24:15.719047] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T17:24:15.747196] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-15T17:24:16.457892] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-09-15T17:24:17.257893] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-09-15T17:24:17.375048] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-15T17:24:17.575808] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-15T17:24:18.057887] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-09-15T17:24:18.329001] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-15T17:24:18.775883] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-15T17:24:18.857939] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-09-15T17:24:19.657871] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-09-15T17:24:20.006518] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-15T17:24:20.457837] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-09-15T17:24:20.506551] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-15T17:24:21.257868] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-09-15T17:24:21.619904] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-15T17:24:22.057874] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-09-15T17:24:22.857845] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-09-15T17:24:23.016636] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-15T17:24:23.038668] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-15T17:24:23.478240] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-15T17:24:23.657883] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-09-15T17:24:24.457879] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-09-15T17:24:25.257891] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-09-15T17:24:26.057986] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-09-15T17:24:26.252827] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-15T17:24:26.423767] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-15T17:24:26.583487] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (2.93 seconds). [2025-09-15T17:24:26.857873] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-09-15T17:24:26.924331] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-15T17:24:27.598792] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-15T17:24:27.657891] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-09-15T17:24:28.457924] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-09-15T17:24:28.799186] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-15T17:24:29.257892] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-09-15T17:24:29.532844] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-15T17:24:30.025377] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T17:24:30.028372] [INFO ] [REMOTE ] BCO: Full fetch complete (28707 records). [2025-09-15T17:24:30.028481] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-09-15T17:24:30.062934] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-09-15T17:24:30.402341] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-09-15T17:24:30.402427] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-09-15T17:24:30.402906] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-09-15T17:24:30.402956] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-09-15T17:24:30.403657] [DEBUG] [LOCAL ] BCO: Trimmed 28707 records to 19118 (keeping 150 days of data) [2025-09-15T17:24:30.521312] [DEBUG] [LOCAL ] BCO: Primary data saved (19118 records). [2025-09-15T17:24:30.521452] [INFO ] [MAIN ] BCO: Full history saved. [2025-09-15T17:24:30.521552] [INFO ] [MAIN ] Update Progress: 236/2369 symbols completed. BCO took 24.7s. Estimated remaining: 3h 41m 1s. Rate: 9.7 symbols/min [2025-09-15T17:24:30.688978] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:24:30.707585] [DEBUG] [LOCAL ] BDC: Loaded 17994 existing records from primary storage. [2025-09-15T17:24:30.707720] [INFO ] [MAIN ] BDC: Loaded 17994 existing records. [2025-09-15T17:24:30.877396] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-09-15T17:24:30.881699] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:24:30.882634] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-09-15T17:24:30.882703] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-09-15T17:24:30.883217] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-09-15T17:24:30.883335] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-09-15T17:24:31.236964] [INFO ] [REMOTE ] BDC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:24:31.657893] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-09-15T17:24:32.049767] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-15T17:24:32.141244] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T17:24:32.457884] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-09-15T17:24:32.916139] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-15T17:24:33.257880] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-09-15T17:24:34.057837] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-09-15T17:24:34.376676] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-15T17:24:34.395589] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-15T17:24:34.398763] [INFO ] [REMOTE ] BCSF: Full fetch complete (29645 records). [2025-09-15T17:24:34.398835] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-09-15T17:24:34.763509] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-09-15T17:24:34.763582] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-09-15T17:24:34.763977] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-09-15T17:24:34.764020] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-09-15T17:24:34.764775] [DEBUG] [LOCAL ] BCSF: Trimmed 29645 records to 19270 (keeping 150 days of data) [2025-09-15T17:24:34.858247] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-09-15T17:24:34.888282] [DEBUG] [LOCAL ] BCSF: Primary data saved (19270 records). [2025-09-15T17:24:34.888441] [INFO ] [MAIN ] BCSF: Full history saved. [2025-09-15T17:24:34.888561] [INFO ] [MAIN ] Update Progress: 237/2369 symbols completed. BCSF took 23.0s. Estimated remaining: 3h 40m 38s. Rate: 9.7 symbols/min [2025-09-15T17:24:34.909676] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-15T17:24:35.657909] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-09-15T17:24:35.809720] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T17:24:36.457835] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-09-15T17:24:36.570434] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-15T17:24:37.257915] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-09-15T17:24:38.057857] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-09-15T17:24:38.183637] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-15T17:24:38.189115] [INFO ] [REMOTE ] BCS: Full fetch complete (57740 records). [2025-09-15T17:24:38.189218] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-09-15T17:24:38.190054] [FATAL] [VALIDATOR ] BCS: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:24:38.190138] [FATAL] [MAIN ] BCS: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:24:38.190176] [WARN ] [MAIN ] BCS: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:24:38.190235] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-09-15T17:24:38.190301] [DEBUG] [LOCAL ] BCS: No primary data file found to delete. [2025-09-15T17:24:38.190350] [INFO ] [LOCAL ] BCS: Starting deletion of derivative data. [2025-09-15T17:24:38.190692] [DEBUG] [LOCAL ] BCS: Deleted derivative data file. [2025-09-15T17:24:38.191682] [INFO ] [MAIN ] Update Progress: 238/2369 symbols completed. BCS took 27.6s. Estimated remaining: 3h 40m 6s. Rate: 9.7 symbols/min [2025-09-15T17:24:38.421119] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-15T17:24:38.806803] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-15T17:24:38.809406] [INFO ] [REMOTE ] BCX: Full fetch complete (24201 records). [2025-09-15T17:24:38.809493] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-09-15T17:24:38.866892] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-09-15T17:24:39.200455] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-09-15T17:24:39.200534] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-09-15T17:24:39.200939] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-09-15T17:24:39.201019] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-09-15T17:24:39.201684] [DEBUG] [LOCAL ] BCX: Trimmed 24201 records to 15307 (keeping 150 days of data) [2025-09-15T17:24:39.293654] [DEBUG] [LOCAL ] BCX: Primary data saved (15307 records). [2025-09-15T17:24:39.293794] [INFO ] [MAIN ] BCX: Full history saved. [2025-09-15T17:24:39.293884] [INFO ] [MAIN ] Update Progress: 239/2369 symbols completed. BCX took 24.4s. Estimated remaining: 3h 39m 14s. Rate: 9.7 symbols/min [2025-09-15T17:24:39.967362] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-15T17:24:39.972449] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-09-15T17:24:41.241146] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-15T17:24:41.247102] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-09-15T17:24:42.457566] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T17:24:42.463541] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-09-15T17:24:43.667370] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-15T17:24:43.670303] [INFO ] [REMOTE ] BDC: Full fetch complete (27326 records). [2025-09-15T17:24:43.670397] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-09-15T17:24:44.050008] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-09-15T17:24:44.050114] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-09-15T17:24:44.050710] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-09-15T17:24:44.050766] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-09-15T17:24:44.051810] [DEBUG] [LOCAL ] BDC: Trimmed 27326 records to 17657 (keeping 150 days of data) [2025-09-15T17:24:44.175459] [DEBUG] [LOCAL ] BDC: Primary data saved (17657 records). [2025-09-15T17:24:44.175732] [INFO ] [MAIN ] BDC: Full history saved. [2025-09-15T17:24:44.175901] [INFO ] [MAIN ] Update Progress: 240/2369 symbols completed. BDC took 13.7s. Estimated remaining: 3h 38m 56s. Rate: 9.7 symbols/min [2025-09-15T17:24:44.857398] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:24:44.912367] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:24:44.937604] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:24:44.939088] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:24:44.964927] [DEBUG] [LOCAL ] BDJ: Loaded 21798 existing records from primary storage. [2025-09-15T17:24:44.976766] [INFO ] [MAIN ] BDJ: Loaded 21798 existing records. [2025-09-15T17:24:45.135340] [DEBUG] [LOCAL ] BE: Loaded 40401 existing records from primary storage. [2025-09-15T17:24:45.214785] [DEBUG] [LOCAL ] BDX: Loaded 39715 existing records from primary storage. [2025-09-15T17:24:45.213947] [INFO ] [MAIN ] BE: Loaded 40401 existing records. [2025-09-15T17:24:45.226307] [INFO ] [MAIN ] BDX: Loaded 39715 existing records. [2025-09-15T17:24:45.215423] [DEBUG] [LOCAL ] BDN: Loaded 35556 existing records from primary storage. [2025-09-15T17:24:45.214178] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:24:45.236039] [INFO ] [MAIN ] BDN: Loaded 35556 existing records. [2025-09-15T17:24:45.339820] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-09-15T17:24:45.439553] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-09-15T17:24:45.525207] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-09-15T17:24:45.597019] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-09-15T17:24:45.640614] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:24:45.772813] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-09-15T17:24:45.793489] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:24:45.844500] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-09-15T17:24:45.882570] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-09-15T17:24:45.882715] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:24:45.896854] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-09-15T17:24:45.897144] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-09-15T17:24:45.897110] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-09-15T17:24:45.897202] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-09-15T17:24:45.942269] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-09-15T17:24:46.023010] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-09-15T17:24:46.028198] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-09-15T17:24:46.039033] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-09-15T17:24:46.105281] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-09-15T17:24:46.681865] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:24:46.706335] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-09-15T17:24:47.063034] [INFO ] [REMOTE ] BE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:24:47.074774] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-09-15T17:24:47.189115] [INFO ] [REMOTE ] BDX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:24:47.214904] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-09-15T17:24:47.254317] [INFO ] [REMOTE ] BDN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:24:47.254693] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-09-15T17:24:48.108421] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T17:24:48.114421] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-09-15T17:24:48.723075] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-15T17:24:48.732971] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-09-15T17:24:48.773044] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T17:24:48.784116] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-09-15T17:24:48.815767] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T17:24:48.825678] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-09-15T17:24:49.305431] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-15T17:24:49.311807] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-09-15T17:24:50.176621] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T17:24:50.187200] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-09-15T17:24:50.391034] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-15T17:24:50.402505] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-09-15T17:24:50.500090] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-15T17:24:50.609177] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-15T17:24:50.857930] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-09-15T17:24:51.496176] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-15T17:24:51.657884] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-09-15T17:24:52.165360] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T17:24:52.457934] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-09-15T17:24:52.542158] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-15T17:24:52.868754] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-15T17:24:53.257909] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-09-15T17:24:53.675300] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-15T17:24:54.057945] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-09-15T17:24:54.857873] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-09-15T17:24:55.265217] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-15T17:24:55.474212] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-15T17:24:55.657897] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-09-15T17:24:56.460210] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-09-15T17:24:56.468901] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T17:24:56.850990] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T17:24:57.257946] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-09-15T17:24:58.069417] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-09-15T17:24:58.075730] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-15T17:24:58.857848] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-09-15T17:24:59.134600] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-15T17:24:59.573716] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T17:24:59.657915] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-09-15T17:25:00.457890] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-09-15T17:25:00.749524] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-15T17:25:00.855428] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-15T17:25:01.257887] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-09-15T17:25:02.057923] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-09-15T17:25:02.142715] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T17:25:02.857877] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-09-15T17:25:02.873573] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-15T17:25:02.879290] [INFO ] [REMOTE ] BDN: Full fetch complete (51744 records). [2025-09-15T17:25:02.879414] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-09-15T17:25:03.292069] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-09-15T17:25:03.292208] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-09-15T17:25:03.292850] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-09-15T17:25:03.292907] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-09-15T17:25:03.299508] [DEBUG] [LOCAL ] BDN: Trimmed 51744 records to 34811 (keeping 150 days of data) [2025-09-15T17:25:03.309909] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-15T17:25:03.517582] [DEBUG] [LOCAL ] BDN: Primary data saved (34811 records). [2025-09-15T17:25:03.517766] [INFO ] [MAIN ] BDN: Full history saved. [2025-09-15T17:25:03.517855] [INFO ] [MAIN ] Update Progress: 241/2369 symbols completed. BDN took 19.3s. Estimated remaining: 3h 40m 46s. Rate: 9.6 symbols/min [2025-09-15T17:25:03.668344] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-09-15T17:25:03.694576] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:25:03.694853] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-09-15T17:25:03.694919] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-09-15T17:25:03.695297] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-09-15T17:25:03.695343] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-15T17:25:03.695383] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-15T17:25:03.695423] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-09-15T17:25:04.050680] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:25:04.418629] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-15T17:25:04.427072] [INFO ] [REMOTE ] BDX: Full fetch complete (56920 records). [2025-09-15T17:25:04.427223] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-09-15T17:25:04.462965] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-09-15T17:25:04.829238] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-09-15T17:25:04.829394] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-09-15T17:25:04.830119] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-09-15T17:25:04.830189] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-09-15T17:25:04.856528] [DEBUG] [LOCAL ] BDX: Trimmed 56920 records to 38949 (keeping 150 days of data) [2025-09-15T17:25:04.856359] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-15T17:25:04.964974] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-15T17:25:05.127516] [DEBUG] [LOCAL ] BDX: Primary data saved (38949 records). [2025-09-15T17:25:05.127697] [INFO ] [MAIN ] BDX: Full history saved. [2025-09-15T17:25:05.127804] [INFO ] [MAIN ] Update Progress: 242/2369 symbols completed. BDX took 20.9s. Estimated remaining: 3h 39m 60s. Rate: 9.7 symbols/min [2025-09-15T17:25:05.273328] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-09-15T17:25:05.307445] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:25:05.347308] [DEBUG] [LOCAL ] BEKE: Loaded 40023 existing records from primary storage. [2025-09-15T17:25:05.347464] [INFO ] [MAIN ] BEKE: Loaded 40023 existing records. [2025-09-15T17:25:05.528878] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:25:05.529151] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-09-15T17:25:05.529200] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-09-15T17:25:05.530222] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-09-15T17:25:05.530275] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-09-15T17:25:05.888283] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:25:06.057965] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-09-15T17:25:06.382256] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-15T17:25:06.857960] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-09-15T17:25:07.101522] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-15T17:25:07.273507] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-15T17:25:07.657976] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-09-15T17:25:08.457923] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-09-15T17:25:09.257898] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-09-15T17:25:09.550338] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-15T17:25:09.556826] [INFO ] [REMOTE ] BE: Full fetch complete (58322 records). [2025-09-15T17:25:09.556960] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-09-15T17:25:09.647939] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-15T17:25:09.949147] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-09-15T17:25:09.949227] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-09-15T17:25:09.949854] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-09-15T17:25:09.949898] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-09-15T17:25:09.951194] [DEBUG] [LOCAL ] BE: Trimmed 58322 records to 39622 (keeping 150 days of data) [2025-09-15T17:25:10.057984] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-09-15T17:25:10.224518] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-15T17:25:10.256296] [DEBUG] [LOCAL ] BE: Primary data saved (39622 records). [2025-09-15T17:25:10.256468] [INFO ] [MAIN ] BE: Full history saved. [2025-09-15T17:25:10.256594] [INFO ] [MAIN ] Update Progress: 243/2369 symbols completed. BE took 26.1s. Estimated remaining: 3h 39m 44s. Rate: 9.7 symbols/min [2025-09-15T17:25:10.429921] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:25:10.469298] [DEBUG] [LOCAL ] BEN: Loaded 39969 existing records from primary storage. [2025-09-15T17:25:10.469455] [INFO ] [MAIN ] BEN: Loaded 39969 existing records. [2025-09-15T17:25:10.642990] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:25:10.643283] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-09-15T17:25:10.643331] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-09-15T17:25:10.644614] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-09-15T17:25:10.644721] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-09-15T17:25:10.863211] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-09-15T17:25:11.012841] [INFO ] [REMOTE ] BEN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:25:11.041375] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-15T17:25:11.657906] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-09-15T17:25:12.457916] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-09-15T17:25:12.703583] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-15T17:25:12.866503] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-15T17:25:12.871530] [INFO ] [REMOTE ] BDJ: Full fetch complete (31749 records). [2025-09-15T17:25:12.871670] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-09-15T17:25:13.252904] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-09-15T17:25:13.252991] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-09-15T17:25:13.253410] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-09-15T17:25:13.253451] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-09-15T17:25:13.254362] [DEBUG] [LOCAL ] BDJ: Trimmed 31749 records to 21245 (keeping 150 days of data) [2025-09-15T17:25:13.257941] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-09-15T17:25:13.391218] [DEBUG] [LOCAL ] BDJ: Primary data saved (21245 records). [2025-09-15T17:25:13.391381] [INFO ] [MAIN ] BDJ: Full history saved. [2025-09-15T17:25:13.391497] [INFO ] [MAIN ] Update Progress: 244/2369 symbols completed. BDJ took 29.2s. Estimated remaining: 3h 39m 11s. Rate: 9.7 symbols/min [2025-09-15T17:25:13.581171] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-15T17:25:13.603713] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:25:13.643530] [DEBUG] [LOCAL ] BEP: Loaded 28134 existing records from primary storage. [2025-09-15T17:25:13.643810] [INFO ] [MAIN ] BEP: Loaded 28134 existing records. [2025-09-15T17:25:13.805552] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T17:25:13.871855] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:25:13.872166] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-09-15T17:25:13.872226] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-09-15T17:25:13.873006] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-09-15T17:25:13.873067] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-09-15T17:25:14.058521] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-09-15T17:25:14.246770] [INFO ] [REMOTE ] BEP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:25:14.467901] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-15T17:25:14.857874] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-09-15T17:25:15.179370] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-15T17:25:15.657881] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-09-15T17:25:16.457939] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-09-15T17:25:16.790814] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-15T17:25:16.791539] [INFO ] [REMOTE ] BEDU: Full fetch complete (925 records). [2025-09-15T17:25:16.791608] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-09-15T17:25:16.979515] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 122 unique days, need 150 days [2025-09-15T17:25:16.979820] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:25:16.979901] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:25:16.979980] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-15T17:25:16.980065] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-15T17:25:16.980111] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-09-15T17:25:16.980162] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-09-15T17:25:16.980226] [INFO ] [MAIN ] Update Progress: 245/2369 symbols completed. BEDU took 13.5s. Estimated remaining: 3h 38m 42s. Rate: 9.7 symbols/min [2025-09-15T17:25:17.155538] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:25:17.199661] [DEBUG] [LOCAL ] BEPC: Loaded 34353 existing records from primary storage. [2025-09-15T17:25:17.199846] [INFO ] [MAIN ] BEPC: Loaded 34353 existing records. [2025-09-15T17:25:17.270608] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-09-15T17:25:17.402668] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:25:17.402961] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-09-15T17:25:17.403114] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-09-15T17:25:17.404016] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-09-15T17:25:17.404070] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-09-15T17:25:17.663735] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-15T17:25:17.826722] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:25:18.057891] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-09-15T17:25:18.534332] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-15T17:25:18.857945] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-09-15T17:25:19.218472] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T17:25:19.657895] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-09-15T17:25:20.457896] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-09-15T17:25:20.717404] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-15T17:25:21.257990] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-09-15T17:25:21.296823] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T17:25:22.057880] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-09-15T17:25:22.114939] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-15T17:25:22.847757] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-15T17:25:22.858438] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-09-15T17:25:23.551513] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T17:25:23.657927] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-09-15T17:25:24.025584] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-15T17:25:24.457978] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-09-15T17:25:25.257896] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-09-15T17:25:25.389155] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-15T17:25:25.915933] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-15T17:25:26.057838] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-09-15T17:25:26.461461] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-15T17:25:26.857902] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-09-15T17:25:27.372071] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T17:25:27.657878] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-09-15T17:25:28.457925] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-09-15T17:25:28.580914] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-15T17:25:28.981404] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-15T17:25:29.257916] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-09-15T17:25:29.647214] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-15T17:25:30.057867] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-09-15T17:25:30.608793] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T17:25:30.857877] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-09-15T17:25:31.456343] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-15T17:25:31.657860] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-09-15T17:25:32.143932] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T17:25:32.457944] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-09-15T17:25:33.185892] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-15T17:25:33.257825] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-09-15T17:25:34.057918] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-09-15T17:25:34.253594] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-15T17:25:34.386888] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-15T17:25:34.857924] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-09-15T17:25:35.409389] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T17:25:35.415190] [INFO ] [REMOTE ] BEN: Full fetch complete (57720 records). [2025-09-15T17:25:35.415302] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-09-15T17:25:35.664399] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-09-15T17:25:35.792395] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-09-15T17:25:35.792475] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-09-15T17:25:35.793108] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-09-15T17:25:35.793161] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-09-15T17:25:35.794289] [DEBUG] [LOCAL ] BEN: Trimmed 57720 records to 39192 (keeping 150 days of data) [2025-09-15T17:25:36.043473] [DEBUG] [LOCAL ] BEN: Primary data saved (39192 records). [2025-09-15T17:25:36.043627] [INFO ] [MAIN ] BEN: Full history saved. [2025-09-15T17:25:36.045570] [INFO ] [MAIN ] Update Progress: 246/2369 symbols completed. BEN took 25.8s. Estimated remaining: 3h 40m 27s. Rate: 9.6 symbols/min [2025-09-15T17:25:36.215492] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:25:36.221526] [DEBUG] [LOCAL ] BEPH: Loaded 3539 existing records from primary storage. [2025-09-15T17:25:36.221636] [INFO ] [MAIN ] BEPH: Loaded 3539 existing records. [2025-09-15T17:25:36.398700] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:25:36.398975] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-09-15T17:25:36.399021] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-09-15T17:25:36.399265] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-09-15T17:25:36.399310] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-09-15T17:25:36.467437] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-09-15T17:25:36.752244] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:25:36.771099] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-15T17:25:36.777996] [INFO ] [REMOTE ] BEKE: Full fetch complete (57953 records). [2025-09-15T17:25:36.778176] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-09-15T17:25:37.199808] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-09-15T17:25:37.199971] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-09-15T17:25:37.200703] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-09-15T17:25:37.200875] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-09-15T17:25:37.202693] [DEBUG] [LOCAL ] BEKE: Trimmed 57953 records to 39242 (keeping 150 days of data) [2025-09-15T17:25:37.259423] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-09-15T17:25:37.330752] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-15T17:25:37.479268] [DEBUG] [LOCAL ] BEKE: Primary data saved (39242 records). [2025-09-15T17:25:37.479436] [INFO ] [MAIN ] BEKE: Full history saved. [2025-09-15T17:25:37.479827] [INFO ] [MAIN ] Update Progress: 247/2369 symbols completed. BEKE took 32.4s. Estimated remaining: 3h 39m 40s. Rate: 9.7 symbols/min [2025-09-15T17:25:37.650818] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:25:37.658330] [DEBUG] [LOCAL ] BEPI: Loaded 2735 existing records from primary storage. [2025-09-15T17:25:37.658445] [INFO ] [MAIN ] BEPI: Loaded 2735 existing records. [2025-09-15T17:25:37.839116] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:25:37.844365] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-09-15T17:25:37.844749] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-09-15T17:25:37.844563] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-15T17:25:37.846168] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-09-15T17:25:37.846757] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-09-15T17:25:38.062938] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-09-15T17:25:38.245753] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:25:38.248891] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-15T17:25:38.488767] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-15T17:25:38.857934] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-09-15T17:25:39.657895] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-09-15T17:25:40.033408] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-15T17:25:40.038624] [INFO ] [REMOTE ] BEPC: Full fetch complete (50944 records). [2025-09-15T17:25:40.038779] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-09-15T17:25:40.420629] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-09-15T17:25:40.420736] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-09-15T17:25:40.421296] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-09-15T17:25:40.421336] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-09-15T17:25:40.422417] [DEBUG] [LOCAL ] BEPC: Trimmed 50944 records to 33680 (keeping 150 days of data) [2025-09-15T17:25:40.482995] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-09-15T17:25:40.643738] [DEBUG] [LOCAL ] BEPC: Primary data saved (33680 records). [2025-09-15T17:25:40.643929] [INFO ] [MAIN ] BEPC: Full history saved. [2025-09-15T17:25:40.644055] [INFO ] [MAIN ] Update Progress: 248/2369 symbols completed. BEPC took 23.7s. Estimated remaining: 3h 39m 8s. Rate: 9.7 symbols/min [2025-09-15T17:25:40.832526] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:25:40.858064] [DEBUG] [LOCAL ] BEPJ: Loaded 2618 existing records from primary storage. [2025-09-15T17:25:40.858608] [INFO ] [MAIN ] BEPJ: Loaded 2618 existing records. [2025-09-15T17:25:40.859790] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-15T17:25:41.043585] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:25:41.043836] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-09-15T17:25:41.043882] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-09-15T17:25:41.044073] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-09-15T17:25:41.044118] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-09-15T17:25:41.167572] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-15T17:25:41.263158] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-09-15T17:25:41.412133] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:25:41.802864] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-15T17:25:42.057918] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-09-15T17:25:42.432442] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-15T17:25:42.857905] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-09-15T17:25:43.407894] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-15T17:25:43.657887] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-09-15T17:25:44.194465] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-15T17:25:44.457888] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-09-15T17:25:45.069127] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-15T17:25:45.257834] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-09-15T17:25:45.780796] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-15T17:25:46.057908] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-09-15T17:25:46.507968] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-15T17:25:46.857871] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-09-15T17:25:47.401919] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-15T17:25:47.657907] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-09-15T17:25:48.237658] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-15T17:25:48.457875] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-09-15T17:25:49.043291] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-15T17:25:49.257873] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-09-15T17:25:49.761694] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-15T17:25:50.057887] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-09-15T17:25:50.857921] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-09-15T17:25:51.193690] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-15T17:25:51.448130] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-15T17:25:51.459355] [INFO ] [REMOTE ] BEP: Full fetch complete (42759 records). [2025-09-15T17:25:51.459594] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-09-15T17:25:51.662967] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-09-15T17:25:51.894965] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-09-15T17:25:51.895045] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-09-15T17:25:51.895549] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-09-15T17:25:51.895589] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-09-15T17:25:51.896514] [DEBUG] [LOCAL ] BEP: Trimmed 42759 records to 27576 (keeping 150 days of data) [2025-09-15T17:25:52.069007] [DEBUG] [LOCAL ] BEP: Primary data saved (27576 records). [2025-09-15T17:25:52.069140] [INFO ] [MAIN ] BEP: Full history saved. [2025-09-15T17:25:52.069231] [INFO ] [MAIN ] Update Progress: 249/2369 symbols completed. BEP took 38.7s. Estimated remaining: 3h 39m 46s. Rate: 9.6 symbols/min [2025-09-15T17:25:52.173936] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-15T17:25:52.244373] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:25:52.269352] [DEBUG] [LOCAL ] BFAM: Loaded 24802 existing records from primary storage. [2025-09-15T17:25:52.269487] [INFO ] [MAIN ] BFAM: Loaded 24802 existing records. [2025-09-15T17:25:52.448199] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:25:52.448458] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-09-15T17:25:52.448528] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-09-15T17:25:52.449273] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-09-15T17:25:52.449338] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-09-15T17:25:52.462971] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-09-15T17:25:52.805876] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:25:52.942882] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-15T17:25:52.943750] [INFO ] [REMOTE ] BEPI: Full fetch complete (3669 records). [2025-09-15T17:25:52.943817] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-09-15T17:25:53.266885] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-09-15T17:25:53.297202] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-09-15T17:25:53.297272] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-09-15T17:25:53.297388] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-09-15T17:25:53.297428] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-09-15T17:25:53.297879] [DEBUG] [LOCAL ] BEPI: Trimmed 3669 records to 2662 (keeping 150 days of data) [2025-09-15T17:25:53.315119] [DEBUG] [LOCAL ] BEPI: Primary data saved (2662 records). [2025-09-15T17:25:53.315826] [INFO ] [MAIN ] BEPI: Full history saved. [2025-09-15T17:25:53.315938] [INFO ] [MAIN ] Update Progress: 250/2369 symbols completed. BEPI took 15.8s. Estimated remaining: 3h 38m 58s. Rate: 9.7 symbols/min [2025-09-15T17:25:53.483038] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:25:53.516042] [DEBUG] [LOCAL ] BFH: Loaded 30776 existing records from primary storage. [2025-09-15T17:25:53.516194] [INFO ] [MAIN ] BFH: Loaded 30776 existing records. [2025-09-15T17:25:53.697325] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:25:53.697610] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-09-15T17:25:53.697680] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-09-15T17:25:53.698465] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-09-15T17:25:53.698520] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-09-15T17:25:54.064735] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-09-15T17:25:54.069690] [INFO ] [REMOTE ] BFH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:25:54.505987] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-15T17:25:54.638766] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T17:25:54.857908] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-09-15T17:25:55.286902] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-15T17:25:55.657874] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-09-15T17:25:56.203204] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-15T17:25:56.204262] [INFO ] [REMOTE ] BEPH: Full fetch complete (5756 records). [2025-09-15T17:25:56.204329] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-09-15T17:25:56.463028] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-09-15T17:25:56.562431] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-09-15T17:25:56.562507] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-09-15T17:25:56.562693] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-09-15T17:25:56.562735] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-09-15T17:25:56.563117] [DEBUG] [LOCAL ] BEPH: Trimmed 5756 records to 3476 (keeping 150 days of data) [2025-09-15T17:25:56.584598] [DEBUG] [LOCAL ] BEPH: Primary data saved (3476 records). [2025-09-15T17:25:56.587713] [INFO ] [MAIN ] BEPH: Full history saved. [2025-09-15T17:25:56.587796] [INFO ] [MAIN ] Update Progress: 251/2369 symbols completed. BEPH took 20.5s. Estimated remaining: 3h 38m 27s. Rate: 9.7 symbols/min [2025-09-15T17:25:56.788808] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:25:56.800321] [DEBUG] [LOCAL ] BFK: Loaded 10011 existing records from primary storage. [2025-09-15T17:25:56.800440] [INFO ] [MAIN ] BFK: Loaded 10011 existing records. [2025-09-15T17:25:57.005222] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:25:57.005617] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-09-15T17:25:57.005702] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-09-15T17:25:57.006131] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-09-15T17:25:57.006202] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-09-15T17:25:57.153168] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-15T17:25:57.263116] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-09-15T17:25:57.413551] [INFO ] [REMOTE ] BFK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:25:58.057901] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-09-15T17:25:58.531176] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-15T17:25:58.857887] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-09-15T17:25:58.916774] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T17:25:59.296507] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-15T17:25:59.657885] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-09-15T17:26:00.074485] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-15T17:26:00.457864] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-09-15T17:26:01.257848] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-09-15T17:26:01.656228] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T17:26:01.720700] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-15T17:26:01.721571] [INFO ] [REMOTE ] BEPJ: Full fetch complete (3532 records). [2025-09-15T17:26:01.721639] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-09-15T17:26:02.063495] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-09-15T17:26:02.088266] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-09-15T17:26:02.088337] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-09-15T17:26:02.088478] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-09-15T17:26:02.088533] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-09-15T17:26:02.089060] [DEBUG] [LOCAL ] BEPJ: Trimmed 3532 records to 2575 (keeping 150 days of data) [2025-09-15T17:26:02.107473] [DEBUG] [LOCAL ] BEPJ: Primary data saved (2575 records). [2025-09-15T17:26:02.107636] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-09-15T17:26:02.107749] [INFO ] [MAIN ] Update Progress: 252/2369 symbols completed. BEPJ took 21.5s. Estimated remaining: 3h 38m 15s. Rate: 9.7 symbols/min [2025-09-15T17:26:02.274329] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:26:02.315632] [DEBUG] [LOCAL ] BFLY: Loaded 38899 existing records from primary storage. [2025-09-15T17:26:02.315819] [INFO ] [MAIN ] BFLY: Loaded 38899 existing records. [2025-09-15T17:26:02.492543] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:26:02.492911] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-09-15T17:26:02.492963] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-09-15T17:26:02.493983] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-09-15T17:26:02.494050] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-09-15T17:26:02.859159] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:26:02.859282] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-09-15T17:26:03.454902] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-15T17:26:03.657837] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-09-15T17:26:03.715338] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T17:26:04.457927] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-09-15T17:26:05.135795] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-15T17:26:05.257845] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-09-15T17:26:05.713751] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-15T17:26:06.057890] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-09-15T17:26:06.482820] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T17:26:06.857896] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-09-15T17:26:07.304030] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-15T17:26:07.658436] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-09-15T17:26:08.139496] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T17:26:08.457922] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-09-15T17:26:08.596466] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-15T17:26:09.257927] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-09-15T17:26:09.617980] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-15T17:26:10.057970] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-09-15T17:26:10.869364] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-09-15T17:26:10.896104] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T17:26:11.098832] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-15T17:26:11.657920] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-09-15T17:26:12.450107] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T17:26:12.461054] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-09-15T17:26:12.749458] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-15T17:26:12.753415] [INFO ] [REMOTE ] BFAM: Full fetch complete (35565 records). [2025-09-15T17:26:12.753559] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-09-15T17:26:13.151241] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-09-15T17:26:13.151350] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-09-15T17:26:13.151874] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-09-15T17:26:13.151933] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-09-15T17:26:13.159359] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-15T17:26:13.162717] [DEBUG] [LOCAL ] BFAM: Trimmed 35565 records to 24414 (keeping 150 days of data) [2025-09-15T17:26:13.259095] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-09-15T17:26:13.312762] [DEBUG] [LOCAL ] BFAM: Primary data saved (24414 records). [2025-09-15T17:26:13.312891] [INFO ] [MAIN ] BFAM: Full history saved. [2025-09-15T17:26:13.312973] [INFO ] [MAIN ] Update Progress: 253/2369 symbols completed. BFAM took 21.2s. Estimated remaining: 3h 38m 51s. Rate: 9.7 symbols/min [2025-09-15T17:26:13.489902] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:26:13.498045] [DEBUG] [LOCAL ] BFS: Loaded 6805 existing records from primary storage. [2025-09-15T17:26:13.498140] [INFO ] [MAIN ] BFS: Loaded 6805 existing records. [2025-09-15T17:26:13.679034] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:26:13.679361] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-09-15T17:26:13.679425] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-09-15T17:26:13.679917] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-09-15T17:26:13.679977] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-09-15T17:26:14.038535] [INFO ] [REMOTE ] BFS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:26:14.057821] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-09-15T17:26:14.727665] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T17:26:14.729367] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-15T17:26:14.857892] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-09-15T17:26:15.657876] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-09-15T17:26:16.258845] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-15T17:26:16.457909] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-09-15T17:26:16.512125] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-15T17:26:17.229391] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-15T17:26:17.257829] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-09-15T17:26:18.049973] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-15T17:26:18.057809] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-09-15T17:26:18.854891] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-15T17:26:18.857235] [INFO ] [REMOTE ] BFK: Full fetch complete (14535 records). [2025-09-15T17:26:18.857313] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-09-15T17:26:18.863046] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-09-15T17:26:19.267810] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-09-15T17:26:19.267947] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-09-15T17:26:19.268268] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-09-15T17:26:19.268312] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-09-15T17:26:19.268916] [DEBUG] [LOCAL ] BFK: Trimmed 14535 records to 9574 (keeping 150 days of data) [2025-09-15T17:26:19.328421] [DEBUG] [LOCAL ] BFK: Primary data saved (9574 records). [2025-09-15T17:26:19.328564] [INFO ] [MAIN ] BFK: Full history saved. [2025-09-15T17:26:19.328689] [INFO ] [MAIN ] Update Progress: 254/2369 symbols completed. BFK took 22.7s. Estimated remaining: 3h 38m 43s. Rate: 9.7 symbols/min [2025-09-15T17:26:19.505256] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:26:19.514787] [DEBUG] [LOCAL ] BFZ: Loaded 8286 existing records from primary storage. [2025-09-15T17:26:19.514894] [INFO ] [MAIN ] BFZ: Loaded 8286 existing records. [2025-09-15T17:26:19.636614] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-15T17:26:19.662963] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-09-15T17:26:19.701766] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:26:19.702405] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-09-15T17:26:19.702458] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-09-15T17:26:19.702886] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-09-15T17:26:19.702956] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-09-15T17:26:20.076421] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:26:20.457884] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-09-15T17:26:20.573830] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-15T17:26:21.257916] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-09-15T17:26:22.057886] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-09-15T17:26:22.154364] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-15T17:26:22.668244] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-15T17:26:22.740433] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T17:26:22.857883] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-09-15T17:26:23.617211] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-15T17:26:23.657891] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-09-15T17:26:24.123972] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-15T17:26:24.457889] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-09-15T17:26:25.055180] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-15T17:26:25.257883] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-09-15T17:26:26.057887] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-09-15T17:26:26.857926] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-09-15T17:26:27.174969] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-15T17:26:27.251956] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T17:26:27.637035] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-15T17:26:27.657880] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-09-15T17:26:28.457881] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-09-15T17:26:29.257906] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-09-15T17:26:29.326197] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-15T17:26:29.512842] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-15T17:26:29.518368] [INFO ] [REMOTE ] BFLY: Full fetch complete (56473 records). [2025-09-15T17:26:29.518502] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-09-15T17:26:29.910950] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-09-15T17:26:29.911170] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-09-15T17:26:29.911962] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-09-15T17:26:29.912018] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-09-15T17:26:29.913670] [DEBUG] [LOCAL ] BFLY: Trimmed 56473 records to 38151 (keeping 150 days of data) [2025-09-15T17:26:30.074723] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-09-15T17:26:30.142383] [DEBUG] [LOCAL ] BFLY: Primary data saved (38151 records). [2025-09-15T17:26:30.142542] [INFO ] [MAIN ] BFLY: Full history saved. [2025-09-15T17:26:30.142652] [INFO ] [MAIN ] Update Progress: 255/2369 symbols completed. BFLY took 28.0s. Estimated remaining: 3h 39m 15s. Rate: 9.6 symbols/min [2025-09-15T17:26:30.312281] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:26:30.355313] [DEBUG] [LOCAL ] BG: Loaded 37983 existing records from primary storage. [2025-09-15T17:26:30.355459] [INFO ] [MAIN ] BG: Loaded 37983 existing records. [2025-09-15T17:26:30.544448] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:26:30.544835] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-09-15T17:26:30.544997] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-09-15T17:26:30.546156] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-09-15T17:26:30.546213] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-09-15T17:26:30.758247] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T17:26:30.863018] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-09-15T17:26:30.947009] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-15T17:26:30.951256] [INFO ] [REMOTE ] BG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:26:31.657887] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-09-15T17:26:32.072196] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T17:26:32.457959] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-09-15T17:26:32.549912] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-15T17:26:32.977483] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-15T17:26:33.257939] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-09-15T17:26:34.057910] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-09-15T17:26:34.471741] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-15T17:26:34.476357] [INFO ] [REMOTE ] BFH: Full fetch complete (45466 records). [2025-09-15T17:26:34.476496] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-09-15T17:26:34.858229] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-09-15T17:26:34.857908] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-09-15T17:26:34.862250] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-09-15T17:26:34.862858] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-09-15T17:26:34.863374] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-09-15T17:26:34.864833] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T17:26:34.868015] [INFO ] [REMOTE ] BFS: Full fetch complete (9647 records). [2025-09-15T17:26:34.868280] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-09-15T17:26:34.880279] [DEBUG] [LOCAL ] BFH: Trimmed 45466 records to 30069 (keeping 150 days of data) [2025-09-15T17:26:35.368825] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-09-15T17:26:35.369460] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-09-15T17:26:35.370244] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-09-15T17:26:35.370314] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-09-15T17:26:35.373721] [DEBUG] [LOCAL ] BFS: Trimmed 9647 records to 6716 (keeping 150 days of data) [2025-09-15T17:26:35.468405] [DEBUG] [LOCAL ] BFS: Primary data saved (6716 records). [2025-09-15T17:26:35.469342] [INFO ] [MAIN ] BFS: Full history saved. [2025-09-15T17:26:35.469714] [INFO ] [MAIN ] Update Progress: 256/2369 symbols completed. BFS took 22.2s. Estimated remaining: 3h 39m 1s. Rate: 9.6 symbols/min [2025-09-15T17:26:35.653010] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:26:35.658309] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-09-15T17:26:35.663039] [DEBUG] [LOCAL ] BFH: Primary data saved (30069 records). [2025-09-15T17:26:35.666851] [INFO ] [MAIN ] BFH: Full history saved. [2025-09-15T17:26:35.667308] [INFO ] [MAIN ] Update Progress: 257/2369 symbols completed. BFH took 42.4s. Estimated remaining: 3h 38m 6s. Rate: 9.7 symbols/min [2025-09-15T17:26:35.755070] [DEBUG] [LOCAL ] BGB: Loaded 12790 existing records from primary storage. [2025-09-15T17:26:35.776003] [INFO ] [MAIN ] BGB: Loaded 12790 existing records. [2025-09-15T17:26:36.001570] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:26:36.033630] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:26:36.033894] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-09-15T17:26:36.034036] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-09-15T17:26:36.034517] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-09-15T17:26:36.034574] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-09-15T17:26:36.150854] [DEBUG] [LOCAL ] BGH: Loaded 12346 existing records from primary storage. [2025-09-15T17:26:36.156119] [INFO ] [MAIN ] BGH: Loaded 12346 existing records. [2025-09-15T17:26:36.545316] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:26:36.551310] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-09-15T17:26:36.567142] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-09-15T17:26:36.576895] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-09-15T17:26:36.588213] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-09-15T17:26:36.603777] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T17:26:36.679109] [INFO ] [REMOTE ] BGB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:26:36.689688] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-09-15T17:26:36.964055] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-15T17:26:37.045575] [INFO ] [REMOTE ] BGH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:26:37.257883] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-09-15T17:26:37.622358] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-15T17:26:37.849847] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-15T17:26:38.057915] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-09-15T17:26:38.857877] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-09-15T17:26:39.462998] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-15T17:26:39.657864] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-09-15T17:26:39.799732] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-15T17:26:40.457877] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-09-15T17:26:41.214914] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-15T17:26:41.257822] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-09-15T17:26:41.486276] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-15T17:26:42.057887] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-09-15T17:26:42.779607] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-15T17:26:42.781588] [INFO ] [REMOTE ] BFZ: Full fetch complete (12477 records). [2025-09-15T17:26:42.781680] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-09-15T17:26:42.860916] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-09-15T17:26:43.092324] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-15T17:26:43.197894] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-09-15T17:26:43.198014] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-09-15T17:26:43.198398] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-09-15T17:26:43.198451] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-09-15T17:26:43.199125] [DEBUG] [LOCAL ] BFZ: Trimmed 12477 records to 8249 (keeping 150 days of data) [2025-09-15T17:26:43.254434] [DEBUG] [LOCAL ] BFZ: Primary data saved (8249 records). [2025-09-15T17:26:43.254596] [INFO ] [MAIN ] BFZ: Full history saved. [2025-09-15T17:26:43.254739] [INFO ] [MAIN ] Update Progress: 258/2369 symbols completed. BFZ took 23.9s. Estimated remaining: 3h 38m 11s. Rate: 9.7 symbols/min [2025-09-15T17:26:43.459321] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:26:43.471524] [DEBUG] [LOCAL ] BGR: Loaded 9858 existing records from primary storage. [2025-09-15T17:26:43.471699] [INFO ] [MAIN ] BGR: Loaded 9858 existing records. [2025-09-15T17:26:43.660751] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-09-15T17:26:43.695990] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:26:43.696320] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-09-15T17:26:43.696397] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-09-15T17:26:43.696945] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-09-15T17:26:43.697029] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-09-15T17:26:44.171500] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-15T17:26:44.226769] [INFO ] [REMOTE ] BGR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:26:44.457925] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-09-15T17:26:45.234074] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-15T17:26:45.257811] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-09-15T17:26:45.371178] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-15T17:26:45.825266] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-15T17:26:46.057907] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-09-15T17:26:46.797885] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-15T17:26:46.857915] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-09-15T17:26:47.381496] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-15T17:26:47.657879] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-09-15T17:26:48.457883] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-09-15T17:26:48.686414] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-15T17:26:49.257880] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-09-15T17:26:49.822710] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-15T17:26:50.057885] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-09-15T17:26:50.198819] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-15T17:26:50.857872] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-09-15T17:26:51.657877] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-09-15T17:26:51.729223] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-15T17:26:51.814487] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-15T17:26:52.459788] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-09-15T17:26:52.460989] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-15T17:26:53.108714] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-15T17:26:53.257884] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-09-15T17:26:54.057888] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-09-15T17:26:54.164435] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-15T17:26:54.166776] [INFO ] [REMOTE ] BGH: Full fetch complete (17364 records). [2025-09-15T17:26:54.166848] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-09-15T17:26:54.553042] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-09-15T17:26:54.553133] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-09-15T17:26:54.553483] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-09-15T17:26:54.553527] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-09-15T17:26:54.554255] [DEBUG] [LOCAL ] BGH: Trimmed 17364 records to 12045 (keeping 150 days of data) [2025-09-15T17:26:54.634196] [DEBUG] [LOCAL ] BGH: Primary data saved (12045 records). [2025-09-15T17:26:54.634341] [INFO ] [MAIN ] BGH: Full history saved. [2025-09-15T17:26:54.634424] [INFO ] [MAIN ] Update Progress: 259/2369 symbols completed. BGH took 19.0s. Estimated remaining: 3h 38m 47s. Rate: 9.6 symbols/min [2025-09-15T17:26:54.817611] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:26:54.826127] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T17:26:54.864818] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-09-15T17:26:54.867522] [DEBUG] [LOCAL ] BGS: Loaded 37999 existing records from primary storage. [2025-09-15T17:26:54.867688] [INFO ] [MAIN ] BGS: Loaded 37999 existing records. [2025-09-15T17:26:55.047137] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:26:55.047447] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-09-15T17:26:55.047534] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-09-15T17:26:55.048430] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-09-15T17:26:55.048481] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-09-15T17:26:55.408998] [INFO ] [REMOTE ] BGS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:26:55.548011] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T17:26:55.657863] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-09-15T17:26:56.267249] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-15T17:26:56.269199] [INFO ] [REMOTE ] BGR: Full fetch complete (14905 records). [2025-09-15T17:26:56.269276] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-09-15T17:26:56.463918] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-09-15T17:26:56.631901] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-09-15T17:26:56.631981] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-09-15T17:26:56.632285] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-09-15T17:26:56.632356] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-09-15T17:26:56.632890] [DEBUG] [LOCAL ] BGR: Trimmed 14905 records to 9621 (keeping 150 days of data) [2025-09-15T17:26:56.692211] [DEBUG] [LOCAL ] BGR: Primary data saved (9621 records). [2025-09-15T17:26:56.692357] [INFO ] [MAIN ] BGR: Full history saved. [2025-09-15T17:26:56.692443] [INFO ] [MAIN ] Update Progress: 260/2369 symbols completed. BGR took 13.4s. Estimated remaining: 3h 38m 7s. Rate: 9.7 symbols/min [2025-09-15T17:26:56.865426] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:26:56.872946] [DEBUG] [LOCAL ] BGSF: Loaded 4332 existing records from primary storage. [2025-09-15T17:26:56.873147] [INFO ] [MAIN ] BGSF: Loaded 4332 existing records. [2025-09-15T17:26:57.063383] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:26:57.063796] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-09-15T17:26:57.063851] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-09-15T17:26:57.064159] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-09-15T17:26:57.064216] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-09-15T17:26:57.263033] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-09-15T17:26:57.440711] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:26:58.044774] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-15T17:26:58.057801] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-09-15T17:26:58.857868] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-09-15T17:26:58.892261] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-15T17:26:58.898616] [INFO ] [REMOTE ] BG: Full fetch complete (54781 records). [2025-09-15T17:26:58.898781] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-09-15T17:26:59.304741] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-09-15T17:26:59.304893] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-09-15T17:26:59.305560] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-09-15T17:26:59.305619] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-09-15T17:26:59.307037] [DEBUG] [LOCAL ] BG: Trimmed 54781 records to 37332 (keeping 150 days of data) [2025-09-15T17:26:59.335981] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T17:26:59.588727] [DEBUG] [LOCAL ] BG: Primary data saved (37332 records). [2025-09-15T17:26:59.588894] [INFO ] [MAIN ] BG: Full history saved. [2025-09-15T17:26:59.591234] [INFO ] [MAIN ] Update Progress: 261/2369 symbols completed. BG took 29.4s. Estimated remaining: 3h 37m 34s. Rate: 9.7 symbols/min [2025-09-15T17:26:59.662934] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-09-15T17:26:59.777075] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:26:59.787964] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-15T17:26:59.808287] [DEBUG] [LOCAL ] BGT: Loaded 12374 existing records from primary storage. [2025-09-15T17:26:59.808423] [INFO ] [MAIN ] BGT: Loaded 12374 existing records. [2025-09-15T17:26:59.988913] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:26:59.989199] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-09-15T17:26:59.989266] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-09-15T17:26:59.989799] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-09-15T17:26:59.989887] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-09-15T17:27:00.345968] [INFO ] [REMOTE ] BGT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:27:00.457879] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-09-15T17:27:01.180736] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-15T17:27:01.218080] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-15T17:27:01.257861] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-09-15T17:27:02.057920] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-09-15T17:27:02.857922] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-09-15T17:27:02.965546] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-15T17:27:03.280383] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-15T17:27:03.657888] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-09-15T17:27:04.457939] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-09-15T17:27:04.886723] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-15T17:27:04.912019] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-15T17:27:05.064252] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-15T17:27:05.257973] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-09-15T17:27:06.017210] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-15T17:27:06.057821] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-09-15T17:27:06.830274] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-15T17:27:06.857860] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-09-15T17:27:07.657938] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-09-15T17:27:07.782480] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-15T17:27:08.457892] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-09-15T17:27:09.010182] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T17:27:09.257912] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-09-15T17:27:09.370821] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-15T17:27:09.373539] [INFO ] [REMOTE ] BGB: Full fetch complete (19575 records). [2025-09-15T17:27:09.373716] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-09-15T17:27:09.676557] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-15T17:27:09.761310] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-09-15T17:27:09.761398] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-09-15T17:27:09.761760] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-09-15T17:27:09.761814] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-09-15T17:27:09.762587] [DEBUG] [LOCAL ] BGB: Trimmed 19575 records to 12257 (keeping 150 days of data) [2025-09-15T17:27:09.842239] [DEBUG] [LOCAL ] BGB: Primary data saved (12257 records). [2025-09-15T17:27:09.842399] [INFO ] [MAIN ] BGB: Full history saved. [2025-09-15T17:27:09.842505] [INFO ] [MAIN ] Update Progress: 262/2369 symbols completed. BGB took 34.4s. Estimated remaining: 3h 38m 0s. Rate: 9.7 symbols/min [2025-09-15T17:27:10.013491] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:27:10.022192] [DEBUG] [LOCAL ] BGX: Loaded 7740 existing records from primary storage. [2025-09-15T17:27:10.022280] [INFO ] [MAIN ] BGX: Loaded 7740 existing records. [2025-09-15T17:27:10.063105] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-09-15T17:27:10.205351] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:27:10.205594] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-09-15T17:27:10.205660] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-09-15T17:27:10.205970] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-09-15T17:27:10.206016] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-09-15T17:27:10.554982] [INFO ] [REMOTE ] BGX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:27:10.857894] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-09-15T17:27:11.283886] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T17:27:11.657913] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-09-15T17:27:11.720324] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T17:27:12.223363] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-15T17:27:12.457903] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-09-15T17:27:13.257900] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-09-15T17:27:14.057898] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-09-15T17:27:14.274807] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-15T17:27:14.857845] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-09-15T17:27:14.936481] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-15T17:27:15.064469] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-15T17:27:15.472299] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-15T17:27:15.657896] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-09-15T17:27:16.090416] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-15T17:27:16.457920] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-09-15T17:27:17.033827] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-15T17:27:17.257930] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-09-15T17:27:17.979220] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-15T17:27:17.980905] [INFO ] [REMOTE ] BGSF: Full fetch complete (5699 records). [2025-09-15T17:27:17.980973] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-09-15T17:27:18.062947] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-09-15T17:27:18.335879] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-09-15T17:27:18.335969] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-09-15T17:27:18.336160] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-09-15T17:27:18.336201] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-09-15T17:27:18.336599] [DEBUG] [LOCAL ] BGSF: Trimmed 5699 records to 4578 (keeping 150 days of data) [2025-09-15T17:27:18.363099] [DEBUG] [LOCAL ] BGSF: Primary data saved (4578 records). [2025-09-15T17:27:18.363174] [INFO ] [MAIN ] BGSF: Full history saved. [2025-09-15T17:27:18.363272] [INFO ] [MAIN ] Update Progress: 263/2369 symbols completed. BGSF took 21.7s. Estimated remaining: 3h 38m 13s. Rate: 9.7 symbols/min [2025-09-15T17:27:18.545492] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:27:18.566406] [DEBUG] [LOCAL ] BGY: Loaded 16485 existing records from primary storage. [2025-09-15T17:27:18.566547] [INFO ] [MAIN ] BGY: Loaded 16485 existing records. [2025-09-15T17:27:18.750757] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:27:18.751096] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-09-15T17:27:18.751148] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-09-15T17:27:18.751675] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-09-15T17:27:18.751731] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-09-15T17:27:18.863056] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-09-15T17:27:19.112558] [INFO ] [REMOTE ] BGY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:27:19.630778] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T17:27:19.650236] [INFO ] [REMOTE ] BGS: Full fetch complete (54805 records). [2025-09-15T17:27:19.653387] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-15T17:27:19.652960] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-09-15T17:27:19.663220] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-09-15T17:27:20.035494] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-09-15T17:27:20.035574] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-09-15T17:27:20.036214] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-09-15T17:27:20.036258] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-09-15T17:27:20.037307] [DEBUG] [LOCAL ] BGS: Trimmed 54805 records to 37320 (keeping 150 days of data) [2025-09-15T17:27:20.260659] [DEBUG] [LOCAL ] BGS: Primary data saved (37320 records). [2025-09-15T17:27:20.260804] [INFO ] [MAIN ] BGS: Full history saved. [2025-09-15T17:27:20.261074] [INFO ] [MAIN ] Update Progress: 264/2369 symbols completed. BGS took 25.6s. Estimated remaining: 3h 37m 32s. Rate: 9.7 symbols/min [2025-09-15T17:27:20.428859] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:27:20.436564] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-15T17:27:20.451879] [DEBUG] [LOCAL ] BH: Loaded 13143 existing records from primary storage. [2025-09-15T17:27:20.451978] [INFO ] [MAIN ] BH: Loaded 13143 existing records. [2025-09-15T17:27:20.462924] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-09-15T17:27:20.631023] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:27:20.631241] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-09-15T17:27:20.631298] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-09-15T17:27:20.631762] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-09-15T17:27:20.631813] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-09-15T17:27:21.008350] [INFO ] [REMOTE ] BH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:27:21.257907] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-09-15T17:27:21.522877] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-15T17:27:21.701826] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-15T17:27:22.057913] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-09-15T17:27:22.767633] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-15T17:27:22.857839] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-09-15T17:27:23.657946] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-09-15T17:27:23.872486] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-15T17:27:24.197761] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-15T17:27:24.457873] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-09-15T17:27:25.019727] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-15T17:27:25.257900] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-09-15T17:27:26.057857] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-09-15T17:27:26.289270] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-15T17:27:26.701574] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-15T17:27:26.857876] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-09-15T17:27:27.657883] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-09-15T17:27:27.696394] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-15T17:27:28.356663] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-15T17:27:28.457835] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-09-15T17:27:29.195694] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-15T17:27:29.198381] [INFO ] [REMOTE ] BGT: Full fetch complete (17972 records). [2025-09-15T17:27:29.198452] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-09-15T17:27:29.263165] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-09-15T17:27:29.560988] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-09-15T17:27:29.561074] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-09-15T17:27:29.561463] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-09-15T17:27:29.561520] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-09-15T17:27:29.562128] [DEBUG] [LOCAL ] BGT: Trimmed 17972 records to 12264 (keeping 150 days of data) [2025-09-15T17:27:29.643380] [DEBUG] [LOCAL ] BGT: Primary data saved (12264 records). [2025-09-15T17:27:29.643546] [INFO ] [MAIN ] BGT: Full history saved. [2025-09-15T17:27:29.643664] [INFO ] [MAIN ] Update Progress: 265/2369 symbols completed. BGT took 30.1s. Estimated remaining: 3h 37m 51s. Rate: 9.7 symbols/min [2025-09-15T17:27:29.812479] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:27:29.854802] [DEBUG] [LOCAL ] BHC: Loaded 34955 existing records from primary storage. [2025-09-15T17:27:29.854960] [INFO ] [MAIN ] BHC: Loaded 34955 existing records. [2025-09-15T17:27:29.991886] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-15T17:27:30.045374] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:27:30.045660] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-09-15T17:27:30.045708] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-09-15T17:27:30.047004] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-09-15T17:27:30.047058] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-09-15T17:27:30.066976] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-09-15T17:27:30.398708] [INFO ] [REMOTE ] BHC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:27:30.838191] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-15T17:27:30.857819] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-09-15T17:27:31.352530] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-15T17:27:31.657874] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-09-15T17:27:32.457912] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-09-15T17:27:32.815269] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T17:27:33.257872] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-09-15T17:27:33.470112] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-15T17:27:33.841145] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-15T17:27:33.843186] [INFO ] [REMOTE ] BGX: Full fetch complete (11967 records). [2025-09-15T17:27:33.843256] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-09-15T17:27:34.063063] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-09-15T17:27:34.200521] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-09-15T17:27:34.200593] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-09-15T17:27:34.200867] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-09-15T17:27:34.200908] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-09-15T17:27:34.201359] [DEBUG] [LOCAL ] BGX: Trimmed 11967 records to 7699 (keeping 150 days of data) [2025-09-15T17:27:34.252613] [DEBUG] [LOCAL ] BGX: Primary data saved (7699 records). [2025-09-15T17:27:34.252756] [INFO ] [MAIN ] BGX: Full history saved. [2025-09-15T17:27:34.252850] [INFO ] [MAIN ] Update Progress: 266/2369 symbols completed. BGX took 24.4s. Estimated remaining: 3h 37m 32s. Rate: 9.7 symbols/min [2025-09-15T17:27:34.423220] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:27:34.442122] [DEBUG] [LOCAL ] BHE: Loaded 17884 existing records from primary storage. [2025-09-15T17:27:34.442237] [INFO ] [MAIN ] BHE: Loaded 17884 existing records. [2025-09-15T17:27:34.619189] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:27:34.619416] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-09-15T17:27:34.619469] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-09-15T17:27:34.620090] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-09-15T17:27:34.620161] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-09-15T17:27:34.863085] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-09-15T17:27:34.972749] [INFO ] [REMOTE ] BHE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:27:35.231023] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-15T17:27:35.569023] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-15T17:27:35.657877] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-09-15T17:27:36.457942] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-09-15T17:27:36.940499] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T17:27:37.257900] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-09-15T17:27:37.462270] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-15T17:27:38.057903] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-09-15T17:27:38.328531] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-15T17:27:38.857874] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-09-15T17:27:39.431323] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T17:27:39.657900] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-09-15T17:27:39.762942] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-15T17:27:39.765362] [INFO ] [REMOTE ] BH: Full fetch complete (15431 records). [2025-09-15T17:27:39.765432] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-09-15T17:27:39.765847] [FATAL] [VALIDATOR ] BH: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:27:39.765956] [FATAL] [MAIN ] BH: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:27:39.766004] [WARN ] [MAIN ] BH: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:27:39.766043] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-09-15T17:27:39.766110] [DEBUG] [LOCAL ] BH: No primary data file found to delete. [2025-09-15T17:27:39.766147] [INFO ] [LOCAL ] BH: Starting deletion of derivative data. [2025-09-15T17:27:39.766476] [DEBUG] [LOCAL ] BH: Deleted derivative data file. [2025-09-15T17:27:39.766552] [INFO ] [MAIN ] Update Progress: 267/2369 symbols completed. BH took 19.5s. Estimated remaining: 3h 37m 21s. Rate: 9.7 symbols/min [2025-09-15T17:27:39.973821] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:27:39.991834] [DEBUG] [LOCAL ] BHK: Loaded 18380 existing records from primary storage. [2025-09-15T17:27:39.991960] [INFO ] [MAIN ] BHK: Loaded 18380 existing records. [2025-09-15T17:27:40.178853] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:27:40.179097] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-09-15T17:27:40.179150] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-09-15T17:27:40.179792] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-09-15T17:27:40.179853] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-09-15T17:27:40.463040] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-09-15T17:27:40.542742] [INFO ] [REMOTE ] BHK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:27:40.782094] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-15T17:27:41.257877] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-09-15T17:27:41.860549] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T17:27:42.057899] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-09-15T17:27:42.248497] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T17:27:42.857911] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-09-15T17:27:43.024027] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-15T17:27:43.657908] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-09-15T17:27:43.718806] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-15T17:27:44.457843] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-09-15T17:27:44.805980] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-15T17:27:45.257893] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-09-15T17:27:45.315712] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-15T17:27:46.056306] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-15T17:27:46.061141] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-09-15T17:27:46.857926] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-09-15T17:27:47.657906] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-09-15T17:27:47.707288] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-15T17:27:47.754231] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T17:27:48.431468] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-15T17:27:48.457821] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-09-15T17:27:49.257897] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-09-15T17:27:49.421010] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-15T17:27:49.423962] [INFO ] [REMOTE ] BGY: Full fetch complete (25396 records). [2025-09-15T17:27:49.424132] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-09-15T17:27:49.815833] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-09-15T17:27:49.815968] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-09-15T17:27:49.816532] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-09-15T17:27:49.816579] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-09-15T17:27:49.817831] [DEBUG] [LOCAL ] BGY: Trimmed 25396 records to 16276 (keeping 150 days of data) [2025-09-15T17:27:49.918807] [DEBUG] [LOCAL ] BGY: Primary data saved (16276 records). [2025-09-15T17:27:49.918979] [INFO ] [MAIN ] BGY: Full history saved. [2025-09-15T17:27:49.919084] [INFO ] [MAIN ] Update Progress: 268/2369 symbols completed. BGY took 31.6s. Estimated remaining: 3h 37m 45s. Rate: 9.6 symbols/min [2025-09-15T17:27:50.065164] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-09-15T17:27:50.094164] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:27:50.139686] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-15T17:27:50.159070] [DEBUG] [LOCAL ] BHP: Loaded 40153 existing records from primary storage. [2025-09-15T17:27:50.159316] [INFO ] [MAIN ] BHP: Loaded 40153 existing records. [2025-09-15T17:27:50.343831] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:27:50.344172] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-09-15T17:27:50.344222] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-09-15T17:27:50.345472] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-09-15T17:27:50.345535] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-09-15T17:27:50.716140] [INFO ] [REMOTE ] BHP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:27:50.857877] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-09-15T17:27:51.562262] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-15T17:27:51.593634] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-15T17:27:51.657871] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-09-15T17:27:52.457894] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-09-15T17:27:52.969101] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-15T17:27:53.257885] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-09-15T17:27:53.983826] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-15T17:27:54.057846] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-09-15T17:27:54.090611] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-15T17:27:54.857900] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-09-15T17:27:55.169407] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-15T17:27:55.657922] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-09-15T17:27:56.434665] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T17:27:56.457831] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-09-15T17:27:56.665273] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T17:27:57.257876] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-09-15T17:27:57.785008] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-15T17:27:57.790617] [INFO ] [REMOTE ] BHC: Full fetch complete (50928 records). [2025-09-15T17:27:57.790838] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-09-15T17:27:58.065543] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-09-15T17:27:58.171950] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-09-15T17:27:58.172076] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-09-15T17:27:58.185972] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-09-15T17:27:58.186091] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-09-15T17:27:58.187680] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-15T17:27:58.193869] [DEBUG] [LOCAL ] BHC: Trimmed 50928 records to 34175 (keeping 150 days of data) [2025-09-15T17:27:58.400488] [DEBUG] [LOCAL ] BHC: Primary data saved (34175 records). [2025-09-15T17:27:58.400668] [INFO ] [MAIN ] BHC: Full history saved. [2025-09-15T17:27:58.400779] [INFO ] [MAIN ] Update Progress: 269/2369 symbols completed. BHC took 28.8s. Estimated remaining: 3h 37m 57s. Rate: 9.6 symbols/min [2025-09-15T17:27:58.571806] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:27:58.587419] [DEBUG] [LOCAL ] BHR: Loaded 15557 existing records from primary storage. [2025-09-15T17:27:58.587583] [INFO ] [MAIN ] BHR: Loaded 15557 existing records. [2025-09-15T17:27:58.762548] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:27:58.762797] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-09-15T17:27:58.762842] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-09-15T17:27:58.763290] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-09-15T17:27:58.763337] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-09-15T17:27:58.863142] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-09-15T17:27:59.127484] [INFO ] [REMOTE ] BHR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:27:59.521206] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T17:27:59.657857] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-09-15T17:28:00.095309] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-15T17:28:00.457863] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-09-15T17:28:01.257884] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-09-15T17:28:01.298386] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T17:28:01.537930] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-15T17:28:01.956016] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T17:28:01.958845] [INFO ] [REMOTE ] BHE: Full fetch complete (27984 records). [2025-09-15T17:28:01.958951] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-09-15T17:28:02.063166] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-09-15T17:28:02.357834] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-09-15T17:28:02.357917] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-09-15T17:28:02.358352] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-09-15T17:28:02.358394] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-09-15T17:28:02.359198] [DEBUG] [LOCAL ] BHE: Trimmed 27984 records to 17441 (keeping 150 days of data) [2025-09-15T17:28:02.477335] [DEBUG] [LOCAL ] BHE: Primary data saved (17441 records). [2025-09-15T17:28:02.477594] [INFO ] [MAIN ] BHE: Full history saved. [2025-09-15T17:28:02.477724] [INFO ] [MAIN ] Update Progress: 270/2369 symbols completed. BHE took 28.2s. Estimated remaining: 3h 37m 34s. Rate: 9.6 symbols/min [2025-09-15T17:28:02.665440] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:28:02.665627] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-09-15T17:28:02.665687] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-09-15T17:28:02.665841] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-09-15T17:28:02.665881] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-15T17:28:02.665922] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-15T17:28:02.665956] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-09-15T17:28:02.860389] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-09-15T17:28:03.046724] [INFO ] [REMOTE ] BHV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:28:03.657941] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-09-15T17:28:03.823943] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-15T17:28:03.837299] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T17:28:03.841561] [INFO ] [REMOTE ] BHK: Full fetch complete (23576 records). [2025-09-15T17:28:03.841679] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-09-15T17:28:04.123815] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-15T17:28:04.205236] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-09-15T17:28:04.205319] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-09-15T17:28:04.205845] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-09-15T17:28:04.205894] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-09-15T17:28:04.207280] [DEBUG] [LOCAL ] BHK: Trimmed 23576 records to 18311 (keeping 150 days of data) [2025-09-15T17:28:04.319264] [DEBUG] [LOCAL ] BHK: Primary data saved (18311 records). [2025-09-15T17:28:04.319427] [INFO ] [MAIN ] BHK: Full history saved. [2025-09-15T17:28:04.319521] [INFO ] [MAIN ] Update Progress: 271/2369 symbols completed. BHK took 24.6s. Estimated remaining: 3h 36m 54s. Rate: 9.7 symbols/min [2025-09-15T17:28:04.464030] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-09-15T17:28:04.496413] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:28:04.541541] [DEBUG] [LOCAL ] BHVN: Loaded 37833 existing records from primary storage. [2025-09-15T17:28:04.541774] [INFO ] [MAIN ] BHVN: Loaded 37833 existing records. [2025-09-15T17:28:04.722381] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:28:04.722695] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-09-15T17:28:04.722747] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-09-15T17:28:04.723699] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-09-15T17:28:04.723758] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-09-15T17:28:05.084432] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:28:05.257848] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-09-15T17:28:06.057882] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-09-15T17:28:06.254030] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-15T17:28:06.418957] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T17:28:06.747899] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-15T17:28:06.857877] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-09-15T17:28:07.657940] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-09-15T17:28:07.894146] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-15T17:28:07.904907] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-15T17:28:08.457902] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-09-15T17:28:09.257899] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-09-15T17:28:09.925982] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T17:28:09.984262] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-15T17:28:10.057880] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-09-15T17:28:10.857898] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-09-15T17:28:11.657951] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-09-15T17:28:11.874705] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-15T17:28:12.029777] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-15T17:28:12.457872] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-09-15T17:28:12.616942] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T17:28:12.754610] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-15T17:28:13.257913] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-09-15T17:28:14.057904] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-09-15T17:28:14.456816] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-15T17:28:14.857923] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-09-15T17:28:15.292738] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-15T17:28:15.657889] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-09-15T17:28:15.984876] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-15T17:28:16.457885] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-09-15T17:28:16.785676] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-15T17:28:16.912075] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-15T17:28:17.257882] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-09-15T17:28:18.057886] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-09-15T17:28:18.804743] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-15T17:28:18.857855] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-09-15T17:28:18.928428] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-15T17:28:19.657912] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-09-15T17:28:20.457938] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-09-15T17:28:20.536762] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-15T17:28:20.543105] [INFO ] [REMOTE ] BHP: Full fetch complete (58047 records). [2025-09-15T17:28:20.543280] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-09-15T17:28:20.839372] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-15T17:28:20.935451] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-09-15T17:28:20.935563] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-09-15T17:28:20.936315] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-09-15T17:28:20.936372] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-09-15T17:28:20.937856] [DEBUG] [LOCAL ] BHP: Trimmed 58047 records to 39376 (keeping 150 days of data) [2025-09-15T17:28:21.212008] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T17:28:21.229067] [DEBUG] [LOCAL ] BHP: Primary data saved (39376 records). [2025-09-15T17:28:21.229235] [INFO ] [MAIN ] BHP: Full history saved. [2025-09-15T17:28:21.229998] [INFO ] [MAIN ] Update Progress: 272/2369 symbols completed. BHP took 31.3s. Estimated remaining: 3h 38m 10s. Rate: 9.6 symbols/min [2025-09-15T17:28:21.262973] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-09-15T17:28:21.409728] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:28:21.449188] [DEBUG] [LOCAL ] BILL: Loaded 39323 existing records from primary storage. [2025-09-15T17:28:21.449329] [INFO ] [MAIN ] BILL: Loaded 39323 existing records. [2025-09-15T17:28:21.635373] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:28:21.635682] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-09-15T17:28:21.635730] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-09-15T17:28:21.636627] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-09-15T17:28:21.636713] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-09-15T17:28:21.988204] [INFO ] [REMOTE ] BILL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:28:22.057827] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-09-15T17:28:22.079805] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T17:28:22.857889] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-09-15T17:28:23.421198] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-15T17:28:23.657889] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-09-15T17:28:23.851619] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-15T17:28:24.457921] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-09-15T17:28:25.221749] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T17:28:25.257813] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-09-15T17:28:25.594729] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-15T17:28:25.600403] [INFO ] [REMOTE ] BHVN: Full fetch complete (53240 records). [2025-09-15T17:28:25.600502] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-09-15T17:28:25.973566] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-09-15T17:28:25.973692] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-09-15T17:28:25.974289] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-09-15T17:28:25.974333] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-09-15T17:28:25.975849] [DEBUG] [LOCAL ] BHVN: Trimmed 53240 records to 37135 (keeping 150 days of data) [2025-09-15T17:28:26.065152] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-09-15T17:28:26.207523] [DEBUG] [LOCAL ] BHVN: Primary data saved (37135 records). [2025-09-15T17:28:26.207698] [INFO ] [MAIN ] BHVN: Full history saved. [2025-09-15T17:28:26.208078] [INFO ] [MAIN ] Update Progress: 273/2369 symbols completed. BHVN took 21.9s. Estimated remaining: 3h 37m 54s. Rate: 9.6 symbols/min [2025-09-15T17:28:26.378539] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:28:26.401369] [DEBUG] [LOCAL ] BIO: Loaded 18672 existing records from primary storage. [2025-09-15T17:28:26.401550] [INFO ] [MAIN ] BIO: Loaded 18672 existing records. [2025-09-15T17:28:26.582328] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:28:26.582577] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-09-15T17:28:26.582624] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-09-15T17:28:26.583218] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-09-15T17:28:26.583270] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-09-15T17:28:26.859542] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-09-15T17:28:26.974666] [INFO ] [REMOTE ] BIO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:28:26.977604] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-15T17:28:27.016174] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T17:28:27.426887] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-15T17:28:27.427788] [INFO ] [REMOTE ] BHV: Full fetch complete (1075 records). [2025-09-15T17:28:27.427857] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-09-15T17:28:27.610232] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 147 unique days, need 150 days [2025-09-15T17:28:27.610432] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:28:27.610480] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:28:27.610519] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-15T17:28:27.610577] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-15T17:28:27.610633] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-09-15T17:28:27.610696] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-09-15T17:28:27.610778] [INFO ] [MAIN ] Update Progress: 274/2369 symbols completed. BHV took 25.1s. Estimated remaining: 3h 37m 11s. Rate: 9.6 symbols/min [2025-09-15T17:28:27.663325] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-09-15T17:28:27.785558] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:28:27.823798] [DEBUG] [LOCAL ] BIP: Loaded 28380 existing records from primary storage. [2025-09-15T17:28:27.824027] [INFO ] [MAIN ] BIP: Loaded 28380 existing records. [2025-09-15T17:28:28.001093] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:28:28.001355] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-09-15T17:28:28.001400] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-09-15T17:28:28.002113] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-09-15T17:28:28.002164] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-09-15T17:28:28.357963] [INFO ] [REMOTE ] BIP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:28:28.457914] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-09-15T17:28:28.824309] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-15T17:28:28.829564] [INFO ] [REMOTE ] BHR: Full fetch complete (22607 records). [2025-09-15T17:28:28.829725] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-09-15T17:28:29.217161] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-09-15T17:28:29.217376] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-09-15T17:28:29.218359] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-09-15T17:28:29.218525] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-09-15T17:28:29.220916] [DEBUG] [LOCAL ] BHR: Trimmed 22607 records to 15154 (keeping 150 days of data) [2025-09-15T17:28:29.276967] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-09-15T17:28:29.344285] [DEBUG] [LOCAL ] BHR: Primary data saved (15154 records). [2025-09-15T17:28:29.344513] [INFO ] [MAIN ] BHR: Full history saved. [2025-09-15T17:28:29.344672] [INFO ] [MAIN ] Update Progress: 275/2369 symbols completed. BHR took 30.9s. Estimated remaining: 3h 36m 30s. Rate: 9.7 symbols/min [2025-09-15T17:28:29.532441] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:28:29.567465] [DEBUG] [LOCAL ] BIPC: Loaded 30547 existing records from primary storage. [2025-09-15T17:28:29.567698] [INFO ] [MAIN ] BIPC: Loaded 30547 existing records. [2025-09-15T17:28:29.754608] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:28:29.754989] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-09-15T17:28:29.755046] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-09-15T17:28:29.755911] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-09-15T17:28:29.755964] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-09-15T17:28:30.062800] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-09-15T17:28:30.137637] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:28:30.172387] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-15T17:28:30.436139] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T17:28:30.857904] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-09-15T17:28:31.554632] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-15T17:28:31.657883] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-09-15T17:28:32.457939] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-09-15T17:28:32.548850] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T17:28:32.615568] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-15T17:28:33.257879] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-09-15T17:28:33.854088] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T17:28:34.057871] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-09-15T17:28:34.682622] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T17:28:34.857879] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-09-15T17:28:35.277587] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T17:28:35.657921] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-09-15T17:28:36.463001] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-09-15T17:28:36.485134] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T17:28:36.516861] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-15T17:28:37.257890] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-09-15T17:28:37.611032] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-15T17:28:38.057933] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-09-15T17:28:38.857891] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-09-15T17:28:38.913738] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-15T17:28:38.919668] [INFO ] [REMOTE ] BILL: Full fetch complete (56988 records). [2025-09-15T17:28:38.919788] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-09-15T17:28:39.313199] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-09-15T17:28:39.313341] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-09-15T17:28:39.314079] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-09-15T17:28:39.314127] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-09-15T17:28:39.315626] [DEBUG] [LOCAL ] BILL: Trimmed 56988 records to 38625 (keeping 150 days of data) [2025-09-15T17:28:39.552009] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T17:28:39.586158] [DEBUG] [LOCAL ] BILL: Primary data saved (38625 records). [2025-09-15T17:28:39.586393] [INFO ] [MAIN ] BILL: Full history saved. [2025-09-15T17:28:39.586911] [INFO ] [MAIN ] Update Progress: 276/2369 symbols completed. BILL took 18.4s. Estimated remaining: 3h 36m 55s. Rate: 9.6 symbols/min [2025-09-15T17:28:39.662947] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-09-15T17:28:39.760414] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:28:39.764565] [DEBUG] [LOCAL ] BIPH: Loaded 1599 existing records from primary storage. [2025-09-15T17:28:39.764694] [INFO ] [MAIN ] BIPH: Loaded 1599 existing records. [2025-09-15T17:28:39.938414] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:28:39.938687] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-09-15T17:28:39.938734] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-09-15T17:28:39.938939] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-09-15T17:28:39.938983] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-09-15T17:28:40.297179] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:28:40.324187] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T17:28:40.457889] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-09-15T17:28:40.933255] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-15T17:28:41.257901] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-09-15T17:28:41.587306] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-15T17:28:41.795904] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-15T17:28:42.057891] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-09-15T17:28:42.857854] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-09-15T17:28:43.037537] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-15T17:28:43.194411] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-15T17:28:43.657867] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-09-15T17:28:44.457685] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-15T17:28:44.457916] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-09-15T17:28:45.257928] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-09-15T17:28:45.460167] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-15T17:28:46.057882] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-09-15T17:28:46.825335] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T17:28:46.857836] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-09-15T17:28:46.898938] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-15T17:28:47.657876] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-09-15T17:28:48.248395] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-15T17:28:48.457953] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-09-15T17:28:48.826861] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-15T17:28:49.173204] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-15T17:28:49.257928] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-09-15T17:28:50.057896] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-09-15T17:28:50.348333] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-15T17:28:50.430035] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-15T17:28:50.857892] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-09-15T17:28:51.236130] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-15T17:28:51.657872] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-09-15T17:28:52.036538] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-15T17:28:52.457870] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-09-15T17:28:53.257854] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-09-15T17:28:53.467717] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-15T17:28:53.470378] [INFO ] [REMOTE ] BIO: Full fetch complete (28335 records). [2025-09-15T17:28:53.470467] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-09-15T17:28:53.572583] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-15T17:28:53.855529] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-09-15T17:28:53.855697] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-09-15T17:28:53.856403] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-09-15T17:28:53.856454] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-09-15T17:28:53.857488] [DEBUG] [LOCAL ] BIO: Trimmed 28335 records to 18273 (keeping 150 days of data) [2025-09-15T17:28:53.984178] [DEBUG] [LOCAL ] BIO: Primary data saved (18273 records). [2025-09-15T17:28:53.984418] [INFO ] [MAIN ] BIO: Full history saved. [2025-09-15T17:28:53.984536] [INFO ] [MAIN ] Update Progress: 277/2369 symbols completed. BIO took 27.8s. Estimated remaining: 3h 37m 50s. Rate: 9.6 symbols/min [2025-09-15T17:28:54.057867] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-09-15T17:28:54.857889] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-09-15T17:28:55.617810] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-15T17:28:55.624099] [INFO ] [REMOTE ] BIP: Full fetch complete (43437 records). [2025-09-15T17:28:55.624292] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-09-15T17:28:55.669150] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-09-15T17:28:56.007973] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-09-15T17:28:56.008124] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-09-15T17:28:56.008763] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-09-15T17:28:56.008856] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-09-15T17:28:56.012596] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-15T17:28:56.014394] [DEBUG] [LOCAL ] BIP: Trimmed 43437 records to 27810 (keeping 150 days of data) [2025-09-15T17:28:56.142242] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T17:28:56.225256] [DEBUG] [LOCAL ] BIP: Primary data saved (27810 records). [2025-09-15T17:28:56.225396] [INFO ] [MAIN ] BIP: Full history saved. [2025-09-15T17:28:56.225477] [INFO ] [MAIN ] Update Progress: 278/2369 symbols completed. BIP took 28.6s. Estimated remaining: 3h 37m 14s. Rate: 9.6 symbols/min [2025-09-15T17:28:56.457873] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-09-15T17:28:57.002113] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-15T17:28:57.003002] [INFO ] [REMOTE ] BIPH: Full fetch complete (2784 records). [2025-09-15T17:28:57.003071] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-09-15T17:28:57.270045] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-09-15T17:28:57.358858] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-09-15T17:28:57.358939] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-09-15T17:28:57.359045] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-09-15T17:28:57.359084] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-09-15T17:28:57.359440] [DEBUG] [LOCAL ] BIPH: Trimmed 2784 records to 1566 (keeping 150 days of data) [2025-09-15T17:28:57.369265] [DEBUG] [LOCAL ] BIPH: Primary data saved (1566 records). [2025-09-15T17:28:57.369323] [INFO ] [MAIN ] BIPH: Full history saved. [2025-09-15T17:28:57.369389] [INFO ] [MAIN ] Update Progress: 279/2369 symbols completed. BIPH took 17.8s. Estimated remaining: 3h 36m 30s. Rate: 9.7 symbols/min [2025-09-15T17:28:58.617439] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T17:28:58.621828] [INFO ] [REMOTE ] BIPC: Full fetch complete (45504 records). [2025-09-15T17:28:58.621917] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-09-15T17:28:59.038513] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-09-15T17:28:59.038608] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-09-15T17:28:59.039158] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-09-15T17:28:59.039201] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-09-15T17:28:59.040279] [DEBUG] [LOCAL ] BIPC: Trimmed 45504 records to 29926 (keeping 150 days of data) [2025-09-15T17:28:59.232978] [DEBUG] [LOCAL ] BIPC: Primary data saved (29926 records). [2025-09-15T17:28:59.233126] [INFO ] [MAIN ] BIPC: Full history saved. [2025-09-15T17:28:59.233217] [INFO ] [MAIN ] Update Progress: 280/2369 symbols completed. BIPC took 29.9s. Estimated remaining: 3h 35m 51s. Rate: 9.7 symbols/min [2025-09-15T17:28:59.915908] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:28:59.915025] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:28:59.962067] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:28:59.957910] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:28:59.971449] [DEBUG] [LOCAL ] BIPJ: Loaded 2122 existing records from primary storage. [2025-09-15T17:28:59.974091] [DEBUG] [LOCAL ] BIPI: Loaded 2075 existing records from primary storage. [2025-09-15T17:28:59.971609] [INFO ] [MAIN ] BIPJ: Loaded 2122 existing records. [2025-09-15T17:28:59.995321] [INFO ] [MAIN ] BIPI: Loaded 2075 existing records. [2025-09-15T17:29:00.224972] [DEBUG] [LOCAL ] BIT: Loaded 16547 existing records from primary storage. [2025-09-15T17:29:00.263192] [INFO ] [MAIN ] BIT: Loaded 16547 existing records. [2025-09-15T17:29:00.331579] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:29:00.400972] [DEBUG] [LOCAL ] BIRK: Loaded 38281 existing records from primary storage. [2025-09-15T17:29:00.458806] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:29:00.464192] [INFO ] [MAIN ] BIRK: Loaded 38281 existing records. [2025-09-15T17:29:00.497202] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-09-15T17:29:00.535469] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-09-15T17:29:00.535590] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-09-15T17:29:00.585678] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-09-15T17:29:00.601132] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-09-15T17:29:00.601181] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-09-15T17:29:00.641505] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-09-15T17:29:00.658114] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-09-15T17:29:00.812102] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:29:00.896885] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:29:00.924638] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-09-15T17:29:00.929950] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-09-15T17:29:00.940297] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-09-15T17:29:00.945560] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-09-15T17:29:00.960140] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-09-15T17:29:00.950840] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-09-15T17:29:01.051715] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-09-15T17:29:01.097504] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-09-15T17:29:01.763791] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:29:01.791080] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-09-15T17:29:01.895678] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:29:01.939710] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-09-15T17:29:02.150539] [INFO ] [REMOTE ] BIT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:29:02.156683] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-09-15T17:29:02.242469] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:29:02.242863] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-09-15T17:29:02.314187] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-15T17:29:02.315447] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-09-15T17:29:02.558302] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-15T17:29:02.559478] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-09-15T17:29:02.635371] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-15T17:29:02.857810] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-09-15T17:29:02.914977] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-15T17:29:03.167280] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-15T17:29:03.302294] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-15T17:29:03.657872] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-09-15T17:29:03.795070] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-15T17:29:04.457872] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-09-15T17:29:04.591780] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-15T17:29:04.736216] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-15T17:29:05.257949] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-09-15T17:29:06.057904] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-09-15T17:29:06.214266] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-15T17:29:06.857923] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-09-15T17:29:07.427029] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-15T17:29:07.649444] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-15T17:29:07.659340] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-09-15T17:29:08.070356] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-15T17:29:08.457921] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-09-15T17:29:09.063943] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-15T17:29:09.257875] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-09-15T17:29:10.057916] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-09-15T17:29:10.577292] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-15T17:29:10.855343] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-15T17:29:10.865238] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-09-15T17:29:11.168779] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-15T17:29:11.657874] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-09-15T17:29:12.457883] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-09-15T17:29:13.000337] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-15T17:29:13.005209] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T17:29:13.257897] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-09-15T17:29:14.057877] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-09-15T17:29:14.487339] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-15T17:29:14.858317] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-09-15T17:29:14.864885] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T17:29:15.396508] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-15T17:29:15.657943] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-09-15T17:29:16.230473] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-15T17:29:16.231548] [INFO ] [REMOTE ] BIPI: Full fetch complete (3611 records). [2025-09-15T17:29:16.231614] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-09-15T17:29:16.467457] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-09-15T17:29:16.588410] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-09-15T17:29:16.588520] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-09-15T17:29:16.588693] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-09-15T17:29:16.588752] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-09-15T17:29:16.589127] [DEBUG] [LOCAL ] BIPI: Trimmed 3611 records to 2045 (keeping 150 days of data) [2025-09-15T17:29:16.602976] [DEBUG] [LOCAL ] BIPI: Primary data saved (2045 records). [2025-09-15T17:29:16.603044] [INFO ] [MAIN ] BIPI: Full history saved. [2025-09-15T17:29:16.603134] [INFO ] [MAIN ] Update Progress: 281/2369 symbols completed. BIPI took 17.4s. Estimated remaining: 3h 37m 8s. Rate: 9.6 symbols/min [2025-09-15T17:29:16.772873] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:29:16.821914] [DEBUG] [LOCAL ] BJ: Loaded 38619 existing records from primary storage. [2025-09-15T17:29:16.822141] [INFO ] [MAIN ] BJ: Loaded 38619 existing records. [2025-09-15T17:29:16.998771] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:29:16.999053] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-09-15T17:29:16.999115] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-09-15T17:29:16.999971] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-09-15T17:29:17.000025] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-09-15T17:29:17.263026] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-09-15T17:29:17.364526] [INFO ] [REMOTE ] BJ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:29:17.622467] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-15T17:29:17.836503] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-15T17:29:18.057879] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-09-15T17:29:18.468374] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-15T17:29:18.857920] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-09-15T17:29:19.657900] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-09-15T17:29:19.679853] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-15T17:29:20.457936] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-09-15T17:29:21.257897] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-09-15T17:29:21.320310] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-15T17:29:21.359689] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T17:29:21.364001] [INFO ] [REMOTE ] BIT: Full fetch complete (23275 records). [2025-09-15T17:29:21.364137] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-09-15T17:29:21.740974] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-09-15T17:29:21.741084] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-09-15T17:29:21.741485] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-09-15T17:29:21.741543] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-09-15T17:29:21.742956] [DEBUG] [LOCAL ] BIT: Trimmed 23275 records to 16393 (keeping 150 days of data) [2025-09-15T17:29:21.853123] [DEBUG] [LOCAL ] BIT: Primary data saved (16393 records). [2025-09-15T17:29:21.853274] [INFO ] [MAIN ] BIT: Full history saved. [2025-09-15T17:29:21.853361] [INFO ] [MAIN ] Update Progress: 282/2369 symbols completed. BIT took 22.6s. Estimated remaining: 3h 36m 54s. Rate: 9.6 symbols/min [2025-09-15T17:29:22.037887] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:29:22.057940] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-09-15T17:29:22.091758] [DEBUG] [LOCAL ] BK: Loaded 40340 existing records from primary storage. [2025-09-15T17:29:22.092004] [INFO ] [MAIN ] BK: Loaded 40340 existing records. [2025-09-15T17:29:22.276523] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:29:22.276907] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-09-15T17:29:22.276957] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-09-15T17:29:22.277936] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-09-15T17:29:22.277993] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-09-15T17:29:22.646760] [INFO ] [REMOTE ] BK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:29:22.650602] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-15T17:29:22.652349] [INFO ] [REMOTE ] BIPJ: Full fetch complete (3066 records). [2025-09-15T17:29:22.652482] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-09-15T17:29:22.868184] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-09-15T17:29:23.026253] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-15T17:29:23.057566] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-09-15T17:29:23.057702] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-09-15T17:29:23.057831] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-09-15T17:29:23.057888] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-09-15T17:29:23.058870] [DEBUG] [LOCAL ] BIPJ: Trimmed 3066 records to 2114 (keeping 150 days of data) [2025-09-15T17:29:23.073280] [DEBUG] [LOCAL ] BIPJ: Primary data saved (2114 records). [2025-09-15T17:29:23.073343] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-09-15T17:29:23.073431] [INFO ] [MAIN ] Update Progress: 283/2369 symbols completed. BIPJ took 23.8s. Estimated remaining: 3h 36m 11s. Rate: 9.6 symbols/min [2025-09-15T17:29:23.243183] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:29:23.288282] [DEBUG] [LOCAL ] BKD: Loaded 37868 existing records from primary storage. [2025-09-15T17:29:23.288429] [INFO ] [MAIN ] BKD: Loaded 37868 existing records. [2025-09-15T17:29:23.476987] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:29:23.477375] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-09-15T17:29:23.477428] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-09-15T17:29:23.478361] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-09-15T17:29:23.478418] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-09-15T17:29:23.660740] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-09-15T17:29:23.861423] [INFO ] [REMOTE ] BKD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:29:24.457920] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-09-15T17:29:24.605072] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-15T17:29:25.066473] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-15T17:29:25.257839] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-09-15T17:29:26.050451] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-15T17:29:26.059181] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-09-15T17:29:26.857880] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-09-15T17:29:26.943252] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T17:29:27.579386] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T17:29:27.657834] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-09-15T17:29:28.132386] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T17:29:28.137803] [INFO ] [REMOTE ] BIRK: Full fetch complete (55265 records). [2025-09-15T17:29:28.137898] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-09-15T17:29:28.470451] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-09-15T17:29:28.520791] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-09-15T17:29:28.520875] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-09-15T17:29:28.521502] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-09-15T17:29:28.521566] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-09-15T17:29:28.522770] [DEBUG] [LOCAL ] BIRK: Trimmed 55265 records to 37594 (keeping 150 days of data) [2025-09-15T17:29:28.748336] [DEBUG] [LOCAL ] BIRK: Primary data saved (37594 records). [2025-09-15T17:29:28.748488] [INFO ] [MAIN ] BIRK: Full history saved. [2025-09-15T17:29:28.748574] [INFO ] [MAIN ] Update Progress: 284/2369 symbols completed. BIRK took 29.5s. Estimated remaining: 3h 36m 1s. Rate: 9.7 symbols/min [2025-09-15T17:29:28.917801] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:29:28.940825] [DEBUG] [LOCAL ] BKE: Loaded 25219 existing records from primary storage. [2025-09-15T17:29:28.940960] [INFO ] [MAIN ] BKE: Loaded 25219 existing records. [2025-09-15T17:29:29.146673] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:29:29.147437] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-09-15T17:29:29.148530] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T17:29:29.159022] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-09-15T17:29:29.160065] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-09-15T17:29:29.160120] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-09-15T17:29:29.261764] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-09-15T17:29:29.511571] [INFO ] [REMOTE ] BKE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:29:29.945581] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-15T17:29:30.057925] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-09-15T17:29:30.590737] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T17:29:30.857909] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-09-15T17:29:31.662965] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-09-15T17:29:31.679970] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-15T17:29:32.137876] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T17:29:32.457882] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-09-15T17:29:32.777573] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-15T17:29:33.257925] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-09-15T17:29:33.769263] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-15T17:29:34.057901] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-09-15T17:29:34.627251] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-15T17:29:34.857900] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-09-15T17:29:35.657861] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-09-15T17:29:35.814565] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-15T17:29:36.457825] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-09-15T17:29:36.655439] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-15T17:29:36.702214] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-15T17:29:37.257927] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-09-15T17:29:38.057887] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-09-15T17:29:38.207064] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-15T17:29:38.778787] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-15T17:29:38.857882] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-09-15T17:29:39.073248] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-15T17:29:39.657898] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-09-15T17:29:40.457943] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-09-15T17:29:40.634672] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-15T17:29:41.235163] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-15T17:29:41.241046] [INFO ] [REMOTE ] BJ: Full fetch complete (55912 records). [2025-09-15T17:29:41.241192] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-09-15T17:29:41.263137] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-09-15T17:29:41.636389] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-09-15T17:29:41.636515] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-09-15T17:29:41.637259] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-09-15T17:29:41.637320] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-09-15T17:29:41.638931] [DEBUG] [LOCAL ] BJ: Trimmed 55912 records to 37884 (keeping 150 days of data) [2025-09-15T17:29:41.778094] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T17:29:41.935951] [DEBUG] [LOCAL ] BJ: Primary data saved (37884 records). [2025-09-15T17:29:41.936120] [INFO ] [MAIN ] BJ: Full history saved. [2025-09-15T17:29:41.936514] [INFO ] [MAIN ] Update Progress: 285/2369 symbols completed. BJ took 25.3s. Estimated remaining: 3h 36m 46s. Rate: 9.6 symbols/min [2025-09-15T17:29:42.063124] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-09-15T17:29:42.162582] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:29:42.195837] [DEBUG] [LOCAL ] BKH: Loaded 27760 existing records from primary storage. [2025-09-15T17:29:42.196003] [INFO ] [MAIN ] BKH: Loaded 27760 existing records. [2025-09-15T17:29:42.471577] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:29:42.471946] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-09-15T17:29:42.472009] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-09-15T17:29:42.472874] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-09-15T17:29:42.472949] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-09-15T17:29:42.866069] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-09-15T17:29:43.020685] [INFO ] [REMOTE ] BKH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:29:43.145851] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-15T17:29:43.188041] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-15T17:29:43.657875] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-09-15T17:29:44.412371] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-15T17:29:44.457835] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-09-15T17:29:45.095677] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-15T17:29:45.104202] [INFO ] [REMOTE ] BK: Full fetch complete (58246 records). [2025-09-15T17:29:45.104502] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-09-15T17:29:45.263028] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-09-15T17:29:45.566450] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-09-15T17:29:45.566562] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-09-15T17:29:45.567420] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-09-15T17:29:45.567470] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-09-15T17:29:45.569992] [DEBUG] [LOCAL ] BK: Trimmed 58246 records to 39555 (keeping 150 days of data) [2025-09-15T17:29:45.738136] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T17:29:45.878680] [DEBUG] [LOCAL ] BK: Primary data saved (39555 records). [2025-09-15T17:29:45.878862] [INFO ] [MAIN ] BK: Full history saved. [2025-09-15T17:29:45.880261] [INFO ] [MAIN ] Update Progress: 286/2369 symbols completed. BK took 24.0s. Estimated remaining: 3h 36m 23s. Rate: 9.6 symbols/min [2025-09-15T17:29:46.061444] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:29:46.061549] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-09-15T17:29:46.090505] [DEBUG] [LOCAL ] BKKT: Loaded 25840 existing records from primary storage. [2025-09-15T17:29:46.090737] [INFO ] [MAIN ] BKKT: Loaded 25840 existing records. [2025-09-15T17:29:46.276870] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:29:46.277123] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-09-15T17:29:46.277173] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-09-15T17:29:46.277866] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-09-15T17:29:46.277921] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-09-15T17:29:46.652017] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:29:46.699044] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-15T17:29:46.857883] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-09-15T17:29:47.563024] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-15T17:29:47.657929] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-09-15T17:29:48.179716] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T17:29:48.457875] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-09-15T17:29:49.176996] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-15T17:29:49.182843] [INFO ] [REMOTE ] BKD: Full fetch complete (54368 records). [2025-09-15T17:29:49.183004] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-09-15T17:29:49.263121] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-09-15T17:29:49.583073] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-09-15T17:29:49.583237] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-09-15T17:29:49.583927] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-09-15T17:29:49.584004] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-09-15T17:29:49.585399] [DEBUG] [LOCAL ] BKD: Trimmed 54368 records to 37053 (keeping 150 days of data) [2025-09-15T17:29:49.691240] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-15T17:29:49.823800] [DEBUG] [LOCAL ] BKD: Primary data saved (37053 records). [2025-09-15T17:29:49.823947] [INFO ] [MAIN ] BKD: Full history saved. [2025-09-15T17:29:49.824813] [INFO ] [MAIN ] Update Progress: 287/2369 symbols completed. BKD took 26.8s. Estimated remaining: 3h 35m 60s. Rate: 9.6 symbols/min [2025-09-15T17:29:50.001547] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:29:50.010409] [DEBUG] [LOCAL ] BKN: Loaded 5520 existing records from primary storage. [2025-09-15T17:29:50.010542] [INFO ] [MAIN ] BKN: Loaded 5520 existing records. [2025-09-15T17:29:50.065965] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-09-15T17:29:50.188966] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:29:50.189221] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-09-15T17:29:50.189268] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-09-15T17:29:50.189597] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-09-15T17:29:50.189662] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-09-15T17:29:50.552984] [INFO ] [REMOTE ] BKN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:29:50.657847] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-15T17:29:50.857882] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-09-15T17:29:51.365729] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T17:29:51.657857] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-09-15T17:29:52.137120] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T17:29:52.457866] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-09-15T17:29:52.769313] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T17:29:52.963692] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-15T17:29:53.257833] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-09-15T17:29:54.057940] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-09-15T17:29:54.578982] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T17:29:54.857898] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-09-15T17:29:55.122397] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T17:29:55.657908] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-09-15T17:29:55.780390] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-15T17:29:56.457880] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-09-15T17:29:56.979940] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T17:29:56.984775] [INFO ] [REMOTE ] BKE: Full fetch complete (37997 records). [2025-09-15T17:29:56.984916] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-09-15T17:29:57.263026] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-09-15T17:29:57.365609] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-09-15T17:29:57.365720] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-09-15T17:29:57.366259] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-09-15T17:29:57.366312] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-09-15T17:29:57.367346] [DEBUG] [LOCAL ] BKE: Trimmed 37997 records to 24727 (keeping 150 days of data) [2025-09-15T17:29:57.521396] [DEBUG] [LOCAL ] BKE: Primary data saved (24727 records). [2025-09-15T17:29:57.521531] [INFO ] [MAIN ] BKE: Full history saved. [2025-09-15T17:29:57.521652] [INFO ] [MAIN ] Update Progress: 288/2369 symbols completed. BKE took 28.8s. Estimated remaining: 3h 36m 4s. Rate: 9.6 symbols/min [2025-09-15T17:29:57.697939] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T17:29:57.721931] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:29:57.758693] [DEBUG] [LOCAL ] BKSY: Loaded 36355 existing records from primary storage. [2025-09-15T17:29:57.758842] [INFO ] [MAIN ] BKSY: Loaded 36355 existing records. [2025-09-15T17:29:57.890328] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-15T17:29:57.948699] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:29:57.948978] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-09-15T17:29:57.949028] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-09-15T17:29:57.949909] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-09-15T17:29:57.949962] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-09-15T17:29:58.063019] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-09-15T17:29:58.300487] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:29:58.857927] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-09-15T17:29:58.948738] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-15T17:29:59.657870] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-09-15T17:30:00.341977] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-15T17:30:00.457882] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-09-15T17:30:00.495228] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-15T17:30:01.079431] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-15T17:30:01.257875] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-09-15T17:30:02.057883] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-09-15T17:30:02.857889] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-09-15T17:30:03.657917] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-09-15T17:30:03.696842] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-15T17:30:04.457909] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-09-15T17:30:06.128136] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (4.07 seconds). [2025-09-15T17:30:06.138819] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-09-15T17:30:06.169512] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-15T17:30:06.173233] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-09-15T17:30:06.174814] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (3.32 seconds). [2025-09-15T17:30:06.782616] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-15T17:30:06.787554] [INFO ] [REMOTE ] BKKT: Full fetch complete (36037 records). [2025-09-15T17:30:06.787711] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-09-15T17:30:06.867946] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-09-15T17:30:06.894717] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-15T17:30:07.181958] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-09-15T17:30:07.182036] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-09-15T17:30:07.182491] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-09-15T17:30:07.182530] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-09-15T17:30:07.183349] [DEBUG] [LOCAL ] BKKT: Trimmed 36037 records to 25845 (keeping 150 days of data) [2025-09-15T17:30:07.348182] [DEBUG] [LOCAL ] BKKT: Primary data saved (25845 records). [2025-09-15T17:30:07.348380] [INFO ] [MAIN ] BKKT: Full history saved. [2025-09-15T17:30:07.348489] [INFO ] [MAIN ] Update Progress: 289/2369 symbols completed. BKKT took 21.5s. Estimated remaining: 3h 36m 24s. Rate: 9.6 symbols/min [2025-09-15T17:30:07.521447] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:30:07.532144] [DEBUG] [LOCAL ] BKT: Loaded 7512 existing records from primary storage. [2025-09-15T17:30:07.532303] [INFO ] [MAIN ] BKT: Loaded 7512 existing records. [2025-09-15T17:30:07.663079] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-09-15T17:30:07.724008] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:30:07.724269] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-09-15T17:30:07.724323] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-09-15T17:30:07.724687] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-09-15T17:30:07.724753] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-09-15T17:30:08.082189] [INFO ] [REMOTE ] BKT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:30:08.140092] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-15T17:30:08.185705] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-15T17:30:08.405177] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-15T17:30:08.406571] [INFO ] [REMOTE ] BKN: Full fetch complete (8122 records). [2025-09-15T17:30:08.406638] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-09-15T17:30:08.467049] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-09-15T17:30:08.760951] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-09-15T17:30:08.761036] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-09-15T17:30:08.761240] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-09-15T17:30:08.761278] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-09-15T17:30:08.761699] [DEBUG] [LOCAL ] BKN: Trimmed 8122 records to 5415 (keeping 150 days of data) [2025-09-15T17:30:08.795481] [DEBUG] [LOCAL ] BKN: Primary data saved (5415 records). [2025-09-15T17:30:08.795611] [INFO ] [MAIN ] BKN: Full history saved. [2025-09-15T17:30:08.795723] [INFO ] [MAIN ] Update Progress: 290/2369 symbols completed. BKN took 19.0s. Estimated remaining: 3h 35m 43s. Rate: 9.6 symbols/min [2025-09-15T17:30:08.963493] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:30:08.999282] [DEBUG] [LOCAL ] BKU: Loaded 31235 existing records from primary storage. [2025-09-15T17:30:08.999457] [INFO ] [MAIN ] BKU: Loaded 31235 existing records. [2025-09-15T17:30:09.177574] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:30:09.177870] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-09-15T17:30:09.177917] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-09-15T17:30:09.178594] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-09-15T17:30:09.178675] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-09-15T17:30:09.267684] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-09-15T17:30:09.535137] [INFO ] [REMOTE ] BKU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:30:09.952592] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-15T17:30:10.057875] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-09-15T17:30:10.735434] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T17:30:10.857987] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-09-15T17:30:10.991701] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-15T17:30:10.995913] [INFO ] [REMOTE ] BKH: Full fetch complete (39470 records). [2025-09-15T17:30:10.995992] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-09-15T17:30:11.361098] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-09-15T17:30:11.361177] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-09-15T17:30:11.361696] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-09-15T17:30:11.361762] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-09-15T17:30:11.362660] [DEBUG] [LOCAL ] BKH: Trimmed 39470 records to 27296 (keeping 150 days of data) [2025-09-15T17:30:11.540335] [DEBUG] [LOCAL ] BKH: Primary data saved (27296 records). [2025-09-15T17:30:11.540528] [INFO ] [MAIN ] BKH: Full history saved. [2025-09-15T17:30:11.540875] [INFO ] [MAIN ] Update Progress: 291/2369 symbols completed. BKH took 29.6s. Estimated remaining: 3h 35m 12s. Rate: 9.7 symbols/min [2025-09-15T17:30:11.662952] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-09-15T17:30:11.715085] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:30:11.738668] [DEBUG] [LOCAL ] BKV: Loaded 21330 existing records from primary storage. [2025-09-15T17:30:11.738822] [INFO ] [MAIN ] BKV: Loaded 21330 existing records. [2025-09-15T17:30:11.936874] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:30:11.937134] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-09-15T17:30:11.937188] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-09-15T17:30:11.937762] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-09-15T17:30:11.937812] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-09-15T17:30:12.290241] [INFO ] [REMOTE ] BKV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:30:12.457852] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-09-15T17:30:12.546917] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-15T17:30:13.257876] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-09-15T17:30:13.785980] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-15T17:30:14.057888] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-09-15T17:30:14.138786] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-09-15T17:30:14.857911] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-09-15T17:30:15.253889] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-15T17:30:15.657850] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-09-15T17:30:15.697431] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T17:30:15.808140] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-15T17:30:16.346851] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-15T17:30:16.457892] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-09-15T17:30:17.257886] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-09-15T17:30:17.761579] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-15T17:30:17.889994] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T17:30:18.057877] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-09-15T17:30:18.857958] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-09-15T17:30:19.657893] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-09-15T17:30:19.959354] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-15T17:30:20.261087] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-15T17:30:20.457914] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-09-15T17:30:21.257854] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-09-15T17:30:21.429548] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-15T17:30:21.757925] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-15T17:30:21.885727] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-15T17:30:22.057873] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-09-15T17:30:22.857880] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-09-15T17:30:23.396877] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-15T17:30:23.554244] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-15T17:30:23.657847] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-09-15T17:30:24.457892] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-09-15T17:30:25.257846] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-09-15T17:30:25.425753] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-15T17:30:25.478434] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-15T17:30:25.483932] [INFO ] [REMOTE ] BKSY: Full fetch complete (52747 records). [2025-09-15T17:30:25.484037] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-09-15T17:30:25.870129] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-09-15T17:30:25.870221] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-09-15T17:30:25.870916] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-09-15T17:30:25.870971] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-09-15T17:30:25.872112] [DEBUG] [LOCAL ] BKSY: Trimmed 52747 records to 35899 (keeping 150 days of data) [2025-09-15T17:30:26.059786] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-09-15T17:30:26.087480] [DEBUG] [LOCAL ] BKSY: Primary data saved (35899 records). [2025-09-15T17:30:26.087603] [INFO ] [MAIN ] BKSY: Full history saved. [2025-09-15T17:30:26.088177] [INFO ] [MAIN ] Update Progress: 292/2369 symbols completed. BKSY took 28.6s. Estimated remaining: 3h 36m 5s. Rate: 9.6 symbols/min [2025-09-15T17:30:26.257258] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:30:26.284616] [DEBUG] [LOCAL ] BLCO: Loaded 26908 existing records from primary storage. [2025-09-15T17:30:26.284778] [INFO ] [MAIN ] BLCO: Loaded 26908 existing records. [2025-09-15T17:30:26.469315] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:30:26.469669] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-09-15T17:30:26.469740] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-09-15T17:30:26.470378] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-09-15T17:30:26.470446] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-09-15T17:30:26.782901] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-15T17:30:26.842823] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:30:26.865324] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-09-15T17:30:26.870280] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T17:30:27.657876] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-09-15T17:30:27.847015] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-15T17:30:28.417221] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-15T17:30:28.457830] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-09-15T17:30:29.257898] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-09-15T17:30:29.391320] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-15T17:30:29.393666] [INFO ] [REMOTE ] BKT: Full fetch complete (10978 records). [2025-09-15T17:30:29.393742] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-09-15T17:30:29.772019] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-09-15T17:30:29.772141] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-09-15T17:30:29.772442] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-09-15T17:30:29.772516] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-09-15T17:30:29.773246] [DEBUG] [LOCAL ] BKT: Trimmed 10978 records to 7700 (keeping 150 days of data) [2025-09-15T17:30:29.822915] [DEBUG] [LOCAL ] BKT: Primary data saved (7700 records). [2025-09-15T17:30:29.823062] [INFO ] [MAIN ] BKT: Full history saved. [2025-09-15T17:30:29.823162] [INFO ] [MAIN ] Update Progress: 293/2369 symbols completed. BKT took 22.5s. Estimated remaining: 3h 35m 41s. Rate: 9.6 symbols/min [2025-09-15T17:30:30.003816] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:30:30.024500] [DEBUG] [LOCAL ] BLD: Loaded 20705 existing records from primary storage. [2025-09-15T17:30:30.024678] [INFO ] [MAIN ] BLD: Loaded 20705 existing records. [2025-09-15T17:30:30.062954] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-09-15T17:30:30.241208] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:30:30.241569] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-09-15T17:30:30.241632] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-09-15T17:30:30.242207] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-09-15T17:30:30.242375] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-09-15T17:30:30.335945] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-15T17:30:30.622148] [INFO ] [REMOTE ] BLD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:30:30.857889] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-09-15T17:30:31.254698] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-15T17:30:31.657895] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-09-15T17:30:32.307104] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T17:30:32.457890] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-09-15T17:30:32.640876] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-15T17:30:33.257903] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-09-15T17:30:33.809625] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T17:30:34.057882] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-09-15T17:30:34.567490] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T17:30:34.857963] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-09-15T17:30:35.126992] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-15T17:30:35.657943] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-09-15T17:30:35.938948] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-15T17:30:36.457881] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-09-15T17:30:37.148078] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T17:30:37.257861] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-09-15T17:30:37.337934] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-15T17:30:38.057887] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-09-15T17:30:38.591773] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-15T17:30:38.857890] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-09-15T17:30:39.459169] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-15T17:30:39.657884] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-09-15T17:30:39.976295] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-15T17:30:39.980782] [INFO ] [REMOTE ] BKU: Full fetch complete (45240 records). [2025-09-15T17:30:39.980894] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-09-15T17:30:40.349077] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-09-15T17:30:40.349158] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-09-15T17:30:40.349704] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-09-15T17:30:40.349749] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-09-15T17:30:40.350731] [DEBUG] [LOCAL ] BKU: Trimmed 45240 records to 30685 (keeping 150 days of data) [2025-09-15T17:30:40.461178] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-09-15T17:30:40.548289] [DEBUG] [LOCAL ] BKU: Primary data saved (30685 records). [2025-09-15T17:30:40.548443] [INFO ] [MAIN ] BKU: Full history saved. [2025-09-15T17:30:40.548533] [INFO ] [MAIN ] Update Progress: 294/2369 symbols completed. BKU took 31.8s. Estimated remaining: 3h 36m 7s. Rate: 9.6 symbols/min [2025-09-15T17:30:40.719124] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:30:40.733898] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-15T17:30:40.779499] [DEBUG] [LOCAL ] BLDR: Loaded 39059 existing records from primary storage. [2025-09-15T17:30:40.779677] [INFO ] [MAIN ] BLDR: Loaded 39059 existing records. [2025-09-15T17:30:40.955893] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:30:40.956185] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-09-15T17:30:40.956234] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-09-15T17:30:40.957124] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-09-15T17:30:40.957184] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-09-15T17:30:41.262986] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-09-15T17:30:41.317192] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:30:41.648829] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T17:30:42.057937] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-09-15T17:30:42.638950] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-15T17:30:42.766187] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-15T17:30:42.769240] [INFO ] [REMOTE ] BKV: Full fetch complete (33403 records). [2025-09-15T17:30:42.769358] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-09-15T17:30:42.866740] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-09-15T17:30:43.144105] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-09-15T17:30:43.144181] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-09-15T17:30:43.144655] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-09-15T17:30:43.144709] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-09-15T17:30:43.145587] [DEBUG] [LOCAL ] BKV: Trimmed 33403 records to 20925 (keeping 150 days of data) [2025-09-15T17:30:43.275342] [DEBUG] [LOCAL ] BKV: Primary data saved (20925 records). [2025-09-15T17:30:43.275481] [INFO ] [MAIN ] BKV: Full history saved. [2025-09-15T17:30:43.275633] [INFO ] [MAIN ] Update Progress: 295/2369 symbols completed. BKV took 31.7s. Estimated remaining: 3h 35m 36s. Rate: 9.6 symbols/min [2025-09-15T17:30:43.446818] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:30:43.459619] [DEBUG] [LOCAL ] BLE: Loaded 10534 existing records from primary storage. [2025-09-15T17:30:43.459774] [INFO ] [MAIN ] BLE: Loaded 10534 existing records. [2025-09-15T17:30:43.637848] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:30:43.638099] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-09-15T17:30:43.638147] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-09-15T17:30:43.638483] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-09-15T17:30:43.638530] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-09-15T17:30:43.670228] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-09-15T17:30:44.011664] [INFO ] [REMOTE ] BLE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:30:44.278131] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-15T17:30:44.457852] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-09-15T17:30:44.733882] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-15T17:30:45.257917] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-09-15T17:30:45.285715] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-15T17:30:46.057918] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-09-15T17:30:46.810794] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-15T17:30:46.857858] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-09-15T17:30:47.288270] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T17:30:47.657945] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-09-15T17:30:48.433155] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T17:30:48.457843] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-09-15T17:30:48.546857] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-15T17:30:48.550763] [INFO ] [REMOTE ] BLCO: Full fetch complete (39980 records). [2025-09-15T17:30:48.550926] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-09-15T17:30:48.552869] [FATAL] [VALIDATOR ] BLCO: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:30:48.552958] [FATAL] [MAIN ] BLCO: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:30:48.553013] [WARN ] [MAIN ] BLCO: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:30:48.553082] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-09-15T17:30:48.553163] [DEBUG] [LOCAL ] BLCO: No primary data file found to delete. [2025-09-15T17:30:48.553220] [INFO ] [LOCAL ] BLCO: Starting deletion of derivative data. [2025-09-15T17:30:48.553696] [DEBUG] [LOCAL ] BLCO: Deleted derivative data file. [2025-09-15T17:30:48.553837] [INFO ] [MAIN ] Update Progress: 296/2369 symbols completed. BLCO took 22.5s. Estimated remaining: 3h 35m 23s. Rate: 9.6 symbols/min [2025-09-15T17:30:48.728000] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:30:48.753899] [DEBUG] [LOCAL ] BLK: Loaded 24978 existing records from primary storage. [2025-09-15T17:30:48.754041] [INFO ] [MAIN ] BLK: Loaded 24978 existing records. [2025-09-15T17:30:48.931042] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:30:48.931314] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-09-15T17:30:48.931362] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-09-15T17:30:48.932005] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-09-15T17:30:48.932054] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-09-15T17:30:49.261425] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-09-15T17:30:49.288154] [INFO ] [REMOTE ] BLK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:30:49.324177] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-15T17:30:49.327938] [INFO ] [REMOTE ] BLD: Full fetch complete (30845 records). [2025-09-15T17:30:49.328078] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-09-15T17:30:49.699940] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-09-15T17:30:49.700037] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-09-15T17:30:49.700491] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-09-15T17:30:49.700539] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-09-15T17:30:49.701538] [DEBUG] [LOCAL ] BLD: Trimmed 30845 records to 20372 (keeping 150 days of data) [2025-09-15T17:30:49.832566] [DEBUG] [LOCAL ] BLD: Primary data saved (20372 records). [2025-09-15T17:30:49.832732] [INFO ] [MAIN ] BLD: Full history saved. [2025-09-15T17:30:49.832842] [INFO ] [MAIN ] Update Progress: 297/2369 symbols completed. BLD took 20.0s. Estimated remaining: 3h 34m 42s. Rate: 9.7 symbols/min [2025-09-15T17:30:50.020597] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:30:50.057994] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-09-15T17:30:50.059809] [DEBUG] [LOCAL ] BLND: Loaded 36755 existing records from primary storage. [2025-09-15T17:30:50.060045] [INFO ] [MAIN ] BLND: Loaded 36755 existing records. [2025-09-15T17:30:50.244346] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:30:50.244673] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-09-15T17:30:50.244855] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-09-15T17:30:50.250926] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-09-15T17:30:50.254734] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-09-15T17:30:50.299256] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-15T17:30:50.617268] [INFO ] [REMOTE ] BLND: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:30:50.857869] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-09-15T17:30:51.659221] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-09-15T17:30:51.661717] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T17:30:52.459952] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-09-15T17:30:52.467766] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-15T17:30:52.469837] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-15T17:30:53.257877] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-09-15T17:30:54.057865] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-09-15T17:30:54.114101] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T17:30:54.776954] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T17:30:54.857829] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-09-15T17:30:55.657880] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-09-15T17:30:55.724761] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-15T17:30:56.111608] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-15T17:30:56.457873] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-09-15T17:30:57.257871] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-09-15T17:30:57.447195] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-15T17:30:57.530820] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-15T17:30:57.901751] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-15T17:30:58.057875] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-09-15T17:30:58.857885] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-09-15T17:30:59.482600] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-15T17:30:59.657901] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-09-15T17:31:00.314273] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T17:31:00.457873] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-09-15T17:31:00.995246] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-15T17:31:01.257890] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-09-15T17:31:02.008426] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T17:31:02.057878] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-09-15T17:31:02.370814] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T17:31:02.857879] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-09-15T17:31:03.484037] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-15T17:31:03.657905] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-09-15T17:31:03.833402] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-15T17:31:04.457962] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-09-15T17:31:04.929141] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T17:31:04.934930] [INFO ] [REMOTE ] BLND: Full fetch complete (53945 records). [2025-09-15T17:31:04.935034] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-09-15T17:31:05.263003] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-09-15T17:31:05.359592] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-09-15T17:31:05.359692] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-09-15T17:31:05.360293] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-09-15T17:31:05.360335] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-09-15T17:31:05.362461] [DEBUG] [LOCAL ] BLND: Trimmed 53945 records to 36059 (keeping 150 days of data) [2025-09-15T17:31:05.574768] [DEBUG] [LOCAL ] BLND: Primary data saved (36059 records). [2025-09-15T17:31:05.574937] [INFO ] [MAIN ] BLND: Full history saved. [2025-09-15T17:31:05.575051] [INFO ] [MAIN ] Update Progress: 298/2369 symbols completed. BLND took 15.7s. Estimated remaining: 3h 35m 42s. Rate: 9.6 symbols/min [2025-09-15T17:31:05.746894] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:31:05.747086] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-09-15T17:31:05.747125] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-09-15T17:31:05.747257] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-09-15T17:31:05.747321] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-15T17:31:05.747366] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-15T17:31:05.747401] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-09-15T17:31:06.071997] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-09-15T17:31:06.097849] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:31:06.142853] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-15T17:31:06.857896] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-09-15T17:31:06.874450] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-15T17:31:07.027213] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-15T17:31:07.657897] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-09-15T17:31:08.388687] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-15T17:31:08.457934] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-09-15T17:31:09.164788] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T17:31:09.189044] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T17:31:09.257877] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-09-15T17:31:10.057926] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-09-15T17:31:10.348777] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-15T17:31:10.857841] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-09-15T17:31:11.081296] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T17:31:11.083204] [INFO ] [REMOTE ] BLE: Full fetch complete (15587 records). [2025-09-15T17:31:11.083275] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-09-15T17:31:11.447311] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-09-15T17:31:11.447418] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-09-15T17:31:11.447786] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-09-15T17:31:11.447835] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-09-15T17:31:11.448338] [DEBUG] [LOCAL ] BLE: Trimmed 15587 records to 10139 (keeping 150 days of data) [2025-09-15T17:31:11.510282] [DEBUG] [LOCAL ] BLE: Primary data saved (10139 records). [2025-09-15T17:31:11.510412] [INFO ] [MAIN ] BLE: Full history saved. [2025-09-15T17:31:11.510496] [INFO ] [MAIN ] Update Progress: 299/2369 symbols completed. BLE took 28.2s. Estimated remaining: 3h 35m 34s. Rate: 9.6 symbols/min [2025-09-15T17:31:11.678197] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-02. [2025-09-15T17:31:11.681418] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:31:11.692616] [DEBUG] [LOCAL ] BLW: Loaded 9026 existing records from primary storage. [2025-09-15T17:31:11.692742] [INFO ] [MAIN ] BLW: Loaded 9026 existing records. [2025-09-15T17:31:11.872763] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:31:11.872983] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-09-15T17:31:11.873028] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-09-15T17:31:11.873358] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-09-15T17:31:11.873405] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-09-15T17:31:11.910806] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:31:11.953974] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-02 [2025-09-15T17:31:12.231276] [INFO ] [REMOTE ] BLW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:31:12.241528] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-15T17:31:12.245349] [INFO ] [REMOTE ] BLK: Full fetch complete (39180 records). [2025-09-15T17:31:12.245424] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-09-15T17:31:12.462983] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-03. [2025-09-15T17:31:12.619508] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-09-15T17:31:12.619592] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-09-15T17:31:12.620095] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-09-15T17:31:12.620138] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-09-15T17:31:12.621063] [DEBUG] [LOCAL ] BLK: Trimmed 39180 records to 24344 (keeping 150 days of data) [2025-09-15T17:31:12.787834] [DEBUG] [LOCAL ] BLK: Primary data saved (24344 records). [2025-09-15T17:31:12.787974] [INFO ] [MAIN ] BLK: Full history saved. [2025-09-15T17:31:12.788071] [INFO ] [MAIN ] Update Progress: 300/2369 symbols completed. BLK took 24.2s. Estimated remaining: 3h 34m 53s. Rate: 9.6 symbols/min [2025-09-15T17:31:12.832356] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:31:12.870151] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-03 [2025-09-15T17:31:12.963779] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:31:12.975418] [DEBUG] [LOCAL ] BLX: Loaded 11179 existing records from primary storage. [2025-09-15T17:31:12.975518] [INFO ] [MAIN ] BLX: Loaded 11179 existing records. [2025-09-15T17:31:13.152225] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:31:13.152520] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-09-15T17:31:13.152569] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-09-15T17:31:13.153006] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-09-15T17:31:13.153058] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-09-15T17:31:13.262940] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-09-15T17:31:13.515472] [INFO ] [REMOTE ] BLX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:31:14.057884] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-04. [2025-09-15T17:31:14.160848] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-15T17:31:14.311759] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:31:14.312165] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-04 [2025-09-15T17:31:14.857909] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-09-15T17:31:15.413065] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-15T17:31:15.657876] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-09-15T17:31:16.457885] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-09-15T17:31:16.883865] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-15T17:31:17.258011] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-05. [2025-09-15T17:31:17.441832] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:31:17.442350] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-05 [2025-09-15T17:31:18.057889] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-09-15T17:31:18.132662] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-15T17:31:18.137926] [INFO ] [REMOTE ] BLDR: Full fetch complete (55720 records). [2025-09-15T17:31:18.138050] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-09-15T17:31:18.140345] [FATAL] [VALIDATOR ] BLDR: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:31:18.140430] [FATAL] [MAIN ] BLDR: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:31:18.140470] [WARN ] [MAIN ] BLDR: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:31:18.140516] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-09-15T17:31:18.140577] [DEBUG] [LOCAL ] BLDR: No primary data file found to delete. [2025-09-15T17:31:18.140617] [INFO ] [LOCAL ] BLDR: Starting deletion of derivative data. [2025-09-15T17:31:18.140953] [DEBUG] [LOCAL ] BLDR: Deleted derivative data file. [2025-09-15T17:31:18.142429] [INFO ] [MAIN ] Update Progress: 301/2369 symbols completed. BLDR took 37.6s. Estimated remaining: 3h 34m 41s. Rate: 9.6 symbols/min [2025-09-15T17:31:18.312349] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:31:18.346373] [DEBUG] [LOCAL ] BMA: Loaded 25819 existing records from primary storage. [2025-09-15T17:31:18.346520] [INFO ] [MAIN ] BMA: Loaded 25819 existing records. [2025-09-15T17:31:18.529560] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:31:18.529876] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-09-15T17:31:18.529925] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-09-15T17:31:18.530577] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-09-15T17:31:18.530633] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-09-15T17:31:18.862946] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-06. [2025-09-15T17:31:18.892041] [INFO ] [REMOTE ] BMA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:31:18.939681] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-15T17:31:19.082827] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:31:19.083122] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-06 [2025-09-15T17:31:19.657871] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-09-15T17:31:20.457888] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-09-15T17:31:20.480771] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T17:31:21.257916] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-09-15T17:31:21.855389] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T17:31:22.034779] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-15T17:31:22.057852] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-09-15T17:31:22.857902] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-09-15T17:31:23.063968] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-15T17:31:23.407278] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-15T17:31:23.657851] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-09-15T17:31:24.258392] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-15T17:31:24.457875] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-09-15T17:31:25.257933] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-09-15T17:31:25.841854] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T17:31:26.057872] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-09-15T17:31:26.325660] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T17:31:26.857883] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-09-15T17:31:27.084919] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-15T17:31:27.621832] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-15T17:31:27.625451] [INFO ] [REMOTE ] BLW: Full fetch complete (14065 records). [2025-09-15T17:31:27.636453] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-09-15T17:31:27.664701] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-09-15T17:31:28.198251] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-09-15T17:31:28.198353] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-09-15T17:31:28.198765] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-09-15T17:31:28.198812] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-09-15T17:31:28.199614] [DEBUG] [LOCAL ] BLW: Trimmed 14065 records to 8953 (keeping 150 days of data) [2025-09-15T17:31:28.264830] [DEBUG] [LOCAL ] BLW: Primary data saved (8953 records). [2025-09-15T17:31:28.265008] [INFO ] [MAIN ] BLW: Full history saved. [2025-09-15T17:31:28.265102] [INFO ] [MAIN ] Update Progress: 302/2369 symbols completed. BLW took 16.8s. Estimated remaining: 3h 35m 1s. Rate: 9.6 symbols/min [2025-09-15T17:31:28.467447] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-07. [2025-09-15T17:31:28.471246] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:31:28.482047] [DEBUG] [LOCAL ] BME: Loaded 8191 existing records from primary storage. [2025-09-15T17:31:28.482192] [INFO ] [MAIN ] BME: Loaded 8191 existing records. [2025-09-15T17:31:28.675766] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:31:28.676057] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-09-15T17:31:28.676194] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-09-15T17:31:28.676657] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-09-15T17:31:28.681840] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-09-15T17:31:28.691090] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:31:28.760687] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-15T17:31:28.773037] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-07 [2025-09-15T17:31:29.084725] [INFO ] [REMOTE ] BME: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:31:29.257914] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-09-15T17:31:30.057892] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-09-15T17:31:30.162388] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-15T17:31:30.802956] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-15T17:31:30.857824] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-09-15T17:31:31.582110] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-15T17:31:31.657919] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-08. [2025-09-15T17:31:32.457917] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-09-15T17:31:33.257859] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-09-15T17:31:33.287710] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T17:31:33.303516] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-15T17:31:34.057908] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-09-15T17:31:34.696596] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-15T17:31:34.844099] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-15T17:31:34.857870] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-09-15T17:31:35.627871] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-15T17:31:35.657877] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-09-15T17:31:36.457911] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-09. [2025-09-15T17:31:36.472614] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-15T17:31:37.257874] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-09-15T17:31:38.057880] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-09-15T17:31:38.220445] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-15T17:31:38.818437] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-15T17:31:38.824340] [INFO ] [REMOTE ] BLSH: Full fetch complete (8714 records). [2025-09-15T17:31:38.824440] [DEBUG] [VALIDATOR ] BLSH: Validating primary data. [2025-09-15T17:31:38.862976] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-09-15T17:31:39.035859] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-15T17:31:39.043050] [WARN ] [VALIDATOR ] BLSH: Validation failed - insufficient historical data. Have 23 unique days, need 150 days [2025-09-15T17:31:39.043301] [FATAL] [MAIN ] BLSH: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:31:39.046296] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:31:39.046354] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-15T17:31:39.046435] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-15T17:31:39.046472] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-09-15T17:31:39.046512] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-09-15T17:31:39.046570] [INFO ] [MAIN ] Update Progress: 303/2369 symbols completed. BLSH took 33.5s. Estimated remaining: 3h 35m 26s. Rate: 9.6 symbols/min [2025-09-15T17:31:39.233753] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:31:39.253884] [DEBUG] [LOCAL ] BMEZ: Loaded 18009 existing records from primary storage. [2025-09-15T17:31:39.254021] [INFO ] [MAIN ] BMEZ: Loaded 18009 existing records. [2025-09-15T17:31:39.430771] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:31:39.431016] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-09-15T17:31:39.431064] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-09-15T17:31:39.431681] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-09-15T17:31:39.431737] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-09-15T17:31:39.667977] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-09-15T17:31:39.813405] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:31:39.900103] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-15T17:31:40.399176] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T17:31:40.457843] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-09-15T17:31:41.160971] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T17:31:41.162741] [INFO ] [REMOTE ] BME: Full fetch complete (11334 records). [2025-09-15T17:31:41.162818] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-09-15T17:31:41.163282] [FATAL] [VALIDATOR ] BME: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:31:41.163366] [FATAL] [MAIN ] BME: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:31:41.163404] [WARN ] [MAIN ] BME: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:31:41.163445] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-09-15T17:31:41.163520] [DEBUG] [LOCAL ] BME: No primary data file found to delete. [2025-09-15T17:31:41.163559] [INFO ] [LOCAL ] BME: Starting deletion of derivative data. [2025-09-15T17:31:41.163889] [DEBUG] [LOCAL ] BME: Deleted derivative data file. [2025-09-15T17:31:41.163995] [INFO ] [MAIN ] Update Progress: 304/2369 symbols completed. BME took 12.9s. Estimated remaining: 3h 34m 52s. Rate: 9.6 symbols/min [2025-09-15T17:31:41.265077] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-09-15T17:31:41.345467] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:31:41.364322] [DEBUG] [LOCAL ] BMI: Loaded 17696 existing records from primary storage. [2025-09-15T17:31:41.364464] [INFO ] [MAIN ] BMI: Loaded 17696 existing records. [2025-09-15T17:31:41.562995] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:31:41.563340] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-09-15T17:31:41.563398] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-09-15T17:31:41.563950] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-09-15T17:31:41.564024] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-09-15T17:31:41.935614] [INFO ] [REMOTE ] BMI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:31:42.057883] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-09-15T17:31:42.273462] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T17:31:42.857890] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-09-15T17:31:43.221211] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T17:31:43.657894] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-09-15T17:31:44.204546] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T17:31:44.457906] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-09-15T17:31:44.727497] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-15T17:31:45.257954] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-09-15T17:31:45.623057] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-15T17:31:46.063001] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-09-15T17:31:46.073601] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-15T17:31:46.857895] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-09-15T17:31:47.089782] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-15T17:31:47.657907] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-09-15T17:31:48.205414] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T17:31:48.210364] [INFO ] [REMOTE ] BMA: Full fetch complete (37688 records). [2025-09-15T17:31:48.210455] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-09-15T17:31:48.464531] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-09-15T17:31:48.604546] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-09-15T17:31:48.604678] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-09-15T17:31:48.605267] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-09-15T17:31:48.605330] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-09-15T17:31:48.606700] [DEBUG] [LOCAL ] BMA: Trimmed 37688 records to 25268 (keeping 150 days of data) [2025-09-15T17:31:48.770703] [DEBUG] [LOCAL ] BMA: Primary data saved (25268 records). [2025-09-15T17:31:48.770854] [INFO ] [MAIN ] BMA: Full history saved. [2025-09-15T17:31:48.770948] [INFO ] [MAIN ] Update Progress: 305/2369 symbols completed. BMA took 30.6s. Estimated remaining: 3h 34m 54s. Rate: 9.6 symbols/min [2025-09-15T17:31:48.959667] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:31:48.981336] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-15T17:31:48.980622] [DEBUG] [LOCAL ] BMN: Loaded 1921 existing records from primary storage. [2025-09-15T17:31:48.987701] [INFO ] [MAIN ] BMN: Loaded 1921 existing records. [2025-09-15T17:31:49.171574] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:31:49.172368] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-09-15T17:31:49.172415] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-09-15T17:31:49.172590] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-09-15T17:31:49.172634] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-09-15T17:31:49.263442] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-09-15T17:31:49.535351] [INFO ] [REMOTE ] BMN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:31:49.570081] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T17:31:50.057838] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-09-15T17:31:50.227128] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-15T17:31:50.229067] [INFO ] [REMOTE ] BLX: Full fetch complete (16983 records). [2025-09-15T17:31:50.229139] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-09-15T17:31:50.229667] [FATAL] [VALIDATOR ] BLX: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:31:50.229742] [FATAL] [MAIN ] BLX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:31:50.229780] [WARN ] [MAIN ] BLX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:31:50.229820] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-09-15T17:31:50.229914] [DEBUG] [LOCAL ] BLX: No primary data file found to delete. [2025-09-15T17:31:50.229968] [INFO ] [LOCAL ] BLX: Starting deletion of derivative data. [2025-09-15T17:31:50.230324] [DEBUG] [LOCAL ] BLX: Deleted derivative data file. [2025-09-15T17:31:50.230439] [INFO ] [MAIN ] Update Progress: 306/2369 symbols completed. BLX took 37.4s. Estimated remaining: 3h 34m 16s. Rate: 9.6 symbols/min [2025-09-15T17:31:50.413420] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:31:50.445375] [DEBUG] [LOCAL ] BMO: Loaded 30336 existing records from primary storage. [2025-09-15T17:31:50.445539] [INFO ] [MAIN ] BMO: Loaded 30336 existing records. [2025-09-15T17:31:50.646327] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:31:50.646677] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-09-15T17:31:50.646733] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-09-15T17:31:50.647539] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-09-15T17:31:50.647598] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-09-15T17:31:50.859173] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-09-15T17:31:51.023251] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-15T17:31:51.096871] [INFO ] [REMOTE ] BMO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:31:51.657888] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-09-15T17:31:51.923980] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-15T17:31:52.457870] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-09-15T17:31:52.958088] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-15T17:31:53.059844] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T17:31:53.257903] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-09-15T17:31:54.057844] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-09-15T17:31:54.378482] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-15T17:31:54.466817] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-15T17:31:54.857894] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-09-15T17:31:55.657885] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-09-15T17:31:55.884429] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-15T17:31:56.457880] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-09-15T17:31:56.926780] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-15T17:31:57.257900] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-09-15T17:31:57.569884] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-15T17:31:58.057892] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-09-15T17:31:58.079610] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-15T17:31:58.857875] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-09-15T17:31:59.614816] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-15T17:31:59.641629] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-15T17:31:59.646674] [INFO ] [REMOTE ] BMEZ: Full fetch complete (28461 records). [2025-09-15T17:31:59.646833] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-09-15T17:31:59.662973] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-09-15T17:32:00.085516] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-09-15T17:32:00.085860] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-15T17:32:00.086087] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-09-15T17:32:00.088517] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-09-15T17:32:00.088589] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-09-15T17:32:00.089804] [DEBUG] [LOCAL ] BMEZ: Trimmed 28461 records to 17633 (keeping 150 days of data) [2025-09-15T17:32:00.210170] [DEBUG] [LOCAL ] BMEZ: Primary data saved (17633 records). [2025-09-15T17:32:00.210340] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-09-15T17:32:00.210431] [INFO ] [MAIN ] Update Progress: 307/2369 symbols completed. BMEZ took 21.2s. Estimated remaining: 3h 34m 35s. Rate: 9.6 symbols/min [2025-09-15T17:32:00.383397] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:32:00.426527] [DEBUG] [LOCAL ] BMY: Loaded 40497 existing records from primary storage. [2025-09-15T17:32:00.426700] [INFO ] [MAIN ] BMY: Loaded 40497 existing records. [2025-09-15T17:32:00.463042] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-09-15T17:32:00.608400] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:32:00.608681] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-09-15T17:32:00.608729] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-09-15T17:32:00.609940] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-09-15T17:32:00.609994] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-09-15T17:32:00.960602] [INFO ] [REMOTE ] BMY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:32:01.257869] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-09-15T17:32:01.722296] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T17:32:02.057930] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-09-15T17:32:02.671185] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-15T17:32:02.857915] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-09-15T17:32:03.657866] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-09-15T17:32:03.890096] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-15T17:32:03.970948] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-15T17:32:03.974435] [INFO ] [REMOTE ] BMI: Full fetch complete (25221 records). [2025-09-15T17:32:03.974515] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-09-15T17:32:04.354697] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-09-15T17:32:04.354794] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-09-15T17:32:04.355242] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-09-15T17:32:04.355289] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-09-15T17:32:04.356093] [DEBUG] [LOCAL ] BMI: Trimmed 25221 records to 17207 (keeping 150 days of data) [2025-09-15T17:32:04.461850] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-09-15T17:32:04.473088] [DEBUG] [LOCAL ] BMI: Primary data saved (17207 records). [2025-09-15T17:32:04.473261] [INFO ] [MAIN ] BMI: Full history saved. [2025-09-15T17:32:04.473372] [INFO ] [MAIN ] Update Progress: 308/2369 symbols completed. BMI took 23.3s. Estimated remaining: 3h 34m 15s. Rate: 9.6 symbols/min [2025-09-15T17:32:04.648122] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:32:04.689081] [DEBUG] [LOCAL ] BN: Loaded 39788 existing records from primary storage. [2025-09-15T17:32:04.689242] [INFO ] [MAIN ] BN: Loaded 39788 existing records. [2025-09-15T17:32:04.863281] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:32:04.863540] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-09-15T17:32:04.863586] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-09-15T17:32:04.864451] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-09-15T17:32:04.864515] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-09-15T17:32:05.100871] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-15T17:32:05.235951] [INFO ] [REMOTE ] BN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:32:05.257988] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-15T17:32:05.258075] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-09-15T17:32:06.057897] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-09-15T17:32:06.385387] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-15T17:32:06.857895] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-09-15T17:32:06.951893] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T17:32:07.658141] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-09-15T17:32:08.188544] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-15T17:32:08.457909] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-09-15T17:32:08.725226] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-15T17:32:09.257896] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-09-15T17:32:10.018028] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T17:32:10.057911] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-09-15T17:32:10.706393] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-15T17:32:10.857896] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-09-15T17:32:11.657869] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-09-15T17:32:11.709633] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T17:32:12.046103] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-15T17:32:12.457920] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-09-15T17:32:12.840269] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-15T17:32:13.257889] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-09-15T17:32:13.879469] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-15T17:32:14.057892] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-09-15T17:32:14.456026] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-15T17:32:14.457001] [INFO ] [REMOTE ] BMN: Full fetch complete (2755 records). [2025-09-15T17:32:14.457080] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-09-15T17:32:14.457476] [FATAL] [VALIDATOR ] BMN: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:32:14.457564] [FATAL] [MAIN ] BMN: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:32:14.457616] [WARN ] [MAIN ] BMN: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:32:14.457693] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-09-15T17:32:14.457756] [DEBUG] [LOCAL ] BMN: No primary data file found to delete. [2025-09-15T17:32:14.457802] [INFO ] [LOCAL ] BMN: Starting deletion of derivative data. [2025-09-15T17:32:14.458064] [DEBUG] [LOCAL ] BMN: Deleted derivative data file. [2025-09-15T17:32:14.458163] [INFO ] [MAIN ] Update Progress: 309/2369 symbols completed. BMN took 25.7s. Estimated remaining: 3h 34m 34s. Rate: 9.6 symbols/min [2025-09-15T17:32:14.627235] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:32:14.648275] [DEBUG] [LOCAL ] BNED: Loaded 22113 existing records from primary storage. [2025-09-15T17:32:14.648416] [INFO ] [MAIN ] BNED: Loaded 22113 existing records. [2025-09-15T17:32:14.824279] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:32:14.824518] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-09-15T17:32:14.824564] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-09-15T17:32:14.825489] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-09-15T17:32:14.825544] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-09-15T17:32:14.867353] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-09-15T17:32:15.184868] [INFO ] [REMOTE ] BNED: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:32:15.284071] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-15T17:32:15.657923] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-09-15T17:32:16.457892] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-09-15T17:32:16.661553] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-15T17:32:16.858456] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-15T17:32:17.257885] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-09-15T17:32:17.664443] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-15T17:32:17.669003] [INFO ] [REMOTE ] BMO: Full fetch complete (44638 records). [2025-09-15T17:32:17.669158] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-09-15T17:32:17.669869] [FATAL] [VALIDATOR ] BMO: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:32:17.669954] [FATAL] [MAIN ] BMO: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:32:17.669992] [WARN ] [MAIN ] BMO: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:32:17.670034] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-09-15T17:32:17.670097] [DEBUG] [LOCAL ] BMO: No primary data file found to delete. [2025-09-15T17:32:17.670135] [INFO ] [LOCAL ] BMO: Starting deletion of derivative data. [2025-09-15T17:32:17.670376] [DEBUG] [LOCAL ] BMO: Deleted derivative data file. [2025-09-15T17:32:17.670492] [INFO ] [MAIN ] Update Progress: 310/2369 symbols completed. BMO took 27.4s. Estimated remaining: 3h 34m 8s. Rate: 9.6 symbols/min [2025-09-15T17:32:17.841411] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:32:17.846298] [DEBUG] [LOCAL ] BNH: Loaded 3202 existing records from primary storage. [2025-09-15T17:32:17.846375] [INFO ] [MAIN ] BNH: Loaded 3202 existing records. [2025-09-15T17:32:18.025944] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:32:18.026225] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-09-15T17:32:18.026275] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-09-15T17:32:18.026496] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-09-15T17:32:18.026548] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-09-15T17:32:18.062952] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-09-15T17:32:18.395868] [INFO ] [REMOTE ] BNH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:32:18.857924] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-09-15T17:32:18.956217] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-15T17:32:19.314137] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-15T17:32:19.657910] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-09-15T17:32:20.080538] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-15T17:32:20.205815] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T17:32:20.457879] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-09-15T17:32:21.257896] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-09-15T17:32:22.027196] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T17:32:22.057817] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-09-15T17:32:22.233587] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-15T17:32:22.857879] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-09-15T17:32:23.657927] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-09-15T17:32:23.915859] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-15T17:32:24.221723] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-15T17:32:24.457855] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-09-15T17:32:24.818248] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-15T17:32:25.206536] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-15T17:32:25.212424] [INFO ] [REMOTE ] BMY: Full fetch complete (58437 records). [2025-09-15T17:32:25.212532] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-09-15T17:32:25.263038] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-09-15T17:32:25.601607] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-09-15T17:32:25.601709] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-09-15T17:32:25.602356] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-09-15T17:32:25.602657] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-09-15T17:32:25.603887] [DEBUG] [LOCAL ] BMY: Trimmed 58437 records to 39717 (keeping 150 days of data) [2025-09-15T17:32:25.854003] [DEBUG] [LOCAL ] BMY: Primary data saved (39717 records). [2025-09-15T17:32:25.854161] [INFO ] [MAIN ] BMY: Full history saved. [2025-09-15T17:32:25.855544] [INFO ] [MAIN ] Update Progress: 311/2369 symbols completed. BMY took 25.6s. Estimated remaining: 3h 34m 14s. Rate: 9.6 symbols/min [2025-09-15T17:32:26.056764] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:32:26.057910] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-09-15T17:32:26.062928] [DEBUG] [LOCAL ] BNJ: Loaded 1751 existing records from primary storage. [2025-09-15T17:32:26.063171] [INFO ] [MAIN ] BNJ: Loaded 1751 existing records. [2025-09-15T17:32:26.246089] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:32:26.246372] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-09-15T17:32:26.246428] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-09-15T17:32:26.246690] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-09-15T17:32:26.246753] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-09-15T17:32:26.597192] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:32:26.865836] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-09-15T17:32:26.871812] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T17:32:27.308358] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-15T17:32:27.395053] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-15T17:32:27.657877] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-09-15T17:32:28.457900] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-09-15T17:32:28.826558] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-15T17:32:28.924058] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-15T17:32:29.257890] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-09-15T17:32:30.057864] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-09-15T17:32:30.129323] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-15T17:32:30.857885] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-09-15T17:32:31.367734] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-15T17:32:31.657916] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-09-15T17:32:31.712208] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-15T17:32:31.718304] [INFO ] [REMOTE ] BN: Full fetch complete (57630 records). [2025-09-15T17:32:31.718449] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-09-15T17:32:31.981477] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-15T17:32:32.139226] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-09-15T17:32:32.139308] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-09-15T17:32:32.139985] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-09-15T17:32:32.140030] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-09-15T17:32:32.141222] [DEBUG] [LOCAL ] BN: Trimmed 57630 records to 39006 (keeping 150 days of data) [2025-09-15T17:32:32.388680] [DEBUG] [LOCAL ] BN: Primary data saved (39006 records). [2025-09-15T17:32:32.388844] [INFO ] [MAIN ] BN: Full history saved. [2025-09-15T17:32:32.389285] [INFO ] [MAIN ] Update Progress: 312/2369 symbols completed. BN took 27.9s. Estimated remaining: 3h 34m 10s. Rate: 9.6 symbols/min [2025-09-15T17:32:32.463020] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-09-15T17:32:32.565428] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:32:32.603783] [DEBUG] [LOCAL ] BNL: Loaded 35098 existing records from primary storage. [2025-09-15T17:32:32.603934] [INFO ] [MAIN ] BNL: Loaded 35098 existing records. [2025-09-15T17:32:32.784485] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:32:32.784841] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-09-15T17:32:32.784904] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-09-15T17:32:32.785757] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-09-15T17:32:32.785820] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-09-15T17:32:32.949107] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-15T17:32:33.145721] [INFO ] [REMOTE ] BNL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:32:33.257857] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-09-15T17:32:33.608102] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-15T17:32:34.057936] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-09-15T17:32:34.857833] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-09-15T17:32:35.166216] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-15T17:32:35.169623] [INFO ] [REMOTE ] BNED: Full fetch complete (32465 records). [2025-09-15T17:32:35.169729] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-09-15T17:32:35.464924] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-15T17:32:35.552267] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-09-15T17:32:35.552425] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-09-15T17:32:35.553045] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-09-15T17:32:35.553140] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-09-15T17:32:35.554184] [DEBUG] [LOCAL ] BNED: Trimmed 32465 records to 21697 (keeping 150 days of data) [2025-09-15T17:32:35.657905] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-09-15T17:32:35.688134] [DEBUG] [LOCAL ] BNED: Primary data saved (21697 records). [2025-09-15T17:32:35.688262] [INFO ] [MAIN ] BNED: Full history saved. [2025-09-15T17:32:35.688344] [INFO ] [MAIN ] Update Progress: 313/2369 symbols completed. BNED took 21.2s. Estimated remaining: 3h 33m 44s. Rate: 9.6 symbols/min [2025-09-15T17:32:35.862225] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:32:35.901100] [DEBUG] [LOCAL ] BNS: Loaded 38577 existing records from primary storage. [2025-09-15T17:32:35.901297] [INFO ] [MAIN ] BNS: Loaded 38577 existing records. [2025-09-15T17:32:36.077483] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:32:36.077774] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-09-15T17:32:36.077821] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-09-15T17:32:36.078554] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-09-15T17:32:36.078602] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-09-15T17:32:36.432819] [INFO ] [REMOTE ] BNS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:32:36.457849] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-09-15T17:32:36.689400] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-15T17:32:37.257882] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-09-15T17:32:38.057907] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-09-15T17:32:38.147371] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T17:32:38.834345] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-15T17:32:38.859710] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-09-15T17:32:38.864568] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T17:32:39.657918] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-09-15T17:32:40.117583] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-15T17:32:40.457954] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-09-15T17:32:40.641267] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-15T17:32:41.257959] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-09-15T17:32:41.727417] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-15T17:32:41.728406] [INFO ] [REMOTE ] BNJ: Full fetch complete (2890 records). [2025-09-15T17:32:41.728474] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-09-15T17:32:42.066401] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-09-15T17:32:42.099183] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-09-15T17:32:42.099410] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-09-15T17:32:42.099616] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-09-15T17:32:42.099933] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-09-15T17:32:42.100629] [DEBUG] [LOCAL ] BNJ: Trimmed 2890 records to 1727 (keeping 150 days of data) [2025-09-15T17:32:42.137526] [DEBUG] [LOCAL ] BNJ: Primary data saved (1727 records). [2025-09-15T17:32:42.140484] [INFO ] [MAIN ] BNJ: Full history saved. [2025-09-15T17:32:42.140736] [INFO ] [MAIN ] Update Progress: 314/2369 symbols completed. BNJ took 16.3s. Estimated remaining: 3h 33m 40s. Rate: 9.6 symbols/min [2025-09-15T17:32:42.188583] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-15T17:32:42.336001] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:32:42.339990] [DEBUG] [LOCAL ] BNT: Loaded 2113 existing records from primary storage. [2025-09-15T17:32:42.340079] [INFO ] [MAIN ] BNT: Loaded 2113 existing records. [2025-09-15T17:32:42.545845] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:32:42.546094] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-09-15T17:32:42.546140] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-09-15T17:32:42.546352] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-09-15T17:32:42.546405] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-09-15T17:32:42.838931] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-15T17:32:42.861490] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-09-15T17:32:42.929521] [INFO ] [REMOTE ] BNT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:32:43.657887] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-09-15T17:32:44.087580] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-15T17:32:44.457888] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-09-15T17:32:44.519750] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T17:32:44.988286] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-15T17:32:45.257888] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-09-15T17:32:46.057874] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-09-15T17:32:46.862916] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-09-15T17:32:46.882905] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-15T17:32:46.896457] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-15T17:32:47.265022] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-15T17:32:47.657880] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-09-15T17:32:48.159104] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-15T17:32:48.457894] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-09-15T17:32:48.803993] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-15T17:32:49.257876] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-09-15T17:32:49.604451] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-15T17:32:50.057930] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-09-15T17:32:50.857877] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-09-15T17:32:51.384072] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-15T17:32:51.657870] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-09-15T17:32:51.794697] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-15T17:32:52.252905] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-15T17:32:52.253922] [INFO ] [REMOTE ] BNH: Full fetch complete (5125 records). [2025-09-15T17:32:52.254075] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-09-15T17:32:52.254456] [FATAL] [VALIDATOR ] BNH: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:32:52.254537] [FATAL] [MAIN ] BNH: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:32:52.254604] [WARN ] [MAIN ] BNH: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:32:52.254684] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-09-15T17:32:52.254784] [DEBUG] [LOCAL ] BNH: No primary data file found to delete. [2025-09-15T17:32:52.254839] [INFO ] [LOCAL ] BNH: Starting deletion of derivative data. [2025-09-15T17:32:52.255194] [DEBUG] [LOCAL ] BNH: Deleted derivative data file. [2025-09-15T17:32:52.255307] [INFO ] [MAIN ] Update Progress: 315/2369 symbols completed. BNH took 34.6s. Estimated remaining: 3h 33m 59s. Rate: 9.6 symbols/min [2025-09-15T17:32:52.428626] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:32:52.435184] [DEBUG] [LOCAL ] BNY: Loaded 5302 existing records from primary storage. [2025-09-15T17:32:52.435296] [INFO ] [MAIN ] BNY: Loaded 5302 existing records. [2025-09-15T17:32:52.464375] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-09-15T17:32:52.621269] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:32:52.621521] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-09-15T17:32:52.621568] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-09-15T17:32:52.621879] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-09-15T17:32:52.621930] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-09-15T17:32:52.980833] [INFO ] [REMOTE ] BNY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:32:53.257870] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-09-15T17:32:53.959938] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-15T17:32:54.057844] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-09-15T17:32:54.660031] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-15T17:32:54.857901] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-09-15T17:32:55.357003] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-15T17:32:55.657908] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-09-15T17:32:55.701473] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-15T17:32:56.457845] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-09-15T17:32:56.511259] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-15T17:32:57.257886] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-09-15T17:32:57.592662] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T17:32:58.057876] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-09-15T17:32:58.427289] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-15T17:32:58.453062] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-15T17:32:58.857913] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-09-15T17:32:59.657873] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-09-15T17:33:00.356250] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T17:33:00.362253] [INFO ] [REMOTE ] BNS: Full fetch complete (55934 records). [2025-09-15T17:33:00.362422] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-09-15T17:33:00.462985] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-09-15T17:33:00.761129] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-09-15T17:33:00.761211] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-09-15T17:33:00.761868] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-09-15T17:33:00.761922] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-09-15T17:33:00.763419] [DEBUG] [LOCAL ] BNS: Trimmed 55934 records to 37795 (keeping 150 days of data) [2025-09-15T17:33:01.019945] [DEBUG] [LOCAL ] BNS: Primary data saved (37795 records). [2025-09-15T17:33:01.020123] [INFO ] [MAIN ] BNS: Full history saved. [2025-09-15T17:33:01.021220] [INFO ] [MAIN ] Update Progress: 316/2369 symbols completed. BNS took 25.3s. Estimated remaining: 3h 34m 9s. Rate: 9.6 symbols/min [2025-09-15T17:33:01.156131] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-15T17:33:01.211600] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:33:01.231446] [DEBUG] [LOCAL ] BOC: Loaded 13587 existing records from primary storage. [2025-09-15T17:33:01.231608] [INFO ] [MAIN ] BOC: Loaded 13587 existing records. [2025-09-15T17:33:01.263063] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-09-15T17:33:01.424135] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-15T17:33:01.455409] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:33:01.455815] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-09-15T17:33:01.456246] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-09-15T17:33:01.456685] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-09-15T17:33:01.456739] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-09-15T17:33:01.856408] [INFO ] [REMOTE ] BOC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:33:02.057929] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-09-15T17:33:02.857887] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-09-15T17:33:02.895146] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T17:33:03.657881] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-09-15T17:33:03.884524] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-15T17:33:04.457877] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-09-15T17:33:04.487663] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-15T17:33:04.799770] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-15T17:33:04.804948] [INFO ] [REMOTE ] BNL: Full fetch complete (50771 records). [2025-09-15T17:33:04.805067] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-09-15T17:33:05.103325] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-15T17:33:05.125357] [INFO ] [REMOTE ] BNT: Full fetch complete (3483 records). [2025-09-15T17:33:05.148219] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-09-15T17:33:05.271209] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-09-15T17:33:05.284272] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-09-15T17:33:05.300439] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-09-15T17:33:05.301251] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-09-15T17:33:05.305155] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-09-15T17:33:05.368859] [DEBUG] [LOCAL ] BNL: Trimmed 50771 records to 34424 (keeping 150 days of data) [2025-09-15T17:33:05.677600] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-09-15T17:33:05.678224] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-09-15T17:33:05.678605] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-09-15T17:33:05.678962] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-09-15T17:33:05.681881] [DEBUG] [LOCAL ] BNT: Trimmed 3483 records to 2060 (keeping 150 days of data) [2025-09-15T17:33:05.704736] [DEBUG] [LOCAL ] BNT: Primary data saved (2060 records). [2025-09-15T17:33:05.705186] [INFO ] [MAIN ] BNT: Full history saved. [2025-09-15T17:33:05.705545] [INFO ] [MAIN ] Update Progress: 317/2369 symbols completed. BNT took 23.6s. Estimated remaining: 3h 33m 52s. Rate: 9.6 symbols/min [2025-09-15T17:33:05.809139] [DEBUG] [LOCAL ] BNL: Primary data saved (34424 records). [2025-09-15T17:33:05.809298] [INFO ] [MAIN ] BNL: Full history saved. [2025-09-15T17:33:05.809561] [INFO ] [MAIN ] Update Progress: 318/2369 symbols completed. BNL took 33.4s. Estimated remaining: 3h 33m 6s. Rate: 9.6 symbols/min [2025-09-15T17:33:06.057863] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-09-15T17:33:06.234301] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-15T17:33:06.858017] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-09-15T17:33:06.998388] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T17:33:07.528766] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-15T17:33:07.657933] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-09-15T17:33:08.457974] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-09-15T17:33:08.702998] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-15T17:33:09.183416] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T17:33:09.257818] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-09-15T17:33:09.973824] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-15T17:33:09.975310] [INFO ] [REMOTE ] BNY: Full fetch complete (7738 records). [2025-09-15T17:33:09.975382] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-09-15T17:33:10.066315] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-09-15T17:33:10.360393] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-09-15T17:33:10.360512] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-09-15T17:33:10.360836] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-09-15T17:33:10.360885] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-09-15T17:33:10.361550] [DEBUG] [LOCAL ] BNY: Trimmed 7738 records to 5301 (keeping 150 days of data) [2025-09-15T17:33:10.396072] [DEBUG] [LOCAL ] BNY: Primary data saved (5301 records). [2025-09-15T17:33:10.396220] [INFO ] [MAIN ] BNY: Full history saved. [2025-09-15T17:33:10.396306] [INFO ] [MAIN ] Update Progress: 319/2369 symbols completed. BNY took 18.1s. Estimated remaining: 3h 32m 50s. Rate: 9.6 symbols/min [2025-09-15T17:33:11.007271] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-15T17:33:11.011203] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-09-15T17:33:11.908412] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-15T17:33:11.912443] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-09-15T17:33:13.408231] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T17:33:13.412939] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-09-15T17:33:14.451190] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-15T17:33:14.456616] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-09-15T17:33:15.141217] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-15T17:33:15.143465] [INFO ] [REMOTE ] BOC: Full fetch complete (19522 records). [2025-09-15T17:33:15.143537] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-09-15T17:33:15.144013] [FATAL] [VALIDATOR ] BOC: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:33:15.144086] [FATAL] [MAIN ] BOC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:33:15.144133] [WARN ] [MAIN ] BOC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:33:15.144183] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-09-15T17:33:15.144242] [DEBUG] [LOCAL ] BOC: No primary data file found to delete. [2025-09-15T17:33:15.144278] [INFO ] [LOCAL ] BOC: Starting deletion of derivative data. [2025-09-15T17:33:15.144541] [DEBUG] [LOCAL ] BOC: Deleted derivative data file. [2025-09-15T17:33:15.144660] [INFO ] [MAIN ] Update Progress: 320/2369 symbols completed. BOC took 14.1s. Estimated remaining: 3h 32m 34s. Rate: 9.6 symbols/min [2025-09-15T17:33:15.678101] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:33:15.835018] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:33:15.860088] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:33:15.892151] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:33:15.909670] [DEBUG] [LOCAL ] BOE: Loaded 12245 existing records from primary storage. [2025-09-15T17:33:15.909839] [INFO ] [MAIN ] BOE: Loaded 12245 existing records. [2025-09-15T17:33:16.053894] [DEBUG] [LOCAL ] BOOT: Loaded 30125 existing records from primary storage. [2025-09-15T17:33:16.093826] [INFO ] [MAIN ] BOOT: Loaded 30125 existing records. [2025-09-15T17:33:16.059752] [DEBUG] [LOCAL ] BOND: Loaded 23942 existing records from primary storage. [2025-09-15T17:33:16.108683] [DEBUG] [LOCAL ] BOH: Loaded 22443 existing records from primary storage. [2025-09-15T17:33:16.121796] [INFO ] [MAIN ] BOND: Loaded 23942 existing records. [2025-09-15T17:33:16.155478] [INFO ] [MAIN ] BOH: Loaded 22443 existing records. [2025-09-15T17:33:16.205595] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:33:16.370900] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-09-15T17:33:16.404966] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-09-15T17:33:16.470440] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-09-15T17:33:16.482868] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-09-15T17:33:16.538375] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:33:16.652410] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-09-15T17:33:16.697233] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:33:16.744910] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-09-15T17:33:16.769223] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-09-15T17:33:16.768854] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:33:16.779741] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-09-15T17:33:16.790145] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-09-15T17:33:16.790247] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-09-15T17:33:16.784949] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-09-15T17:33:16.815807] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-09-15T17:33:16.859255] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-09-15T17:33:16.892538] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-09-15T17:33:17.001960] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-09-15T17:33:17.026349] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-09-15T17:33:17.411908] [INFO ] [REMOTE ] BOE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:33:17.486134] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-09-15T17:33:17.873801] [INFO ] [REMOTE ] BOH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:33:17.900565] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-09-15T17:33:18.043953] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:33:18.081374] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-09-15T17:33:18.168200] [INFO ] [REMOTE ] BOND: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:33:18.168492] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-09-15T17:33:18.577491] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-15T17:33:18.581512] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-09-15T17:33:19.230885] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-15T17:33:19.236908] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-09-15T17:33:19.315280] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-15T17:33:19.321796] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-09-15T17:33:19.334360] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-15T17:33:19.657888] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-09-15T17:33:19.760878] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T17:33:20.136338] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-15T17:33:20.349671] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-15T17:33:20.457830] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-09-15T17:33:20.686998] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-15T17:33:21.039207] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-15T17:33:21.257882] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-09-15T17:33:22.057907] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-09-15T17:33:22.326279] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T17:33:22.857894] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-09-15T17:33:22.966016] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-15T17:33:23.657889] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-09-15T17:33:23.855411] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-15T17:33:24.457880] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-09-15T17:33:24.587719] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-15T17:33:25.257888] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-09-15T17:33:25.962713] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-15T17:33:26.057866] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-09-15T17:33:26.581332] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T17:33:26.857888] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-09-15T17:33:27.478634] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-15T17:33:27.657832] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-09-15T17:33:27.838896] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-15T17:33:28.457906] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-09-15T17:33:29.203395] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T17:33:29.257824] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-09-15T17:33:29.736803] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T17:33:30.057958] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-09-15T17:33:30.865669] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-09-15T17:33:30.870550] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-15T17:33:31.083502] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-15T17:33:31.657915] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-09-15T17:33:31.776600] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-15T17:33:31.780902] [INFO ] [REMOTE ] BOND: Full fetch complete (34732 records). [2025-09-15T17:33:31.780999] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-09-15T17:33:32.162850] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-09-15T17:33:32.162941] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-09-15T17:33:32.163401] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-09-15T17:33:32.163443] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-09-15T17:33:32.164423] [DEBUG] [LOCAL ] BOND: Trimmed 34732 records to 23537 (keeping 150 days of data) [2025-09-15T17:33:32.318916] [DEBUG] [LOCAL ] BOND: Primary data saved (23537 records). [2025-09-15T17:33:32.319056] [INFO ] [MAIN ] BOND: Full history saved. [2025-09-15T17:33:32.319144] [INFO ] [MAIN ] Update Progress: 321/2369 symbols completed. BOND took 17.2s. Estimated remaining: 3h 33m 37s. Rate: 9.6 symbols/min [2025-09-15T17:33:32.466431] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-09-15T17:33:32.489835] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:33:32.528474] [DEBUG] [LOCAL ] BORR: Loaded 38458 existing records from primary storage. [2025-09-15T17:33:32.528603] [INFO ] [MAIN ] BORR: Loaded 38458 existing records. [2025-09-15T17:33:32.702721] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:33:32.702989] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-09-15T17:33:32.703037] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-09-15T17:33:32.703923] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-09-15T17:33:32.703978] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-09-15T17:33:33.092727] [INFO ] [REMOTE ] BORR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:33:33.113341] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T17:33:33.257922] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-09-15T17:33:33.482320] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T17:33:34.006800] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-15T17:33:34.057920] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-09-15T17:33:34.857886] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-09-15T17:33:35.093611] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-15T17:33:35.657902] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-09-15T17:33:36.306095] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-15T17:33:36.308830] [INFO ] [REMOTE ] BOE: Full fetch complete (18998 records). [2025-09-15T17:33:36.308914] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-09-15T17:33:36.464363] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-09-15T17:33:36.673737] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-09-15T17:33:36.673903] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-09-15T17:33:36.674298] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-09-15T17:33:36.674360] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-09-15T17:33:36.675019] [DEBUG] [LOCAL ] BOE: Trimmed 18998 records to 11861 (keeping 150 days of data) [2025-09-15T17:33:36.761956] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-15T17:33:36.795413] [DEBUG] [LOCAL ] BOE: Primary data saved (11861 records). [2025-09-15T17:33:36.795559] [INFO ] [MAIN ] BOE: Full history saved. [2025-09-15T17:33:36.795693] [INFO ] [MAIN ] Update Progress: 322/2369 symbols completed. BOE took 21.7s. Estimated remaining: 3h 33m 20s. Rate: 9.6 symbols/min [2025-09-15T17:33:36.965765] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:33:36.982629] [DEBUG] [LOCAL ] BOW: Loaded 16592 existing records from primary storage. [2025-09-15T17:33:36.982777] [INFO ] [MAIN ] BOW: Loaded 16592 existing records. [2025-09-15T17:33:37.156834] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:33:37.157057] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-09-15T17:33:37.157102] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-09-15T17:33:37.157564] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-09-15T17:33:37.157612] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-09-15T17:33:37.258842] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-09-15T17:33:37.518173] [INFO ] [REMOTE ] BOW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:33:37.698949] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T17:33:38.057884] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-09-15T17:33:38.662864] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-15T17:33:38.857886] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-09-15T17:33:38.966816] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-15T17:33:39.657897] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-09-15T17:33:40.260412] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T17:33:40.457904] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-09-15T17:33:40.720678] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T17:33:40.724188] [INFO ] [REMOTE ] BOH: Full fetch complete (33807 records). [2025-09-15T17:33:40.724268] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-09-15T17:33:41.089257] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-09-15T17:33:41.089340] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-09-15T17:33:41.089912] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-09-15T17:33:41.089984] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-09-15T17:33:41.090834] [DEBUG] [LOCAL ] BOH: Trimmed 33807 records to 21842 (keeping 150 days of data) [2025-09-15T17:33:41.233794] [DEBUG] [LOCAL ] BOH: Primary data saved (21842 records). [2025-09-15T17:33:41.233934] [INFO ] [MAIN ] BOH: Full history saved. [2025-09-15T17:33:41.234358] [INFO ] [MAIN ] Update Progress: 323/2369 symbols completed. BOH took 26.1s. Estimated remaining: 3h 33m 2s. Rate: 9.6 symbols/min [2025-09-15T17:33:41.265952] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-09-15T17:33:41.405685] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:33:41.442299] [DEBUG] [LOCAL ] BOX: Loaded 37722 existing records from primary storage. [2025-09-15T17:33:41.442457] [INFO ] [MAIN ] BOX: Loaded 37722 existing records. [2025-09-15T17:33:41.632447] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:33:41.632716] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-09-15T17:33:41.632766] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-09-15T17:33:41.633826] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-09-15T17:33:41.633878] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-09-15T17:33:42.000666] [INFO ] [REMOTE ] BOX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:33:42.035000] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T17:33:42.057818] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-09-15T17:33:42.561836] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-15T17:33:42.857872] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-09-15T17:33:43.264763] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-15T17:33:43.657942] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-09-15T17:33:44.032424] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-15T17:33:44.413391] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-15T17:33:44.457880] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-09-15T17:33:45.257874] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-09-15T17:33:45.433050] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-15T17:33:46.057876] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-09-15T17:33:46.429317] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-15T17:33:46.857878] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-09-15T17:33:47.093742] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T17:33:47.098018] [INFO ] [REMOTE ] BOOT: Full fetch complete (45523 records). [2025-09-15T17:33:47.098164] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-09-15T17:33:47.507543] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-09-15T17:33:47.507654] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-09-15T17:33:47.508233] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-09-15T17:33:47.508276] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-09-15T17:33:47.509479] [DEBUG] [LOCAL ] BOOT: Trimmed 45523 records to 29291 (keeping 150 days of data) [2025-09-15T17:33:47.662690] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-09-15T17:33:47.692851] [DEBUG] [LOCAL ] BOOT: Primary data saved (29291 records). [2025-09-15T17:33:47.692994] [INFO ] [MAIN ] BOOT: Full history saved. [2025-09-15T17:33:47.693100] [INFO ] [MAIN ] Update Progress: 324/2369 symbols completed. BOOT took 32.5s. Estimated remaining: 3h 32m 57s. Rate: 9.6 symbols/min [2025-09-15T17:33:47.873326] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:33:47.917846] [DEBUG] [LOCAL ] BP: Loaded 40451 existing records from primary storage. [2025-09-15T17:33:47.918011] [INFO ] [MAIN ] BP: Loaded 40451 existing records. [2025-09-15T17:33:48.103324] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:33:48.103596] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-09-15T17:33:48.103677] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-09-15T17:33:48.104555] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-09-15T17:33:48.104630] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-09-15T17:33:48.457310] [INFO ] [REMOTE ] BP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:33:48.457819] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-09-15T17:33:48.588457] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-15T17:33:48.612371] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-15T17:33:49.257877] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-09-15T17:33:50.057849] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-09-15T17:33:50.138382] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T17:33:50.747458] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T17:33:50.821923] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-15T17:33:50.857868] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-09-15T17:33:51.657889] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-09-15T17:33:52.441923] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T17:33:52.457809] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-09-15T17:33:53.257891] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-09-15T17:33:53.575494] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-15T17:33:53.666052] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T17:33:54.057881] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-09-15T17:33:54.379619] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-15T17:33:54.857881] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-09-15T17:33:55.662965] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-09-15T17:33:55.679367] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-15T17:33:55.863812] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-15T17:33:55.867019] [INFO ] [REMOTE ] BOW: Full fetch complete (24987 records). [2025-09-15T17:33:55.867100] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-09-15T17:33:56.238089] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-09-15T17:33:56.238191] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-09-15T17:33:56.238597] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-09-15T17:33:56.238655] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-09-15T17:33:56.239296] [DEBUG] [LOCAL ] BOW: Trimmed 24987 records to 16164 (keeping 150 days of data) [2025-09-15T17:33:56.339702] [DEBUG] [LOCAL ] BOW: Primary data saved (16164 records). [2025-09-15T17:33:56.339857] [INFO ] [MAIN ] BOW: Full history saved. [2025-09-15T17:33:56.339959] [INFO ] [MAIN ] Update Progress: 325/2369 symbols completed. BOW took 19.5s. Estimated remaining: 3h 33m 6s. Rate: 9.6 symbols/min [2025-09-15T17:33:56.462951] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-09-15T17:33:56.514639] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:33:56.541274] [DEBUG] [LOCAL ] BR: Loaded 25468 existing records from primary storage. [2025-09-15T17:33:56.541420] [INFO ] [MAIN ] BR: Loaded 25468 existing records. [2025-09-15T17:33:56.719203] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:33:56.719439] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-09-15T17:33:56.719485] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-09-15T17:33:56.720279] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-09-15T17:33:56.720332] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-09-15T17:33:57.071845] [INFO ] [REMOTE ] BR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:33:57.263056] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-09-15T17:33:57.283571] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-15T17:33:58.065136] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-09-15T17:33:58.085107] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-15T17:33:58.857888] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-09-15T17:33:58.889208] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-15T17:33:59.639771] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T17:33:59.657816] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-09-15T17:34:00.457898] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-09-15T17:34:00.490558] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-15T17:34:01.257899] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-09-15T17:34:01.445448] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-15T17:34:01.619593] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-15T17:34:02.057938] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-09-15T17:34:02.857876] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-09-15T17:34:02.932815] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-15T17:34:03.212754] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T17:34:03.218800] [INFO ] [REMOTE ] BORR: Full fetch complete (55804 records). [2025-09-15T17:34:03.218965] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-09-15T17:34:03.612171] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-09-15T17:34:03.612292] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-09-15T17:34:03.613138] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-09-15T17:34:03.613193] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-09-15T17:34:03.614699] [DEBUG] [LOCAL ] BORR: Trimmed 55804 records to 37699 (keeping 150 days of data) [2025-09-15T17:34:03.664365] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-09-15T17:34:03.849169] [DEBUG] [LOCAL ] BORR: Primary data saved (37699 records). [2025-09-15T17:34:03.849439] [INFO ] [MAIN ] BORR: Full history saved. [2025-09-15T17:34:03.850811] [INFO ] [MAIN ] Update Progress: 326/2369 symbols completed. BORR took 31.5s. Estimated remaining: 3h 33m 8s. Rate: 9.6 symbols/min [2025-09-15T17:34:04.025509] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:34:04.064419] [DEBUG] [LOCAL ] BRBR: Loaded 39015 existing records from primary storage. [2025-09-15T17:34:04.064782] [INFO ] [MAIN ] BRBR: Loaded 39015 existing records. [2025-09-15T17:34:04.240833] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:34:04.241242] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-09-15T17:34:04.241350] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-09-15T17:34:04.242524] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-09-15T17:34:04.242578] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-09-15T17:34:04.475317] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-09-15T17:34:04.498118] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T17:34:04.629097] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:34:05.170121] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-15T17:34:05.176168] [INFO ] [REMOTE ] BOX: Full fetch complete (54517 records). [2025-09-15T17:34:05.176274] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-09-15T17:34:05.266697] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-09-15T17:34:05.559136] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-09-15T17:34:05.559254] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-09-15T17:34:05.560045] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-09-15T17:34:05.560126] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-09-15T17:34:05.561727] [DEBUG] [LOCAL ] BOX: Trimmed 54517 records to 37029 (keeping 150 days of data) [2025-09-15T17:34:05.792778] [DEBUG] [LOCAL ] BOX: Primary data saved (37029 records). [2025-09-15T17:34:05.792969] [INFO ] [MAIN ] BOX: Full history saved. [2025-09-15T17:34:05.793577] [INFO ] [MAIN ] Update Progress: 327/2369 symbols completed. BOX took 24.6s. Estimated remaining: 3h 32m 34s. Rate: 9.6 symbols/min [2025-09-15T17:34:05.961469] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:34:05.977299] [DEBUG] [LOCAL ] BRC: Loaded 13569 existing records from primary storage. [2025-09-15T17:34:05.977450] [INFO ] [MAIN ] BRC: Loaded 13569 existing records. [2025-09-15T17:34:06.067763] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-09-15T17:34:06.156268] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:34:06.156663] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-09-15T17:34:06.156721] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-09-15T17:34:06.157287] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-09-15T17:34:06.157342] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-09-15T17:34:06.552332] [INFO ] [REMOTE ] BRC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:34:06.556853] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-15T17:34:06.614514] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T17:34:06.857943] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-09-15T17:34:07.616838] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-15T17:34:07.657897] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-09-15T17:34:08.017301] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-15T17:34:08.457872] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-09-15T17:34:08.850382] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-15T17:34:09.257879] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-09-15T17:34:09.794343] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-15T17:34:10.057882] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-09-15T17:34:10.745496] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T17:34:10.857867] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-09-15T17:34:11.381927] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-15T17:34:11.657884] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-09-15T17:34:12.232093] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-15T17:34:12.457882] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-09-15T17:34:13.257906] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-09-15T17:34:13.697710] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-15T17:34:13.767036] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T17:34:14.057816] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-09-15T17:34:14.375419] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-15T17:34:14.857900] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-09-15T17:34:15.577830] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-15T17:34:15.657825] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-09-15T17:34:15.852221] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-15T17:34:16.457876] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-09-15T17:34:16.940912] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T17:34:17.257933] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-09-15T17:34:17.860949] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T17:34:18.057916] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-09-15T17:34:18.857895] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-09-15T17:34:18.992229] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-15T17:34:18.998221] [INFO ] [REMOTE ] BP: Full fetch complete (58390 records). [2025-09-15T17:34:18.998327] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-09-15T17:34:19.350842] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T17:34:19.408171] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-09-15T17:34:19.407951] [INFO ] [REMOTE ] BR: Full fetch complete (37225 records). [2025-09-15T17:34:19.408367] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-09-15T17:34:19.408508] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-09-15T17:34:19.409308] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-09-15T17:34:19.409681] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-09-15T17:34:19.517051] [DEBUG] [LOCAL ] BP: Trimmed 58390 records to 39671 (keeping 150 days of data) [2025-09-15T17:34:19.658825] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-09-15T17:34:19.905067] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-09-15T17:34:19.906985] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-09-15T17:34:19.908432] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-09-15T17:34:19.908718] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-09-15T17:34:19.912922] [DEBUG] [LOCAL ] BR: Trimmed 37225 records to 25002 (keeping 150 days of data) [2025-09-15T17:34:20.212908] [DEBUG] [LOCAL ] BR: Primary data saved (25002 records). [2025-09-15T17:34:20.213753] [INFO ] [MAIN ] BR: Full history saved. [2025-09-15T17:34:20.214352] [INFO ] [MAIN ] Update Progress: 328/2369 symbols completed. BR took 23.9s. Estimated remaining: 3h 33m 19s. Rate: 9.6 symbols/min [2025-09-15T17:34:20.322061] [DEBUG] [LOCAL ] BP: Primary data saved (39671 records). [2025-09-15T17:34:20.322219] [INFO ] [MAIN ] BP: Full history saved. [2025-09-15T17:34:20.322886] [INFO ] [MAIN ] Update Progress: 329/2369 symbols completed. BP took 32.6s. Estimated remaining: 3h 32m 35s. Rate: 9.6 symbols/min [2025-09-15T17:34:20.467244] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:34:20.566550] [INFO ] [MAIN ] BRFS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:34:20.597425] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-15T17:34:20.610941] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-15T17:34:20.616766] [INFO ] [REMOTE ] BRBR: Full fetch complete (55072 records). [2025-09-15T17:34:20.616993] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-09-15T17:34:20.617289] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-09-15T17:34:20.713504] [DEBUG] [LOCAL ] BRCC: Loaded 30415 existing records from primary storage. [2025-09-15T17:34:20.729788] [INFO ] [MAIN ] BRCC: Loaded 30415 existing records. [2025-09-15T17:34:20.821429] [DEBUG] [LOCAL ] BRFS: Loaded 30661 existing records from primary storage. [2025-09-15T17:34:20.848632] [INFO ] [MAIN ] BRFS: Loaded 30661 existing records. [2025-09-15T17:34:21.233831] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:34:21.253125] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-09-15T17:34:21.263516] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-09-15T17:34:21.309062] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-09-15T17:34:21.361483] [WARN ] [MAIN ] BRFS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:34:21.366693] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-09-15T17:34:21.444704] [INFO ] [MAIN ] BRFS: Wiping existing primary data before full refresh. [2025-09-15T17:34:21.473257] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-09-15T17:34:21.473193] [INFO ] [LOCAL ] BRFS: Starting deletion of primary data. [2025-09-15T17:34:21.505070] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-09-15T17:34:21.517117] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-09-15T17:34:21.522346] [DEBUG] [LOCAL ] BRFS: Deleted primary data file. [2025-09-15T17:34:21.527555] [INFO ] [MAIN ] BRFS: Starting full primary refresh. [2025-09-15T17:34:21.527622] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-09-15T17:34:21.720172] [DEBUG] [LOCAL ] BRBR: Trimmed 55072 records to 38487 (keeping 150 days of data) [2025-09-15T17:34:22.225740] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:34:22.257140] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-09-15T17:34:22.300095] [INFO ] [REMOTE ] BRFS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:34:22.302712] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-02. [2025-09-15T17:34:22.309714] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-15T17:34:22.432503] [DEBUG] [LOCAL ] BRBR: Primary data saved (38487 records). [2025-09-15T17:34:22.432689] [INFO ] [MAIN ] BRBR: Full history saved. [2025-09-15T17:34:22.433177] [INFO ] [MAIN ] Update Progress: 330/2369 symbols completed. BRBR took 18.6s. Estimated remaining: 3h 32m 3s. Rate: 9.6 symbols/min [2025-09-15T17:34:22.600285] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:34:22.639237] [DEBUG] [LOCAL ] BRO: Loaded 39113 existing records from primary storage. [2025-09-15T17:34:22.639394] [INFO ] [MAIN ] BRO: Loaded 39113 existing records. [2025-09-15T17:34:22.811939] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:34:22.812194] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-09-15T17:34:22.812239] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-09-15T17:34:22.813119] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-09-15T17:34:22.813169] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-09-15T17:34:22.875940] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-09-15T17:34:23.166038] [INFO ] [REMOTE ] BRO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:34:23.312907] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-15T17:34:23.657921] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-09-15T17:34:23.981744] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T17:34:24.051819] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-15T17:34:24.457931] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-09-15T17:34:25.106489] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-15T17:34:25.257883] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-09-15T17:34:25.319750] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-15T17:34:26.057945] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-03. [2025-09-15T17:34:26.857938] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-09-15T17:34:27.008021] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-15T17:34:27.531064] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T17:34:27.657920] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-04. [2025-09-15T17:34:27.788570] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-15T17:34:28.457882] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-09-15T17:34:28.898476] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-15T17:34:29.257919] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-09-15T17:34:29.850396] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-15T17:34:30.057910] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-09-15T17:34:30.206453] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-15T17:34:30.208918] [INFO ] [REMOTE ] BRC: Full fetch complete (21888 records). [2025-09-15T17:34:30.208994] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-09-15T17:34:30.568922] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-09-15T17:34:30.569000] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-09-15T17:34:30.569370] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-09-15T17:34:30.569409] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-09-15T17:34:30.570009] [DEBUG] [LOCAL ] BRC: Trimmed 21888 records to 13268 (keeping 150 days of data) [2025-09-15T17:34:30.653424] [DEBUG] [LOCAL ] BRC: Primary data saved (13268 records). [2025-09-15T17:34:30.653616] [INFO ] [MAIN ] BRC: Full history saved. [2025-09-15T17:34:30.653720] [INFO ] [MAIN ] Update Progress: 331/2369 symbols completed. BRC took 24.9s. Estimated remaining: 3h 32m 9s. Rate: 9.6 symbols/min [2025-09-15T17:34:30.825166] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:34:30.861487] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-09-15T17:34:30.862502] [DEBUG] [LOCAL ] BROS: Loaded 40080 existing records from primary storage. [2025-09-15T17:34:30.863300] [INFO ] [MAIN ] BROS: Loaded 40080 existing records. [2025-09-15T17:34:31.040699] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:34:31.040962] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-09-15T17:34:31.041044] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-09-15T17:34:31.041906] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-09-15T17:34:31.041958] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-09-15T17:34:31.395212] [INFO ] [REMOTE ] BROS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:34:31.657898] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-09-15T17:34:31.950708] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-15T17:34:32.022304] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-15T17:34:32.457872] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-05. [2025-09-15T17:34:33.167763] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-15T17:34:33.257884] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-09-15T17:34:33.956512] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-15T17:34:34.057898] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-09-15T17:34:34.660268] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T17:34:34.857878] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-09-15T17:34:35.657853] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-06. [2025-09-15T17:34:35.736359] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T17:34:36.054784] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-15T17:34:36.457944] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-09-15T17:34:36.877109] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-15T17:34:37.257917] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-09-15T17:34:38.057877] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-09-15T17:34:38.174977] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-15T17:34:38.451512] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-15T17:34:38.857887] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-09-15T17:34:39.657890] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-09-15T17:34:39.754021] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-15T17:34:40.457891] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-09-15T17:34:40.800865] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-15T17:34:40.939825] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-15T17:34:41.257872] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-07. [2025-09-15T17:34:41.758463] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-15T17:34:42.057913] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-09-15T17:34:42.653746] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T17:34:42.857868] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-08. [2025-09-15T17:34:43.617568] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-15T17:34:43.657831] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-09-15T17:34:44.243276] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-15T17:34:44.457863] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-09-15T17:34:45.072895] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-15T17:34:45.257876] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-09-15T17:34:45.888605] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T17:34:45.893595] [INFO ] [REMOTE ] BRCC: Full fetch complete (43388 records). [2025-09-15T17:34:45.893703] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-09-15T17:34:46.065059] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-09. [2025-09-15T17:34:46.278290] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-09-15T17:34:46.278368] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-09-15T17:34:46.278909] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-09-15T17:34:46.278953] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-09-15T17:34:46.280839] [DEBUG] [LOCAL ] BRCC: Trimmed 43388 records to 30061 (keeping 150 days of data) [2025-09-15T17:34:46.455292] [DEBUG] [LOCAL ] BRCC: Primary data saved (30061 records). [2025-09-15T17:34:46.455494] [INFO ] [MAIN ] BRCC: Full history saved. [2025-09-15T17:34:46.455633] [INFO ] [MAIN ] Update Progress: 332/2369 symbols completed. BRCC took 26.2s. Estimated remaining: 3h 33m 1s. Rate: 9.6 symbols/min [2025-09-15T17:34:46.650188] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:34:46.651375] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-15T17:34:46.651559] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-09-15T17:34:46.656818] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-09-15T17:34:46.657127] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-09-15T17:34:46.657177] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-15T17:34:46.657219] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-15T17:34:46.657261] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-09-15T17:34:46.700223] [INFO ] [REMOTE ] BRO: Full fetch complete (55871 records). [2025-09-15T17:34:46.732065] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-09-15T17:34:46.758615] [FATAL] [VALIDATOR ] BRO: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:34:46.764157] [FATAL] [MAIN ] BRO: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:34:46.774485] [WARN ] [MAIN ] BRO: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:34:46.784820] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-09-15T17:34:46.808200] [DEBUG] [LOCAL ] BRO: No primary data file found to delete. [2025-09-15T17:34:46.810269] [INFO ] [LOCAL ] BRO: Starting deletion of derivative data. [2025-09-15T17:34:46.865558] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-09-15T17:34:46.865693] [DEBUG] [LOCAL ] BRO: Deleted derivative data file. [2025-09-15T17:34:46.892156] [INFO ] [MAIN ] Update Progress: 333/2369 symbols completed. BRO took 24.5s. Estimated remaining: 3h 32m 19s. Rate: 9.6 symbols/min [2025-09-15T17:34:47.178187] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:34:47.196551] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:34:47.224547] [DEBUG] [LOCAL ] BRSP: Loaded 26840 existing records from primary storage. [2025-09-15T17:34:47.224746] [INFO ] [MAIN ] BRSP: Loaded 26840 existing records. [2025-09-15T17:34:47.416471] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:34:47.418016] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-09-15T17:34:47.417863] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T17:34:47.418095] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-09-15T17:34:47.424050] [INFO ] [REMOTE ] BRFS: Full fetch complete (44685 records). [2025-09-15T17:34:47.424261] [DEBUG] [VALIDATOR ] BRFS: Validating primary data. [2025-09-15T17:34:47.424435] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-09-15T17:34:47.424583] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-09-15T17:34:47.430347] [FATAL] [VALIDATOR ] BRFS: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:34:47.491834] [FATAL] [MAIN ] BRFS: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:34:47.519393] [WARN ] [MAIN ] BRFS: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:34:47.531214] [INFO ] [LOCAL ] BRFS: Starting deletion of primary data. [2025-09-15T17:34:47.531609] [DEBUG] [LOCAL ] BRFS: No primary data file found to delete. [2025-09-15T17:34:47.537066] [INFO ] [LOCAL ] BRFS: Starting deletion of derivative data. [2025-09-15T17:34:47.558019] [DEBUG] [LOCAL ] BRFS: Deleted derivative data file. [2025-09-15T17:34:47.585104] [INFO ] [MAIN ] Update Progress: 334/2369 symbols completed. BRFS took 27.3s. Estimated remaining: 3h 31m 39s. Rate: 9.6 symbols/min [2025-09-15T17:34:47.665920] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-02. [2025-09-15T17:34:47.953625] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:34:47.972872] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:34:47.977446] [DEBUG] [LOCAL ] BRT: Loaded 3527 existing records from primary storage. [2025-09-15T17:34:47.977550] [INFO ] [MAIN ] BRT: Loaded 3527 existing records. [2025-09-15T17:34:48.009789] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:34:48.046718] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-02 [2025-09-15T17:34:48.160453] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:34:48.160735] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-09-15T17:34:48.160784] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-09-15T17:34:48.161000] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-09-15T17:34:48.161050] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-09-15T17:34:48.461404] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-03. [2025-09-15T17:34:48.519704] [INFO ] [REMOTE ] BRT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:34:48.550340] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-15T17:34:48.696839] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:34:48.697186] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-03 [2025-09-15T17:34:49.257880] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-09-15T17:34:50.057898] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-09-15T17:34:50.620231] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-15T17:34:50.857838] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-09-15T17:34:51.135022] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-15T17:34:51.468293] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-15T17:34:51.657874] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-04. [2025-09-15T17:34:51.861874] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:34:51.862367] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-04 [2025-09-15T17:34:52.457902] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-05. [2025-09-15T17:34:52.640878] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:34:52.641196] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-05 [2025-09-15T17:34:53.257872] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-06. [2025-09-15T17:34:53.475229] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:34:53.475750] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-06 [2025-09-15T17:34:54.057877] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-07. [2025-09-15T17:34:54.857879] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-09-15T17:34:55.657836] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-09-15T17:34:55.700008] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-15T17:34:56.322785] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-15T17:34:56.328286] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-15T17:34:56.457835] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-09-15T17:34:57.257878] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-09-15T17:34:57.653060] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-15T17:34:58.057835] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-08. [2025-09-15T17:34:58.359287] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-15T17:34:58.857870] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-09-15T17:34:59.595202] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-15T17:34:59.657924] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-09-15T17:35:00.100807] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-15T17:35:00.163547] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T17:35:00.457872] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-09-15T17:35:01.257916] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-09-15T17:35:01.730036] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-15T17:35:02.057989] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-09-15T17:35:02.857918] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-09-15T17:35:02.906702] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-15T17:35:02.930479] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-15T17:35:02.936590] [INFO ] [REMOTE ] BROS: Full fetch complete (57565 records). [2025-09-15T17:35:02.936843] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-09-15T17:35:02.937962] [FATAL] [VALIDATOR ] BROS: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:35:02.938100] [FATAL] [MAIN ] BROS: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:35:02.938151] [WARN ] [MAIN ] BROS: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:35:02.938200] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-09-15T17:35:02.938276] [DEBUG] [LOCAL ] BROS: No primary data file found to delete. [2025-09-15T17:35:02.938317] [INFO ] [LOCAL ] BROS: Starting deletion of derivative data. [2025-09-15T17:35:02.938706] [DEBUG] [LOCAL ] BROS: Deleted derivative data file. [2025-09-15T17:35:02.939014] [INFO ] [MAIN ] Update Progress: 335/2369 symbols completed. BROS took 32.3s. Estimated remaining: 3h 32m 28s. Rate: 9.6 symbols/min [2025-09-15T17:35:03.123268] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:35:03.143530] [DEBUG] [LOCAL ] BRW: Loaded 14128 existing records from primary storage. [2025-09-15T17:35:03.143777] [INFO ] [MAIN ] BRW: Loaded 14128 existing records. [2025-09-15T17:35:03.339107] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:35:03.339505] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-09-15T17:35:03.339560] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-09-15T17:35:03.340207] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-09-15T17:35:03.340261] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-09-15T17:35:03.663143] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-09. [2025-09-15T17:35:03.722320] [INFO ] [REMOTE ] BRW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:35:03.956202] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-15T17:35:04.457984] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-09-15T17:35:05.156511] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-15T17:35:05.257875] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-09-15T17:35:05.382806] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-15T17:35:05.387537] [INFO ] [REMOTE ] BRSL: Full fetch complete (18687 records). [2025-09-15T17:35:05.387608] [DEBUG] [VALIDATOR ] BRSL: Validating primary data. [2025-09-15T17:35:05.388125] [FATAL] [VALIDATOR ] BRSL: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:35:05.388200] [FATAL] [MAIN ] BRSL: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:35:05.388237] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:35:05.388281] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-15T17:35:05.388338] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-15T17:35:05.388373] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-09-15T17:35:05.388412] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-09-15T17:35:05.388480] [INFO ] [MAIN ] Update Progress: 336/2369 symbols completed. BRSL took 18.9s. Estimated remaining: 3h 31m 59s. Rate: 9.6 symbols/min [2025-09-15T17:35:05.554397] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:35:05.602207] [DEBUG] [LOCAL ] BRX: Loaded 39074 existing records from primary storage. [2025-09-15T17:35:05.602358] [INFO ] [MAIN ] BRX: Loaded 39074 existing records. [2025-09-15T17:35:05.776065] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:35:05.776288] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-09-15T17:35:05.776333] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-09-15T17:35:05.777144] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-09-15T17:35:05.777195] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-09-15T17:35:05.879540] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T17:35:05.910289] [INFO ] [REMOTE ] BRT: Full fetch complete (4965 records). [2025-09-15T17:35:05.933955] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-09-15T17:35:06.004107] [FATAL] [VALIDATOR ] BRT: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:35:06.041413] [FATAL] [MAIN ] BRT: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:35:06.060712] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-09-15T17:35:06.060566] [WARN ] [MAIN ] BRT: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:35:06.069880] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-09-15T17:35:06.080336] [DEBUG] [LOCAL ] BRT: No primary data file found to delete. [2025-09-15T17:35:06.104553] [INFO ] [LOCAL ] BRT: Starting deletion of derivative data. [2025-09-15T17:35:06.141965] [INFO ] [REMOTE ] BRX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:35:06.142007] [DEBUG] [LOCAL ] BRT: Deleted derivative data file. [2025-09-15T17:35:06.142177] [INFO ] [MAIN ] Update Progress: 337/2369 symbols completed. BRT took 18.6s. Estimated remaining: 3h 31m 19s. Rate: 9.6 symbols/min [2025-09-15T17:35:06.318566] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:35:06.345324] [DEBUG] [LOCAL ] BSAC: Loaded 24764 existing records from primary storage. [2025-09-15T17:35:06.345459] [INFO ] [MAIN ] BSAC: Loaded 24764 existing records. [2025-09-15T17:35:06.520216] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:35:06.520497] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-09-15T17:35:06.520558] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-09-15T17:35:06.521230] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-09-15T17:35:06.521292] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-09-15T17:35:06.867011] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-09-15T17:35:06.872667] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:35:06.884918] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-15T17:35:07.657905] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-09-15T17:35:08.235867] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T17:35:08.457829] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-09-15T17:35:08.621054] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-15T17:35:09.257879] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-09-15T17:35:09.606752] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-15T17:35:10.057900] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-09-15T17:35:10.177710] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-15T17:35:10.857868] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-09-15T17:35:11.181902] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-15T17:35:11.657919] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-09-15T17:35:12.233398] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-15T17:35:12.457928] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-09-15T17:35:13.012617] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T17:35:13.257908] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-09-15T17:35:13.342534] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-15T17:35:13.347705] [INFO ] [REMOTE ] BRSP: Full fetch complete (40326 records). [2025-09-15T17:35:13.347824] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-09-15T17:35:13.348449] [FATAL] [VALIDATOR ] BRSP: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:35:13.348537] [FATAL] [MAIN ] BRSP: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:35:13.348574] [WARN ] [MAIN ] BRSP: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:35:13.348617] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-09-15T17:35:13.348698] [DEBUG] [LOCAL ] BRSP: No primary data file found to delete. [2025-09-15T17:35:13.348734] [INFO ] [LOCAL ] BRSP: Starting deletion of derivative data. [2025-09-15T17:35:13.348913] [DEBUG] [LOCAL ] BRSP: Deleted derivative data file. [2025-09-15T17:35:13.348989] [INFO ] [MAIN ] Update Progress: 338/2369 symbols completed. BRSP took 26.4s. Estimated remaining: 3h 31m 19s. Rate: 9.6 symbols/min [2025-09-15T17:35:13.523133] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:35:13.553213] [DEBUG] [LOCAL ] BSBR: Loaded 26870 existing records from primary storage. [2025-09-15T17:35:13.553377] [INFO ] [MAIN ] BSBR: Loaded 26870 existing records. [2025-09-15T17:35:13.729665] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:35:13.729905] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-09-15T17:35:13.729951] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-09-15T17:35:13.730522] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-09-15T17:35:13.730570] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-09-15T17:35:14.081358] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-09-15T17:35:14.087050] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:35:14.519915] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-15T17:35:14.857907] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-09-15T17:35:15.045978] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-15T17:35:15.657915] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-09-15T17:35:16.279825] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-15T17:35:16.457909] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-09-15T17:35:16.956011] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-15T17:35:17.257928] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-09-15T17:35:17.785065] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T17:35:17.946191] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-15T17:35:18.057872] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-09-15T17:35:18.857894] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-09-15T17:35:19.424588] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T17:35:19.659520] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-09-15T17:35:19.659323] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-15T17:35:20.457890] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-09-15T17:35:20.490317] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-15T17:35:21.257877] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-09-15T17:35:21.594903] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-15T17:35:22.057898] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-09-15T17:35:22.162695] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-15T17:35:22.857851] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-09-15T17:35:22.892487] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-15T17:35:23.657880] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-09-15T17:35:23.881630] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-15T17:35:24.457869] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-09-15T17:35:24.734956] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-15T17:35:25.257829] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-09-15T17:35:25.456974] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-15T17:35:25.459829] [INFO ] [REMOTE ] BRW: Full fetch complete (20276 records). [2025-09-15T17:35:25.459901] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-09-15T17:35:25.822936] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-09-15T17:35:25.823042] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-09-15T17:35:25.823399] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-09-15T17:35:25.823459] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-09-15T17:35:25.824097] [DEBUG] [LOCAL ] BRW: Trimmed 20276 records to 14142 (keeping 150 days of data) [2025-09-15T17:35:25.911302] [DEBUG] [LOCAL ] BRW: Primary data saved (14142 records). [2025-09-15T17:35:25.911452] [INFO ] [MAIN ] BRW: Full history saved. [2025-09-15T17:35:25.911540] [INFO ] [MAIN ] Update Progress: 339/2369 symbols completed. BRW took 23.0s. Estimated remaining: 3h 31m 50s. Rate: 9.6 symbols/min [2025-09-15T17:35:26.076104] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-09-15T17:35:26.078394] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:35:26.085626] [DEBUG] [LOCAL ] BSL: Loaded 5222 existing records from primary storage. [2025-09-15T17:35:26.085725] [INFO ] [MAIN ] BSL: Loaded 5222 existing records. [2025-09-15T17:35:26.260486] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:35:26.260758] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-09-15T17:35:26.260878] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-09-15T17:35:26.261162] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-09-15T17:35:26.261210] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-09-15T17:35:26.618077] [INFO ] [REMOTE ] BSL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:35:26.682685] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-15T17:35:26.857863] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-09-15T17:35:27.023980] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-15T17:35:27.657878] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-09-15T17:35:27.822010] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-15T17:35:28.457857] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-09-15T17:35:28.618432] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T17:35:29.257872] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-09-15T17:35:29.653471] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-15T17:35:30.057880] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-09-15T17:35:30.772238] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T17:35:30.857892] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-09-15T17:35:31.266284] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-15T17:35:31.270176] [INFO ] [REMOTE ] BSAC: Full fetch complete (35552 records). [2025-09-15T17:35:31.270286] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-09-15T17:35:31.645137] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-09-15T17:35:31.645238] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-09-15T17:35:31.645753] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-09-15T17:35:31.645815] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-09-15T17:35:31.646932] [DEBUG] [LOCAL ] BSAC: Trimmed 35552 records to 24120 (keeping 150 days of data) [2025-09-15T17:35:31.702390] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-09-15T17:35:31.799530] [DEBUG] [LOCAL ] BSAC: Primary data saved (24120 records). [2025-09-15T17:35:31.799681] [INFO ] [MAIN ] BSAC: Full history saved. [2025-09-15T17:35:31.799958] [INFO ] [MAIN ] Update Progress: 340/2369 symbols completed. BSAC took 25.7s. Estimated remaining: 3h 31m 42s. Rate: 9.6 symbols/min [2025-09-15T17:35:31.977576] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:35:32.000965] [DEBUG] [LOCAL ] BSM: Loaded 24437 existing records from primary storage. [2025-09-15T17:35:32.001149] [INFO ] [MAIN ] BSM: Loaded 24437 existing records. [2025-09-15T17:35:32.218821] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:35:32.219396] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-09-15T17:35:32.225700] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-09-15T17:35:32.239831] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-09-15T17:35:32.239754] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-15T17:35:32.247237] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-09-15T17:35:32.318431] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T17:35:32.463075] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-09-15T17:35:32.618970] [INFO ] [REMOTE ] BSM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:35:33.257895] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-09-15T17:35:33.604387] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-15T17:35:34.057888] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-09-15T17:35:34.173284] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-15T17:35:34.660551] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-15T17:35:34.857885] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-09-15T17:35:35.369801] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-15T17:35:35.657931] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-09-15T17:35:36.457905] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-09-15T17:35:36.650720] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-15T17:35:36.873734] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-15T17:35:37.257871] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-09-15T17:35:38.057833] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-09-15T17:35:38.118696] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-15T17:35:38.857878] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-09-15T17:35:39.492495] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-15T17:35:39.507442] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-15T17:35:39.657879] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-09-15T17:35:40.457849] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-09-15T17:35:40.609227] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-15T17:35:41.257880] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-09-15T17:35:42.027081] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-15T17:35:42.057843] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-09-15T17:35:42.510675] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-15T17:35:42.857917] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-09-15T17:35:42.884047] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-15T17:35:42.890879] [INFO ] [REMOTE ] BSBR: Full fetch complete (38140 records). [2025-09-15T17:35:42.891040] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-09-15T17:35:43.281248] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-09-15T17:35:43.281333] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-09-15T17:35:43.281914] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-09-15T17:35:43.281977] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-09-15T17:35:43.283137] [DEBUG] [LOCAL ] BSBR: Trimmed 38140 records to 26500 (keeping 150 days of data) [2025-09-15T17:35:43.406873] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-15T17:35:43.409670] [INFO ] [REMOTE ] BSL: Full fetch complete (9436 records). [2025-09-15T17:35:43.410053] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-09-15T17:35:43.666235] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-09-15T17:35:43.764120] [DEBUG] [LOCAL ] BSBR: Primary data saved (26500 records). [2025-09-15T17:35:43.774685] [INFO ] [MAIN ] BSBR: Full history saved. [2025-09-15T17:35:43.774942] [INFO ] [MAIN ] Update Progress: 341/2369 symbols completed. BSBR took 30.4s. Estimated remaining: 3h 32m 10s. Rate: 9.6 symbols/min [2025-09-15T17:35:43.978253] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-09-15T17:35:43.988573] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-09-15T17:35:44.013708] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-09-15T17:35:44.029401] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-09-15T17:35:44.047253] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:35:44.047882] [DEBUG] [LOCAL ] BSL: Trimmed 9436 records to 5094 (keeping 150 days of data) [2025-09-15T17:35:44.092563] [DEBUG] [LOCAL ] BSL: Primary data saved (5094 records). [2025-09-15T17:35:44.093028] [DEBUG] [LOCAL ] BST: Loaded 13627 existing records from primary storage. [2025-09-15T17:35:44.093201] [INFO ] [MAIN ] BSL: Full history saved. [2025-09-15T17:35:44.093277] [INFO ] [MAIN ] BST: Loaded 13627 existing records. [2025-09-15T17:35:44.137388] [INFO ] [MAIN ] Update Progress: 342/2369 symbols completed. BSL took 18.2s. Estimated remaining: 3h 31m 28s. Rate: 9.6 symbols/min [2025-09-15T17:35:44.403936] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:35:44.454382] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-09-15T17:35:44.454294] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:35:44.454843] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-09-15T17:35:44.455340] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-09-15T17:35:44.455452] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-09-15T17:35:44.466661] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-09-15T17:35:44.687420] [DEBUG] [LOCAL ] BSTZ: Loaded 18235 existing records from primary storage. [2025-09-15T17:35:44.726995] [INFO ] [MAIN ] BSTZ: Loaded 18235 existing records. [2025-09-15T17:35:44.964148] [INFO ] [REMOTE ] BST: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:35:45.035742] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:35:45.036128] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-09-15T17:35:45.036228] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-09-15T17:35:45.042668] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-09-15T17:35:45.052978] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-09-15T17:35:45.121690] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T17:35:45.262934] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-09-15T17:35:45.421737] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:35:46.057883] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-09-15T17:35:46.197772] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-15T17:35:46.204852] [INFO ] [REMOTE ] BRX: Full fetch complete (56449 records). [2025-09-15T17:35:46.205030] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-09-15T17:35:46.595386] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-09-15T17:35:46.595494] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-09-15T17:35:46.596257] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-09-15T17:35:46.596379] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-09-15T17:35:46.613612] [DEBUG] [LOCAL ] BRX: Trimmed 56449 records to 38344 (keeping 150 days of data) [2025-09-15T17:35:46.613464] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T17:35:46.860633] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-09-15T17:35:46.869661] [DEBUG] [LOCAL ] BRX: Primary data saved (38344 records). [2025-09-15T17:35:46.870282] [INFO ] [MAIN ] BRX: Full history saved. [2025-09-15T17:35:46.872483] [INFO ] [MAIN ] Update Progress: 343/2369 symbols completed. BRX took 41.5s. Estimated remaining: 3h 31m 1s. Rate: 9.6 symbols/min [2025-09-15T17:35:47.051963] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:35:47.067152] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-15T17:35:47.114749] [DEBUG] [LOCAL ] BSX: Loaded 40428 existing records from primary storage. [2025-09-15T17:35:47.114893] [INFO ] [MAIN ] BSX: Loaded 40428 existing records. [2025-09-15T17:35:47.287433] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:35:47.287695] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-09-15T17:35:47.287742] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-09-15T17:35:47.288689] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-09-15T17:35:47.288739] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-09-15T17:35:47.641724] [INFO ] [REMOTE ] BSX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:35:47.657851] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-09-15T17:35:48.263205] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T17:35:48.457871] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-09-15T17:35:49.172826] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-15T17:35:49.262935] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-09-15T17:35:49.272124] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-15T17:35:50.057882] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-09-15T17:35:50.526998] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-15T17:35:50.767410] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-15T17:35:50.857841] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-09-15T17:35:51.657870] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-09-15T17:35:51.851930] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T17:35:52.457859] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-09-15T17:35:52.744533] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-15T17:35:53.257873] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-09-15T17:35:53.368970] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-15T17:35:53.953117] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-15T17:35:54.057868] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-09-15T17:35:54.857881] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-09-15T17:35:55.596883] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-15T17:35:55.657830] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-09-15T17:35:55.854260] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-15T17:35:56.457874] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-09-15T17:35:56.660672] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-15T17:35:57.257858] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-09-15T17:35:57.880348] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-15T17:35:58.057816] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-09-15T17:35:58.157408] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T17:35:58.161568] [INFO ] [REMOTE ] BSM: Full fetch complete (35993 records). [2025-09-15T17:35:58.161672] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-09-15T17:35:58.526614] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-09-15T17:35:58.526713] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-09-15T17:35:58.527192] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-09-15T17:35:58.527233] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-09-15T17:35:58.528024] [DEBUG] [LOCAL ] BSM: Trimmed 35993 records to 23991 (keeping 150 days of data) [2025-09-15T17:35:58.675300] [DEBUG] [LOCAL ] BSM: Primary data saved (23991 records). [2025-09-15T17:35:58.675446] [INFO ] [MAIN ] BSM: Full history saved. [2025-09-15T17:35:58.675533] [INFO ] [MAIN ] Update Progress: 344/2369 symbols completed. BSM took 26.9s. Estimated remaining: 3h 31m 28s. Rate: 9.6 symbols/min [2025-09-15T17:35:58.842218] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:35:58.847677] [DEBUG] [LOCAL ] BTA: Loaded 4083 existing records from primary storage. [2025-09-15T17:35:58.847760] [INFO ] [MAIN ] BTA: Loaded 4083 existing records. [2025-09-15T17:35:58.867724] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-09-15T17:35:59.021924] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:35:59.022145] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-09-15T17:35:59.022194] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-09-15T17:35:59.022427] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-09-15T17:35:59.022470] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-09-15T17:35:59.379396] [INFO ] [REMOTE ] BTA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:35:59.657910] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-09-15T17:35:59.959491] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-15T17:36:00.226138] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-15T17:36:00.457850] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-09-15T17:36:00.481251] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-15T17:36:01.257927] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-09-15T17:36:02.057904] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-09-15T17:36:02.204018] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T17:36:02.323327] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-15T17:36:02.691960] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-15T17:36:02.857858] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-09-15T17:36:03.657864] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-09-15T17:36:03.879127] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-15T17:36:04.262629] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-15T17:36:04.457968] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-09-15T17:36:05.257886] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-09-15T17:36:05.389329] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-15T17:36:05.392260] [INFO ] [REMOTE ] BSTZ: Full fetch complete (27054 records). [2025-09-15T17:36:05.392357] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-09-15T17:36:05.767230] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-09-15T17:36:05.767385] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-09-15T17:36:05.767863] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-09-15T17:36:05.767940] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-09-15T17:36:05.768779] [DEBUG] [LOCAL ] BSTZ: Trimmed 27054 records to 18005 (keeping 150 days of data) [2025-09-15T17:36:05.881547] [DEBUG] [LOCAL ] BSTZ: Primary data saved (18005 records). [2025-09-15T17:36:05.881714] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-09-15T17:36:05.881829] [INFO ] [MAIN ] Update Progress: 345/2369 symbols completed. BSTZ took 21.7s. Estimated remaining: 3h 31m 27s. Rate: 9.6 symbols/min [2025-09-15T17:36:06.052836] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:36:06.059735] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-09-15T17:36:06.066839] [DEBUG] [LOCAL ] BTCM: Loaded 12647 existing records from primary storage. [2025-09-15T17:36:06.066933] [INFO ] [MAIN ] BTCM: Loaded 12647 existing records. [2025-09-15T17:36:06.243146] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:36:06.243459] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-09-15T17:36:06.243512] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-09-15T17:36:06.243886] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-09-15T17:36:06.243935] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-09-15T17:36:06.552719] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-15T17:36:06.598314] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-15T17:36:06.620521] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:36:06.857884] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-09-15T17:36:07.574525] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-15T17:36:07.657933] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-09-15T17:36:08.439190] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-15T17:36:08.457879] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-09-15T17:36:09.257910] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-09-15T17:36:09.869818] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-15T17:36:10.057887] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-09-15T17:36:10.215235] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-15T17:36:10.857846] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-09-15T17:36:10.876070] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T17:36:11.657894] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-09-15T17:36:12.368348] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-15T17:36:12.457905] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-09-15T17:36:12.638403] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-15T17:36:13.122248] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T17:36:13.257884] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-09-15T17:36:14.057933] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-09-15T17:36:14.857879] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-09-15T17:36:14.978853] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-15T17:36:15.052594] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T17:36:15.055010] [INFO ] [REMOTE ] BST: Full fetch complete (21146 records). [2025-09-15T17:36:15.055092] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-09-15T17:36:15.055716] [FATAL] [VALIDATOR ] BST: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:36:15.055808] [FATAL] [MAIN ] BST: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:36:15.055853] [WARN ] [MAIN ] BST: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:36:15.055901] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-09-15T17:36:15.055975] [DEBUG] [LOCAL ] BST: No primary data file found to delete. [2025-09-15T17:36:15.056014] [INFO ] [LOCAL ] BST: Starting deletion of derivative data. [2025-09-15T17:36:15.056365] [DEBUG] [LOCAL ] BST: Deleted derivative data file. [2025-09-15T17:36:15.056454] [INFO ] [MAIN ] Update Progress: 346/2369 symbols completed. BST took 31.3s. Estimated remaining: 3h 31m 38s. Rate: 9.6 symbols/min [2025-09-15T17:36:15.245365] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:36:15.287495] [DEBUG] [LOCAL ] BTE: Loaded 39642 existing records from primary storage. [2025-09-15T17:36:15.287667] [INFO ] [MAIN ] BTE: Loaded 39642 existing records. [2025-09-15T17:36:15.466414] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:36:15.466662] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-09-15T17:36:15.466716] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-09-15T17:36:15.467569] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-09-15T17:36:15.467619] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-09-15T17:36:15.667521] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-09-15T17:36:15.826724] [INFO ] [REMOTE ] BTE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:36:16.289578] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T17:36:16.295526] [INFO ] [REMOTE ] BSX: Full fetch complete (58365 records). [2025-09-15T17:36:16.295635] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-09-15T17:36:16.475035] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-09-15T17:36:16.570103] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-15T17:36:16.708931] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-09-15T17:36:16.709018] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-09-15T17:36:16.709686] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-09-15T17:36:16.709734] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-09-15T17:36:16.711118] [DEBUG] [LOCAL ] BSX: Trimmed 58365 records to 39648 (keeping 150 days of data) [2025-09-15T17:36:16.970030] [DEBUG] [LOCAL ] BSX: Primary data saved (39648 records). [2025-09-15T17:36:16.970186] [INFO ] [MAIN ] BSX: Full history saved. [2025-09-15T17:36:16.971450] [INFO ] [MAIN ] Update Progress: 347/2369 symbols completed. BSX took 30.1s. Estimated remaining: 3h 31m 6s. Rate: 9.6 symbols/min [2025-09-15T17:36:17.148356] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:36:17.190822] [DEBUG] [LOCAL ] BTI: Loaded 40349 existing records from primary storage. [2025-09-15T17:36:17.191013] [INFO ] [MAIN ] BTI: Loaded 40349 existing records. [2025-09-15T17:36:17.266837] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-09-15T17:36:17.379343] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:36:17.379587] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-09-15T17:36:17.379637] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-09-15T17:36:17.380547] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-09-15T17:36:17.380599] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-09-15T17:36:17.734696] [INFO ] [REMOTE ] BTI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:36:17.866899] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-15T17:36:18.057903] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-09-15T17:36:18.127804] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T17:36:18.761822] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T17:36:18.763054] [INFO ] [REMOTE ] BTA: Full fetch complete (5973 records). [2025-09-15T17:36:18.763124] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-09-15T17:36:18.863066] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-09-15T17:36:19.129555] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-09-15T17:36:19.129631] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-09-15T17:36:19.129809] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-09-15T17:36:19.129848] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-09-15T17:36:19.130236] [DEBUG] [LOCAL ] BTA: Trimmed 5973 records to 4014 (keeping 150 days of data) [2025-09-15T17:36:19.154438] [DEBUG] [LOCAL ] BTA: Primary data saved (4014 records). [2025-09-15T17:36:19.154518] [INFO ] [MAIN ] BTA: Full history saved. [2025-09-15T17:36:19.154635] [INFO ] [MAIN ] Update Progress: 348/2369 symbols completed. BTA took 20.5s. Estimated remaining: 3h 30m 36s. Rate: 9.6 symbols/min [2025-09-15T17:36:19.330919] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:36:19.338250] [DEBUG] [LOCAL ] BTO: Loaded 6230 existing records from primary storage. [2025-09-15T17:36:19.338331] [INFO ] [MAIN ] BTO: Loaded 6230 existing records. [2025-09-15T17:36:19.521524] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:36:19.521798] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-09-15T17:36:19.521847] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-09-15T17:36:19.522210] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-09-15T17:36:19.522280] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-09-15T17:36:19.672930] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-09-15T17:36:19.918417] [INFO ] [REMOTE ] BTO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:36:20.457875] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-09-15T17:36:20.684843] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-15T17:36:20.947982] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T17:36:21.257863] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-09-15T17:36:21.827132] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-15T17:36:22.057911] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-09-15T17:36:22.857895] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-09-15T17:36:23.155656] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-15T17:36:23.388202] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-15T17:36:23.657889] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-09-15T17:36:23.839662] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-15T17:36:24.457876] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-09-15T17:36:24.964209] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-15T17:36:25.257884] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-09-15T17:36:25.607399] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-15T17:36:25.754484] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-15T17:36:26.057873] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-09-15T17:36:26.567790] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-15T17:36:26.857865] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-09-15T17:36:27.657867] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-09-15T17:36:28.092503] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T17:36:28.095477] [INFO ] [REMOTE ] BTCM: Full fetch complete (14521 records). [2025-09-15T17:36:28.095559] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-09-15T17:36:28.463047] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-09-15T17:36:28.468435] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-09-15T17:36:28.469319] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-09-15T17:36:28.469751] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-09-15T17:36:28.469819] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-09-15T17:36:28.470602] [DEBUG] [LOCAL ] BTCM: Trimmed 14521 records to 12784 (keeping 150 days of data) [2025-09-15T17:36:28.546954] [DEBUG] [LOCAL ] BTCM: Primary data saved (12784 records). [2025-09-15T17:36:28.547096] [INFO ] [MAIN ] BTCM: Full history saved. [2025-09-15T17:36:28.547203] [INFO ] [MAIN ] Update Progress: 349/2369 symbols completed. BTCM took 22.7s. Estimated remaining: 3h 30m 48s. Rate: 9.6 symbols/min [2025-09-15T17:36:28.723545] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:36:28.735291] [DEBUG] [LOCAL ] BTT: Loaded 11736 existing records from primary storage. [2025-09-15T17:36:28.735457] [INFO ] [MAIN ] BTT: Loaded 11736 existing records. [2025-09-15T17:36:28.915183] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:36:28.915440] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-09-15T17:36:28.915486] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-09-15T17:36:28.915948] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-09-15T17:36:28.916009] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-09-15T17:36:29.272624] [INFO ] [REMOTE ] BTT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:36:29.272717] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-09-15T17:36:29.366907] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-15T17:36:29.980039] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-15T17:36:30.057884] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-09-15T17:36:30.234676] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-15T17:36:30.779494] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-15T17:36:30.857936] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-09-15T17:36:31.581898] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-15T17:36:31.658019] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-09-15T17:36:32.157703] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-15T17:36:32.159126] [INFO ] [REMOTE ] BTO: Full fetch complete (9790 records). [2025-09-15T17:36:32.159204] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-09-15T17:36:32.462782] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-09-15T17:36:32.549473] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-09-15T17:36:32.549558] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-09-15T17:36:32.549916] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-09-15T17:36:32.549969] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-09-15T17:36:32.550491] [DEBUG] [LOCAL ] BTO: Trimmed 9790 records to 6142 (keeping 150 days of data) [2025-09-15T17:36:32.590474] [DEBUG] [LOCAL ] BTO: Primary data saved (6142 records). [2025-09-15T17:36:32.590612] [INFO ] [MAIN ] BTO: Full history saved. [2025-09-15T17:36:32.590732] [INFO ] [MAIN ] Update Progress: 350/2369 symbols completed. BTO took 13.4s. Estimated remaining: 3h 30m 29s. Rate: 9.6 symbols/min [2025-09-15T17:36:32.793149] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:36:32.835040] [DEBUG] [LOCAL ] BTU: Loaded 40092 existing records from primary storage. [2025-09-15T17:36:32.835188] [INFO ] [MAIN ] BTU: Loaded 40092 existing records. [2025-09-15T17:36:33.018744] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:36:33.019011] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-09-15T17:36:33.019061] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-09-15T17:36:33.020011] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-09-15T17:36:33.020065] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-09-15T17:36:33.269404] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-09-15T17:36:33.393099] [INFO ] [REMOTE ] BTU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:36:34.057900] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-09-15T17:36:34.097167] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-15T17:36:34.564246] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-15T17:36:34.857863] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-09-15T17:36:35.657899] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-09-15T17:36:35.867468] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-15T17:36:36.457912] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-09-15T17:36:36.626611] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-15T17:36:37.257875] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-09-15T17:36:37.312515] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T17:36:37.956875] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T17:36:38.057878] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-09-15T17:36:38.857880] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-09-15T17:36:38.932533] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-15T17:36:39.657862] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-09-15T17:36:39.773391] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-15T17:36:39.911872] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-15T17:36:40.457882] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-09-15T17:36:41.229327] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T17:36:41.235101] [INFO ] [REMOTE ] BTE: Full fetch complete (57288 records). [2025-09-15T17:36:41.235199] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-09-15T17:36:41.267389] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-09-15T17:36:41.641181] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-09-15T17:36:41.641464] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-09-15T17:36:41.642438] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-09-15T17:36:41.642869] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-15T17:36:41.642965] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-09-15T17:36:41.649045] [DEBUG] [LOCAL ] BTE: Trimmed 57288 records to 38887 (keeping 150 days of data) [2025-09-15T17:36:41.884652] [DEBUG] [LOCAL ] BTE: Primary data saved (38887 records). [2025-09-15T17:36:41.884857] [INFO ] [MAIN ] BTE: Full history saved. [2025-09-15T17:36:41.885373] [INFO ] [MAIN ] Update Progress: 351/2369 symbols completed. BTE took 26.8s. Estimated remaining: 3h 30m 40s. Rate: 9.6 symbols/min [2025-09-15T17:36:42.056442] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:36:42.056607] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-09-15T17:36:42.056782] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-09-15T17:36:42.056925] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-09-15T17:36:42.056968] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-15T17:36:42.057012] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-15T17:36:42.057056] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-09-15T17:36:42.068312] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-09-15T17:36:42.423499] [INFO ] [REMOTE ] BTX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:36:42.734113] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T17:36:42.739881] [INFO ] [REMOTE ] BTI: Full fetch complete (58223 records). [2025-09-15T17:36:42.739982] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-09-15T17:36:42.863013] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-02. [2025-09-15T17:36:43.140501] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-09-15T17:36:43.140592] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-09-15T17:36:43.141269] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-09-15T17:36:43.141315] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-09-15T17:36:43.142474] [DEBUG] [LOCAL ] BTI: Trimmed 58223 records to 39570 (keeping 150 days of data) [2025-09-15T17:36:43.404482] [DEBUG] [LOCAL ] BTI: Primary data saved (39570 records). [2025-09-15T17:36:43.404677] [INFO ] [MAIN ] BTI: Full history saved. [2025-09-15T17:36:43.405552] [INFO ] [MAIN ] Update Progress: 352/2369 symbols completed. BTI took 26.4s. Estimated remaining: 3h 30m 7s. Rate: 9.6 symbols/min [2025-09-15T17:36:43.582573] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:36:43.601598] [DEBUG] [LOCAL ] BTZ: Loaded 16645 existing records from primary storage. [2025-09-15T17:36:43.601783] [INFO ] [MAIN ] BTZ: Loaded 16645 existing records. [2025-09-15T17:36:43.667042] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-09-15T17:36:43.793370] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:36:43.793807] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-09-15T17:36:43.793891] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-09-15T17:36:43.800958] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-09-15T17:36:43.801070] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-09-15T17:36:43.807692] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T17:36:44.175190] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:36:44.205831] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-15T17:36:44.457843] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-09-15T17:36:44.762529] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-15T17:36:45.196778] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-15T17:36:45.257837] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-09-15T17:36:45.907065] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-15T17:36:46.057880] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-03. [2025-09-15T17:36:46.857920] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-09-15T17:36:47.373273] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-15T17:36:47.657869] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-04. [2025-09-15T17:36:48.457898] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-09-15T17:36:48.724665] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-15T17:36:48.790139] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-15T17:36:49.257891] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-05. [2025-09-15T17:36:49.695727] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-15T17:36:50.057873] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-09-15T17:36:50.543777] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-15T17:36:50.857874] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-09-15T17:36:50.912125] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-15T17:36:51.657882] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-06. [2025-09-15T17:36:52.246010] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-15T17:36:52.455711] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-15T17:36:52.462504] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-09-15T17:36:53.257884] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-07. [2025-09-15T17:36:54.057929] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-09-15T17:36:54.166136] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-15T17:36:54.200853] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-15T17:36:54.857886] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-08. [2025-09-15T17:36:54.954036] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-15T17:36:55.657875] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-09-15T17:36:55.794575] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-15T17:36:56.457892] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-09-15T17:36:56.754585] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-15T17:36:57.073686] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-15T17:36:57.257871] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-09-15T17:36:58.057871] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-09-15T17:36:58.232620] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-15T17:36:58.857852] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-09. [2025-09-15T17:36:59.156556] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T17:36:59.657852] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-09-15T17:36:59.847109] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T17:36:59.851876] [INFO ] [REMOTE ] BTX: Full fetch complete (34215 records). [2025-09-15T17:36:59.852025] [DEBUG] [VALIDATOR ] BTX: Validating primary data. [2025-09-15T17:37:00.047794] [WARN ] [VALIDATOR ] BTX: Validation failed - insufficient historical data. Have 143 unique days, need 150 days [2025-09-15T17:37:00.048265] [FATAL] [MAIN ] BTX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:37:00.048319] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:37:00.048367] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-15T17:37:00.048445] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-15T17:37:00.048491] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-09-15T17:37:00.048534] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-09-15T17:37:00.048600] [INFO ] [MAIN ] Update Progress: 353/2369 symbols completed. BTX took 18.2s. Estimated remaining: 3h 30m 60s. Rate: 9.6 symbols/min [2025-09-15T17:37:00.234142] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:37:00.278912] [DEBUG] [LOCAL ] BUD: Loaded 39588 existing records from primary storage. [2025-09-15T17:37:00.279108] [INFO ] [MAIN ] BUD: Loaded 39588 existing records. [2025-09-15T17:37:00.461936] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-09-15T17:37:00.465527] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:37:00.466105] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-09-15T17:37:00.466902] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-09-15T17:37:00.467857] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-09-15T17:37:00.467915] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-09-15T17:37:00.826139] [INFO ] [REMOTE ] BUD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:37:01.257904] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-09-15T17:37:01.300127] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-15T17:37:01.573081] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-15T17:37:01.576979] [INFO ] [REMOTE ] BTZ: Full fetch complete (25090 records). [2025-09-15T17:37:01.577056] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-09-15T17:37:01.956351] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-15T17:37:01.971620] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-09-15T17:37:01.971745] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-09-15T17:37:01.972250] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-09-15T17:37:01.972323] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-09-15T17:37:01.974299] [DEBUG] [LOCAL ] BTZ: Trimmed 25090 records to 16047 (keeping 150 days of data) [2025-09-15T17:37:02.057899] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-09-15T17:37:02.089601] [DEBUG] [LOCAL ] BTZ: Primary data saved (16047 records). [2025-09-15T17:37:02.089794] [INFO ] [MAIN ] BTZ: Full history saved. [2025-09-15T17:37:02.089900] [INFO ] [MAIN ] Update Progress: 354/2369 symbols completed. BTZ took 18.7s. Estimated remaining: 3h 30m 29s. Rate: 9.6 symbols/min [2025-09-15T17:37:02.262402] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:37:02.273451] [DEBUG] [LOCAL ] BUI: Loaded 8643 existing records from primary storage. [2025-09-15T17:37:02.273596] [INFO ] [MAIN ] BUI: Loaded 8643 existing records. [2025-09-15T17:37:02.456210] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:37:02.456449] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-09-15T17:37:02.456494] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-09-15T17:37:02.456895] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-09-15T17:37:02.456944] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-09-15T17:37:02.817624] [INFO ] [REMOTE ] BUI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:37:02.824462] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T17:37:02.826821] [INFO ] [REMOTE ] BTT: Full fetch complete (17233 records). [2025-09-15T17:37:02.826891] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-09-15T17:37:02.827337] [FATAL] [VALIDATOR ] BTT: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:37:02.827411] [FATAL] [MAIN ] BTT: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:37:02.827456] [WARN ] [MAIN ] BTT: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:37:02.827503] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-09-15T17:37:02.827560] [DEBUG] [LOCAL ] BTT: No primary data file found to delete. [2025-09-15T17:37:02.827596] [INFO ] [LOCAL ] BTT: Starting deletion of derivative data. [2025-09-15T17:37:02.827883] [DEBUG] [LOCAL ] BTT: Deleted derivative data file. [2025-09-15T17:37:02.827975] [INFO ] [MAIN ] Update Progress: 355/2369 symbols completed. BTT took 34.3s. Estimated remaining: 3h 29m 52s. Rate: 9.6 symbols/min [2025-09-15T17:37:02.862951] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-09-15T17:37:03.003313] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:37:03.044771] [DEBUG] [LOCAL ] BUR: Loaded 34135 existing records from primary storage. [2025-09-15T17:37:03.044907] [INFO ] [MAIN ] BUR: Loaded 34135 existing records. [2025-09-15T17:37:03.239585] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:37:03.239865] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-09-15T17:37:03.239910] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-09-15T17:37:03.240547] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-09-15T17:37:03.240593] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-09-15T17:37:03.593128] [INFO ] [REMOTE ] BUR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:37:03.657834] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-09-15T17:37:04.457906] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-09-15T17:37:04.837944] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-15T17:37:04.909064] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-15T17:37:05.257947] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-09-15T17:37:05.977012] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-15T17:37:06.015538] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-15T17:37:06.057823] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-09-15T17:37:06.857927] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-09-15T17:37:07.290112] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-15T17:37:07.418871] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-15T17:37:07.426038] [INFO ] [REMOTE ] BTU: Full fetch complete (57933 records). [2025-09-15T17:37:07.426146] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-09-15T17:37:07.662991] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-09-15T17:37:07.810896] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-09-15T17:37:07.810968] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-09-15T17:37:07.811620] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-09-15T17:37:07.811679] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-09-15T17:37:07.812807] [DEBUG] [LOCAL ] BTU: Trimmed 57933 records to 39314 (keeping 150 days of data) [2025-09-15T17:37:08.054959] [DEBUG] [LOCAL ] BTU: Primary data saved (39314 records). [2025-09-15T17:37:08.055110] [INFO ] [MAIN ] BTU: Full history saved. [2025-09-15T17:37:08.055723] [INFO ] [MAIN ] Update Progress: 356/2369 symbols completed. BTU took 35.5s. Estimated remaining: 3h 29m 40s. Rate: 9.6 symbols/min [2025-09-15T17:37:08.231023] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:37:08.271863] [DEBUG] [LOCAL ] BURL: Loaded 34400 existing records from primary storage. [2025-09-15T17:37:08.271996] [INFO ] [MAIN ] BURL: Loaded 34400 existing records. [2025-09-15T17:37:08.450476] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:37:08.458680] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-15T17:37:08.458333] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-09-15T17:37:08.458756] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-09-15T17:37:08.462231] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-09-15T17:37:08.463336] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-09-15T17:37:08.463391] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-09-15T17:37:08.821266] [INFO ] [REMOTE ] BURL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:37:09.257927] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-09-15T17:37:09.773130] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-15T17:37:10.057854] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-09-15T17:37:10.198663] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-15T17:37:10.857873] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-09-15T17:37:11.644992] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-15T17:37:11.657805] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-09-15T17:37:11.703700] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-15T17:37:12.457877] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-09-15T17:37:12.504632] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-15T17:37:13.257894] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-09-15T17:37:14.057876] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-09-15T17:37:14.132341] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T17:37:14.843881] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-15T17:37:14.857810] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-09-15T17:37:14.929808] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-15T17:37:15.500740] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-15T17:37:15.502844] [INFO ] [REMOTE ] BUI: Full fetch complete (12214 records). [2025-09-15T17:37:15.502918] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-09-15T17:37:15.676383] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-09-15T17:37:15.869473] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-09-15T17:37:15.869546] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-09-15T17:37:15.869829] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-09-15T17:37:15.869871] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-09-15T17:37:15.870332] [DEBUG] [LOCAL ] BUI: Trimmed 12214 records to 8539 (keeping 150 days of data) [2025-09-15T17:37:15.927349] [DEBUG] [LOCAL ] BUI: Primary data saved (8539 records). [2025-09-15T17:37:15.927502] [INFO ] [MAIN ] BUI: Full history saved. [2025-09-15T17:37:15.927604] [INFO ] [MAIN ] Update Progress: 357/2369 symbols completed. BUI took 13.8s. Estimated remaining: 3h 29m 43s. Rate: 9.6 symbols/min [2025-09-15T17:37:16.457879] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-09-15T17:37:17.257887] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-09-15T17:37:17.651391] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-15T17:37:17.802315] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T17:37:18.057940] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-09-15T17:37:18.857899] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-09-15T17:37:19.071517] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-15T17:37:19.210496] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-15T17:37:19.657920] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-09-15T17:37:20.348128] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T17:37:20.457880] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-09-15T17:37:21.084816] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T17:37:21.257889] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-09-15T17:37:22.057986] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-09-15T17:37:22.165533] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-15T17:37:22.531822] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-15T17:37:22.857894] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-09-15T17:37:23.657931] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-09-15T17:37:23.814639] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-15T17:37:24.310610] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T17:37:24.457963] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-09-15T17:37:25.204007] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T17:37:25.257839] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-09-15T17:37:25.809771] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-15T17:37:26.057919] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-09-15T17:37:26.732332] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T17:37:26.737885] [INFO ] [REMOTE ] BUR: Full fetch complete (48635 records). [2025-09-15T17:37:26.738066] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-09-15T17:37:26.863020] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-09-15T17:37:27.131148] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-09-15T17:37:27.131303] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-09-15T17:37:27.132102] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-09-15T17:37:27.132182] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-09-15T17:37:27.133609] [DEBUG] [LOCAL ] BUR: Trimmed 48635 records to 33462 (keeping 150 days of data) [2025-09-15T17:37:27.341974] [DEBUG] [LOCAL ] BUR: Primary data saved (33462 records). [2025-09-15T17:37:27.342120] [INFO ] [MAIN ] BUR: Full history saved. [2025-09-15T17:37:27.342701] [INFO ] [MAIN ] Update Progress: 358/2369 symbols completed. BUR took 24.5s. Estimated remaining: 3h 30m 5s. Rate: 9.6 symbols/min [2025-09-15T17:37:27.452539] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-15T17:37:27.657895] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-09-15T17:37:28.467854] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-15T17:37:28.477952] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-09-15T17:37:29.473057] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-15T17:37:29.484895] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-09-15T17:37:30.079150] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T17:37:30.084339] [INFO ] [REMOTE ] BURL: Full fetch complete (50473 records). [2025-09-15T17:37:30.084479] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-09-15T17:37:30.500124] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-09-15T17:37:30.500300] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-09-15T17:37:30.500974] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-09-15T17:37:30.501028] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-09-15T17:37:30.502306] [DEBUG] [LOCAL ] BURL: Trimmed 50473 records to 33645 (keeping 150 days of data) [2025-09-15T17:37:30.709026] [DEBUG] [LOCAL ] BURL: Primary data saved (33645 records). [2025-09-15T17:37:30.709170] [INFO ] [MAIN ] BURL: Full history saved. [2025-09-15T17:37:30.709255] [INFO ] [MAIN ] Update Progress: 359/2369 symbols completed. BURL took 22.7s. Estimated remaining: 3h 29m 43s. Rate: 9.6 symbols/min [2025-09-15T17:37:30.983934] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T17:37:30.991383] [INFO ] [REMOTE ] BUD: Full fetch complete (57366 records). [2025-09-15T17:37:30.991602] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-09-15T17:37:31.379950] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-09-15T17:37:31.380031] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-09-15T17:37:31.380691] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-09-15T17:37:31.380735] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-09-15T17:37:31.381828] [DEBUG] [LOCAL ] BUD: Trimmed 57366 records to 38809 (keeping 150 days of data) [2025-09-15T17:37:31.618826] [DEBUG] [LOCAL ] BUD: Primary data saved (38809 records). [2025-09-15T17:37:31.618975] [INFO ] [MAIN ] BUD: Full history saved. [2025-09-15T17:37:31.620347] [INFO ] [MAIN ] Update Progress: 360/2369 symbols completed. BUD took 31.6s. Estimated remaining: 3h 29m 7s. Rate: 9.6 symbols/min [2025-09-15T17:37:32.261193] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:37:32.267178] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:37:32.360031] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:37:32.361829] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:37:32.386434] [DEBUG] [LOCAL ] BUXX: Loaded 11633 existing records from primary storage. [2025-09-15T17:37:32.386660] [INFO ] [MAIN ] BUXX: Loaded 11633 existing records. [2025-09-15T17:37:32.557115] [DEBUG] [LOCAL ] BVN: Loaded 32333 existing records from primary storage. [2025-09-15T17:37:32.556261] [DEBUG] [LOCAL ] BV: Loaded 28695 existing records from primary storage. [2025-09-15T17:37:32.572715] [INFO ] [MAIN ] BV: Loaded 28695 existing records. [2025-09-15T17:37:32.597611] [INFO ] [MAIN ] BVN: Loaded 32333 existing records. [2025-09-15T17:37:32.609266] [DEBUG] [LOCAL ] BW: Loaded 28564 existing records from primary storage. [2025-09-15T17:37:32.701065] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:37:32.695466] [INFO ] [MAIN ] BW: Loaded 28564 existing records. [2025-09-15T17:37:32.925831] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-09-15T17:37:33.025473] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-09-15T17:37:33.077229] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:37:33.124111] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-09-15T17:37:33.136341] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-09-15T17:37:33.207390] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-09-15T17:37:33.184492] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-09-15T17:37:33.252795] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:37:33.211742] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:37:33.286919] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-09-15T17:37:33.278077] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-09-15T17:37:33.313136] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-09-15T17:37:33.318361] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-09-15T17:37:33.328552] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-09-15T17:37:33.328667] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-09-15T17:37:33.339792] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-09-15T17:37:33.350550] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-09-15T17:37:33.380584] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-09-15T17:37:33.369880] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-09-15T17:37:34.535601] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:37:34.541491] [INFO ] [REMOTE ] BV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:37:34.540222] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-09-15T17:37:34.562911] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-09-15T17:37:34.708781] [INFO ] [REMOTE ] BW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:37:34.709207] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-09-15T17:37:34.705518] [INFO ] [REMOTE ] BVN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:37:34.710156] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-09-15T17:37:35.550711] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-15T17:37:35.553497] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-09-15T17:37:36.125609] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T17:37:36.133813] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-09-15T17:37:36.209050] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-15T17:37:36.217603] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-09-15T17:37:36.244946] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-15T17:37:36.253172] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-09-15T17:37:36.338570] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-15T17:37:36.457910] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-09-15T17:37:37.299588] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-15T17:37:37.308309] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-09-15T17:37:37.359240] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-15T17:37:37.389135] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-15T17:37:37.620727] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T17:37:38.057895] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-09-15T17:37:38.652582] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T17:37:38.857884] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-09-15T17:37:39.016073] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-15T17:37:39.657872] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-09-15T17:37:39.742021] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-15T17:37:40.457883] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-09-15T17:37:41.199533] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-15T17:37:41.257820] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-09-15T17:37:42.020426] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-15T17:37:42.057856] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-09-15T17:37:42.204672] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-15T17:37:42.857875] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-09-15T17:37:43.238901] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-15T17:37:43.657908] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-09-15T17:37:43.729175] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-15T17:37:44.457884] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-09-15T17:37:44.696918] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-15T17:37:45.257863] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-09-15T17:37:45.674531] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-15T17:37:46.057870] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-09-15T17:37:46.748061] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T17:37:46.857906] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-09-15T17:37:47.448054] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-15T17:37:47.657887] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-09-15T17:37:47.907688] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-15T17:37:48.457925] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-09-15T17:37:48.722359] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T17:37:49.257894] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-09-15T17:37:49.857817] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T17:37:50.057888] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-09-15T17:37:50.453743] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-15T17:37:50.857861] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-09-15T17:37:51.539106] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-15T17:37:51.657834] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-09-15T17:37:51.828047] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-15T17:37:51.833009] [INFO ] [REMOTE ] BVN: Full fetch complete (47115 records). [2025-09-15T17:37:51.833092] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-09-15T17:37:52.200450] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-09-15T17:37:52.200528] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-09-15T17:37:52.201092] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-09-15T17:37:52.201135] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-09-15T17:37:52.202064] [DEBUG] [LOCAL ] BVN: Trimmed 47115 records to 31889 (keeping 150 days of data) [2025-09-15T17:37:52.388148] [DEBUG] [LOCAL ] BVN: Primary data saved (31889 records). [2025-09-15T17:37:52.388289] [INFO ] [MAIN ] BVN: Full history saved. [2025-09-15T17:37:52.388369] [INFO ] [MAIN ] Update Progress: 361/2369 symbols completed. BVN took 20.8s. Estimated remaining: 3h 30m 21s. Rate: 9.5 symbols/min [2025-09-15T17:37:52.462992] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-09-15T17:37:52.558296] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:37:52.599598] [DEBUG] [LOCAL ] BWA: Loaded 39146 existing records from primary storage. [2025-09-15T17:37:52.599767] [INFO ] [MAIN ] BWA: Loaded 39146 existing records. [2025-09-15T17:37:52.781784] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:37:52.782086] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-09-15T17:37:52.782262] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-09-15T17:37:52.788203] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-09-15T17:37:52.795407] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-09-15T17:37:52.879096] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-15T17:37:52.945447] [INFO ] [REMOTE ] BW: Full fetch complete (42902 records). [2025-09-15T17:37:52.961617] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-09-15T17:37:53.258275] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-09-15T17:37:53.285082] [INFO ] [REMOTE ] BWA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:37:53.530657] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-09-15T17:37:53.530748] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-09-15T17:37:53.531321] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-09-15T17:37:53.531364] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-09-15T17:37:53.532371] [DEBUG] [LOCAL ] BW: Trimmed 42902 records to 28077 (keeping 150 days of data) [2025-09-15T17:37:53.695811] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T17:37:53.709716] [INFO ] [REMOTE ] BV: Full fetch complete (42102 records). [2025-09-15T17:37:53.712566] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-09-15T17:37:53.714862] [DEBUG] [LOCAL ] BW: Primary data saved (28077 records). [2025-09-15T17:37:53.715262] [INFO ] [MAIN ] BW: Full history saved. [2025-09-15T17:37:53.715846] [INFO ] [MAIN ] Update Progress: 362/2369 symbols completed. BW took 22.1s. Estimated remaining: 3h 29m 47s. Rate: 9.6 symbols/min [2025-09-15T17:37:54.080988] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-09-15T17:37:54.082627] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:37:54.284817] [DEBUG] [LOCAL ] BWG: Loaded 9612 existing records from primary storage. [2025-09-15T17:37:54.302465] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-15T17:37:54.302710] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-09-15T17:37:54.302844] [INFO ] [MAIN ] BWG: Loaded 9612 existing records. [2025-09-15T17:37:54.339527] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-09-15T17:37:54.372236] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-09-15T17:37:54.383836] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-09-15T17:37:54.433336] [DEBUG] [LOCAL ] BV: Trimmed 42102 records to 28319 (keeping 150 days of data) [2025-09-15T17:37:54.494004] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:37:54.555719] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-09-15T17:37:54.582725] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-09-15T17:37:54.590965] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-09-15T17:37:54.602227] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-09-15T17:37:54.859700] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-09-15T17:37:55.007125] [DEBUG] [LOCAL ] BV: Primary data saved (28319 records). [2025-09-15T17:37:55.008140] [INFO ] [MAIN ] BV: Full history saved. [2025-09-15T17:37:55.017928] [INFO ] [MAIN ] Update Progress: 363/2369 symbols completed. BV took 23.4s. Estimated remaining: 3h 29m 14s. Rate: 9.6 symbols/min [2025-09-15T17:37:55.028291] [INFO ] [REMOTE ] BWG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:37:55.215294] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:37:55.243493] [DEBUG] [LOCAL ] BWLP: Loaded 24114 existing records from primary storage. [2025-09-15T17:37:55.243634] [INFO ] [MAIN ] BWLP: Loaded 24114 existing records. [2025-09-15T17:37:55.427315] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:37:55.428071] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-09-15T17:37:55.428171] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-09-15T17:37:55.428926] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-09-15T17:37:55.429066] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-09-15T17:37:55.450859] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-15T17:37:55.630835] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-15T17:37:55.664115] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-09-15T17:37:55.851484] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:37:56.457844] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-09-15T17:37:56.604926] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-15T17:37:56.607004] [INFO ] [REMOTE ] BUXX: Full fetch complete (16143 records). [2025-09-15T17:37:56.607093] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-09-15T17:37:56.965877] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-09-15T17:37:56.965959] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-09-15T17:37:56.966288] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-09-15T17:37:56.966326] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-09-15T17:37:56.966879] [DEBUG] [LOCAL ] BUXX: Trimmed 16143 records to 11375 (keeping 150 days of data) [2025-09-15T17:37:57.041631] [DEBUG] [LOCAL ] BUXX: Primary data saved (11375 records). [2025-09-15T17:37:57.041795] [INFO ] [MAIN ] BUXX: Full history saved. [2025-09-15T17:37:57.041883] [INFO ] [MAIN ] Update Progress: 364/2369 symbols completed. BUXX took 25.4s. Estimated remaining: 3h 28m 44s. Rate: 9.6 symbols/min [2025-09-15T17:37:57.210186] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:37:57.218114] [DEBUG] [LOCAL ] BWMX: Loaded 6394 existing records from primary storage. [2025-09-15T17:37:57.218233] [INFO ] [MAIN ] BWMX: Loaded 6394 existing records. [2025-09-15T17:37:57.263108] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-09-15T17:37:57.397030] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:37:57.397307] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-09-15T17:37:57.397356] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-09-15T17:37:57.397707] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-09-15T17:37:57.397757] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-09-15T17:37:57.756919] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:37:57.774939] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T17:37:58.057869] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-09-15T17:37:58.136141] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-15T17:37:58.497326] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-15T17:37:58.857879] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-09-15T17:37:59.536023] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-15T17:37:59.657859] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-09-15T17:38:00.382290] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-15T17:38:00.457888] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-09-15T17:38:01.257938] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-09-15T17:38:01.324282] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-15T17:38:02.057916] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-09-15T17:38:02.398186] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-15T17:38:02.857882] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-09-15T17:38:03.435184] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T17:38:03.657870] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-09-15T17:38:04.149006] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-15T17:38:04.257827] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T17:38:04.457910] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-09-15T17:38:04.813672] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-15T17:38:05.257867] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-09-15T17:38:06.057902] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-09-15T17:38:06.738367] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T17:38:06.857869] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-09-15T17:38:07.159922] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-15T17:38:07.657887] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-09-15T17:38:08.226250] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T17:38:08.241332] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-15T17:38:08.457921] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-09-15T17:38:08.934275] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-15T17:38:09.257878] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-09-15T17:38:10.057857] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-09-15T17:38:10.221601] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-15T17:38:10.857887] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-09-15T17:38:11.359562] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T17:38:11.657919] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-09-15T17:38:11.756000] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T17:38:11.758950] [INFO ] [REMOTE ] BWG: Full fetch complete (13140 records). [2025-09-15T17:38:11.759057] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-09-15T17:38:12.125456] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-09-15T17:38:12.125586] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-09-15T17:38:12.125894] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-09-15T17:38:12.125950] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-09-15T17:38:12.126604] [DEBUG] [LOCAL ] BWG: Trimmed 13140 records to 9569 (keeping 150 days of data) [2025-09-15T17:38:12.188181] [DEBUG] [LOCAL ] BWG: Primary data saved (9569 records). [2025-09-15T17:38:12.188323] [INFO ] [MAIN ] BWG: Full history saved. [2025-09-15T17:38:12.188438] [INFO ] [MAIN ] Update Progress: 365/2369 symbols completed. BWG took 18.5s. Estimated remaining: 3h 29m 27s. Rate: 9.6 symbols/min [2025-09-15T17:38:12.358414] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:38:12.364333] [DEBUG] [LOCAL ] BWNB: Loaded 3446 existing records from primary storage. [2025-09-15T17:38:12.364477] [INFO ] [MAIN ] BWNB: Loaded 3446 existing records. [2025-09-15T17:38:12.463182] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-09-15T17:38:12.546514] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:38:12.546804] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-09-15T17:38:12.546851] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-09-15T17:38:12.547094] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-09-15T17:38:12.547140] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-09-15T17:38:12.906565] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:38:13.001788] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-15T17:38:13.067919] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-15T17:38:13.257914] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-09-15T17:38:14.057889] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-09-15T17:38:14.245620] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T17:38:14.249371] [INFO ] [REMOTE ] BWLP: Full fetch complete (35870 records). [2025-09-15T17:38:14.249451] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-09-15T17:38:14.564486] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-15T17:38:14.648460] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-09-15T17:38:14.648533] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-09-15T17:38:14.649020] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-09-15T17:38:14.649070] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-09-15T17:38:14.649858] [DEBUG] [LOCAL ] BWLP: Trimmed 35870 records to 23730 (keeping 150 days of data) [2025-09-15T17:38:14.793421] [DEBUG] [LOCAL ] BWLP: Primary data saved (23730 records). [2025-09-15T17:38:14.793551] [INFO ] [MAIN ] BWLP: Full history saved. [2025-09-15T17:38:14.793630] [INFO ] [MAIN ] Update Progress: 366/2369 symbols completed. BWLP took 19.8s. Estimated remaining: 3h 29m 0s. Rate: 9.6 symbols/min [2025-09-15T17:38:14.864290] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-09-15T17:38:14.984186] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:38:14.991227] [DEBUG] [LOCAL ] BWSN: Loaded 4133 existing records from primary storage. [2025-09-15T17:38:14.991343] [INFO ] [MAIN ] BWSN: Loaded 4133 existing records. [2025-09-15T17:38:15.167016] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:38:15.167420] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-09-15T17:38:15.167468] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-09-15T17:38:15.167994] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-09-15T17:38:15.168045] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-09-15T17:38:15.521802] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:38:15.522978] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-15T17:38:15.657906] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-09-15T17:38:16.260404] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-15T17:38:16.457951] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-09-15T17:38:17.258002] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-09-15T17:38:17.937926] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T17:38:17.954279] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-15T17:38:18.057864] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-09-15T17:38:18.857910] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-09-15T17:38:19.236578] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-15T17:38:19.301863] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-15T17:38:19.657880] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-09-15T17:38:20.457866] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-09-15T17:38:21.018541] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-15T17:38:21.196181] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-15T17:38:21.257887] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-09-15T17:38:22.057901] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-09-15T17:38:22.190119] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-15T17:38:22.777366] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-15T17:38:22.857893] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-09-15T17:38:23.435781] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-15T17:38:23.657880] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-09-15T17:38:24.457885] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-09-15T17:38:25.257895] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-09-15T17:38:25.310993] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-15T17:38:25.402506] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-15T17:38:25.742509] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-15T17:38:26.057887] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-09-15T17:38:26.457735] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-15T17:38:26.857938] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-09-15T17:38:27.657920] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-09-15T17:38:28.195591] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-15T17:38:28.201728] [INFO ] [REMOTE ] BWA: Full fetch complete (56854 records). [2025-09-15T17:38:28.201899] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-09-15T17:38:28.313350] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-15T17:38:28.331734] [INFO ] [REMOTE ] BWMX: Full fetch complete (7830 records). [2025-09-15T17:38:28.342311] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-09-15T17:38:28.372339] [FATAL] [VALIDATOR ] BWMX: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:38:28.402551] [FATAL] [MAIN ] BWMX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:38:28.463188] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-09-15T17:38:28.463409] [WARN ] [MAIN ] BWMX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:38:28.463851] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-09-15T17:38:28.477178] [DEBUG] [LOCAL ] BWMX: No primary data file found to delete. [2025-09-15T17:38:28.503235] [INFO ] [LOCAL ] BWMX: Starting deletion of derivative data. [2025-09-15T17:38:28.525312] [DEBUG] [LOCAL ] BWMX: Deleted derivative data file. [2025-09-15T17:38:28.535910] [INFO ] [MAIN ] Update Progress: 367/2369 symbols completed. BWMX took 31.5s. Estimated remaining: 3h 29m 35s. Rate: 9.6 symbols/min [2025-09-15T17:38:28.734928] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-09-15T17:38:28.740136] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-09-15T17:38:28.745946] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-09-15T17:38:28.761506] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-09-15T17:38:28.791199] [DEBUG] [LOCAL ] BWA: Trimmed 56854 records to 38415 (keeping 150 days of data) [2025-09-15T17:38:28.792613] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:38:28.942305] [DEBUG] [LOCAL ] BWXT: Loaded 35100 existing records from primary storage. [2025-09-15T17:38:28.942456] [INFO ] [MAIN ] BWXT: Loaded 35100 existing records. [2025-09-15T17:38:29.205700] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:38:29.207133] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-09-15T17:38:29.207736] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-09-15T17:38:29.209481] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-09-15T17:38:29.209778] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-09-15T17:38:29.264265] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-09-15T17:38:29.519541] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-15T17:38:29.605016] [DEBUG] [LOCAL ] BWA: Primary data saved (38415 records). [2025-09-15T17:38:29.610720] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:38:29.610904] [INFO ] [MAIN ] BWA: Full history saved. [2025-09-15T17:38:29.612151] [INFO ] [MAIN ] Update Progress: 368/2369 symbols completed. BWA took 37.2s. Estimated remaining: 3h 29m 0s. Rate: 9.6 symbols/min [2025-09-15T17:38:29.780896] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:38:29.824162] [DEBUG] [LOCAL ] BX: Loaded 40257 existing records from primary storage. [2025-09-15T17:38:29.824314] [INFO ] [MAIN ] BX: Loaded 40257 existing records. [2025-09-15T17:38:30.010291] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:38:30.015421] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-09-15T17:38:30.015345] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-15T17:38:30.015603] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-09-15T17:38:30.018377] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-09-15T17:38:30.018439] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-09-15T17:38:30.062941] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-09-15T17:38:30.382015] [INFO ] [REMOTE ] BX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:38:30.857882] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-09-15T17:38:31.580966] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-15T17:38:31.657873] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-09-15T17:38:32.457936] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-09-15T17:38:32.557817] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T17:38:32.742419] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-15T17:38:32.888721] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-15T17:38:32.889756] [INFO ] [REMOTE ] BWNB: Full fetch complete (4794 records). [2025-09-15T17:38:32.889825] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-09-15T17:38:33.242071] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-09-15T17:38:33.242147] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-09-15T17:38:33.242273] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-09-15T17:38:33.242312] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-09-15T17:38:33.242701] [DEBUG] [LOCAL ] BWNB: Trimmed 4794 records to 3439 (keeping 150 days of data) [2025-09-15T17:38:33.258809] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-09-15T17:38:33.265149] [DEBUG] [LOCAL ] BWNB: Primary data saved (3439 records). [2025-09-15T17:38:33.265222] [INFO ] [MAIN ] BWNB: Full history saved. [2025-09-15T17:38:33.265298] [INFO ] [MAIN ] Update Progress: 369/2369 symbols completed. BWNB took 21.1s. Estimated remaining: 3h 28m 40s. Rate: 9.6 symbols/min [2025-09-15T17:38:33.442123] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:38:33.453607] [DEBUG] [LOCAL ] BXC: Loaded 10237 existing records from primary storage. [2025-09-15T17:38:33.453759] [INFO ] [MAIN ] BXC: Loaded 10237 existing records. [2025-09-15T17:38:33.629239] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:38:33.629506] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-09-15T17:38:33.629556] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-09-15T17:38:33.629918] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-09-15T17:38:33.629969] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-09-15T17:38:33.981992] [INFO ] [REMOTE ] BXC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:38:34.057865] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-09-15T17:38:34.857857] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-09-15T17:38:34.908242] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-15T17:38:35.350892] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-15T17:38:35.657908] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-09-15T17:38:36.296339] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-15T17:38:36.457902] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-09-15T17:38:36.836344] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-15T17:38:37.257837] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-09-15T17:38:37.304349] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T17:38:38.057881] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-09-15T17:38:38.364374] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-15T17:38:38.857875] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-09-15T17:38:39.014912] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-15T17:38:39.587028] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T17:38:39.657891] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-09-15T17:38:40.199122] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-15T17:38:40.200097] [INFO ] [REMOTE ] BWSN: Full fetch complete (5354 records). [2025-09-15T17:38:40.200163] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-09-15T17:38:40.463280] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-09-15T17:38:40.556738] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-09-15T17:38:40.556822] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-09-15T17:38:40.556966] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-09-15T17:38:40.557004] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-09-15T17:38:40.557378] [DEBUG] [LOCAL ] BWSN: Trimmed 5354 records to 4084 (keeping 150 days of data) [2025-09-15T17:38:40.581962] [DEBUG] [LOCAL ] BWSN: Primary data saved (4084 records). [2025-09-15T17:38:40.582043] [INFO ] [MAIN ] BWSN: Full history saved. [2025-09-15T17:38:40.582133] [INFO ] [MAIN ] Update Progress: 370/2369 symbols completed. BWSN took 25.8s. Estimated remaining: 3h 28m 39s. Rate: 9.6 symbols/min [2025-09-15T17:38:40.749708] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:38:40.783267] [DEBUG] [LOCAL ] BXMT: Loaded 34780 existing records from primary storage. [2025-09-15T17:38:40.783452] [INFO ] [MAIN ] BXMT: Loaded 34780 existing records. [2025-09-15T17:38:40.962533] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:38:40.962824] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-09-15T17:38:40.962870] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-09-15T17:38:40.963587] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-09-15T17:38:40.963668] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-09-15T17:38:41.263044] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-09-15T17:38:41.315154] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:38:42.057876] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-09-15T17:38:42.312516] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-15T17:38:42.554087] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-15T17:38:42.857895] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-09-15T17:38:43.290951] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-15T17:38:43.657867] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-09-15T17:38:44.457921] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-09-15T17:38:44.517884] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-15T17:38:45.253693] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-15T17:38:45.257818] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-09-15T17:38:45.349191] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T17:38:46.032465] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-15T17:38:46.057816] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-09-15T17:38:46.823888] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-15T17:38:46.857871] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-09-15T17:38:47.657885] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-09-15T17:38:48.259829] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T17:38:48.457885] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-09-15T17:38:49.257943] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-09-15T17:38:49.473174] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-15T17:38:49.662202] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-15T17:38:49.770709] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-15T17:38:50.057892] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-09-15T17:38:50.620787] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-15T17:38:50.857891] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-09-15T17:38:51.489018] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-15T17:38:51.490849] [INFO ] [REMOTE ] BXC: Full fetch complete (14603 records). [2025-09-15T17:38:51.490939] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-09-15T17:38:51.665016] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-09-15T17:38:51.854264] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-09-15T17:38:51.854342] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-09-15T17:38:51.854687] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-09-15T17:38:51.854761] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-09-15T17:38:51.855272] [DEBUG] [LOCAL ] BXC: Trimmed 14603 records to 10082 (keeping 150 days of data) [2025-09-15T17:38:51.916132] [DEBUG] [LOCAL ] BXC: Primary data saved (10082 records). [2025-09-15T17:38:51.916278] [INFO ] [MAIN ] BXC: Full history saved. [2025-09-15T17:38:51.916365] [INFO ] [MAIN ] Update Progress: 371/2369 symbols completed. BXC took 18.7s. Estimated remaining: 3h 29m 0s. Rate: 9.6 symbols/min [2025-09-15T17:38:52.083860] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:38:52.098506] [DEBUG] [LOCAL ] BXMX: Loaded 13751 existing records from primary storage. [2025-09-15T17:38:52.098627] [INFO ] [MAIN ] BXMX: Loaded 13751 existing records. [2025-09-15T17:38:52.277773] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:38:52.278017] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-09-15T17:38:52.278064] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-09-15T17:38:52.278535] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-09-15T17:38:52.278583] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-09-15T17:38:52.464035] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-09-15T17:38:52.628033] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:38:53.257879] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-09-15T17:38:53.376823] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-15T17:38:53.817042] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T17:38:53.822979] [INFO ] [REMOTE ] BWXT: Full fetch complete (50766 records). [2025-09-15T17:38:53.823102] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-09-15T17:38:54.063064] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-09-15T17:38:54.217282] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-15T17:38:54.217425] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-09-15T17:38:54.221977] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-09-15T17:38:54.222686] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-09-15T17:38:54.222752] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-09-15T17:38:54.223954] [DEBUG] [LOCAL ] BWXT: Trimmed 50766 records to 34580 (keeping 150 days of data) [2025-09-15T17:38:54.449494] [DEBUG] [LOCAL ] BWXT: Primary data saved (34580 records). [2025-09-15T17:38:54.449652] [INFO ] [MAIN ] BWXT: Full history saved. [2025-09-15T17:38:54.449742] [INFO ] [MAIN ] Update Progress: 372/2369 symbols completed. BWXT took 25.9s. Estimated remaining: 3h 28m 34s. Rate: 9.6 symbols/min [2025-09-15T17:38:54.616448] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:38:54.654575] [DEBUG] [LOCAL ] BXP: Loaded 37306 existing records from primary storage. [2025-09-15T17:38:54.654761] [INFO ] [MAIN ] BXP: Loaded 37306 existing records. [2025-09-15T17:38:54.827975] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:38:54.828263] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-09-15T17:38:54.828329] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-09-15T17:38:54.829218] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-09-15T17:38:54.829286] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-09-15T17:38:54.862959] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-09-15T17:38:55.188694] [INFO ] [REMOTE ] BXP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:38:55.657853] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-09-15T17:38:55.715894] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T17:38:56.457839] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-09-15T17:38:56.620755] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-15T17:38:56.778575] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-15T17:38:57.257883] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-09-15T17:38:57.680287] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-15T17:38:58.057820] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-09-15T17:38:58.388212] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-15T17:38:58.857895] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-09-15T17:38:59.531781] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T17:38:59.657859] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-09-15T17:38:59.689163] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-15T17:39:00.457871] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-09-15T17:39:01.125706] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-15T17:39:01.257874] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-09-15T17:39:01.591010] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-15T17:39:02.057912] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-09-15T17:39:02.321123] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T17:39:02.857889] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-09-15T17:39:03.654671] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-15T17:39:03.664453] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-09-15T17:39:04.457889] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-09-15T17:39:04.572122] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-15T17:39:04.578377] [INFO ] [REMOTE ] BX: Full fetch complete (58173 records). [2025-09-15T17:39:04.578539] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-09-15T17:39:04.969519] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-09-15T17:39:04.969602] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-09-15T17:39:04.970309] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-09-15T17:39:04.970356] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-09-15T17:39:04.971511] [DEBUG] [LOCAL ] BX: Trimmed 58173 records to 39477 (keeping 150 days of data) [2025-09-15T17:39:05.115063] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-15T17:39:05.121857] [INFO ] [REMOTE ] BXMT: Full fetch complete (51749 records). [2025-09-15T17:39:05.122819] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-09-15T17:39:05.272671] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-09-15T17:39:05.472527] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-15T17:39:05.637575] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-09-15T17:39:05.638152] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-09-15T17:39:05.639277] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-09-15T17:39:05.640303] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-09-15T17:39:05.645412] [DEBUG] [LOCAL ] BXMT: Trimmed 51749 records to 33962 (keeping 150 days of data) [2025-09-15T17:39:05.761958] [DEBUG] [LOCAL ] BX: Primary data saved (39477 records). [2025-09-15T17:39:05.762663] [INFO ] [MAIN ] BX: Full history saved. [2025-09-15T17:39:05.764011] [INFO ] [MAIN ] Update Progress: 373/2369 symbols completed. BX took 36.2s. Estimated remaining: 3h 28m 55s. Rate: 9.6 symbols/min [2025-09-15T17:39:05.947308] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:39:06.053480] [DEBUG] [LOCAL ] BXMT: Primary data saved (33962 records). [2025-09-15T17:39:06.053670] [INFO ] [MAIN ] BXMT: Full history saved. [2025-09-15T17:39:06.053935] [INFO ] [MAIN ] Update Progress: 374/2369 symbols completed. BXMT took 25.5s. Estimated remaining: 3h 28m 17s. Rate: 9.6 symbols/min [2025-09-15T17:39:06.075841] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-09-15T17:39:06.129738] [DEBUG] [LOCAL ] BXSL: Loaded 35067 existing records from primary storage. [2025-09-15T17:39:06.146191] [INFO ] [MAIN ] BXSL: Loaded 35067 existing records. [2025-09-15T17:39:06.340409] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:39:06.452870] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:39:06.453126] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-09-15T17:39:06.453175] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-09-15T17:39:06.453947] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-09-15T17:39:06.453998] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-09-15T17:39:06.557375] [DEBUG] [LOCAL ] BY: Loaded 16124 existing records from primary storage. [2025-09-15T17:39:06.560663] [INFO ] [MAIN ] BY: Loaded 16124 existing records. [2025-09-15T17:39:06.915586] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:39:06.942104] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-09-15T17:39:06.976514] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-09-15T17:39:07.004799] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:39:07.016968] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-09-15T17:39:07.016575] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-09-15T17:39:07.018189] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T17:39:07.019318] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-09-15T17:39:07.319921] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-15T17:39:07.437172] [INFO ] [REMOTE ] BY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:39:07.657871] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-09-15T17:39:08.308318] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-15T17:39:08.457919] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-09-15T17:39:08.801541] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-15T17:39:09.257939] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-09-15T17:39:09.936762] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-15T17:39:10.057941] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-09-15T17:39:10.212574] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-15T17:39:10.857913] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-09-15T17:39:11.018424] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-15T17:39:11.657886] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-09-15T17:39:12.457937] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-09-15T17:39:12.539380] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-15T17:39:12.542370] [INFO ] [REMOTE ] BXMX: Full fetch complete (21311 records). [2025-09-15T17:39:12.542455] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-09-15T17:39:12.896017] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-15T17:39:12.963995] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-09-15T17:39:12.964077] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-09-15T17:39:12.964548] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-09-15T17:39:12.964610] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-09-15T17:39:12.965243] [DEBUG] [LOCAL ] BXMX: Trimmed 21311 records to 13325 (keeping 150 days of data) [2025-09-15T17:39:13.052896] [DEBUG] [LOCAL ] BXMX: Primary data saved (13325 records). [2025-09-15T17:39:13.053063] [INFO ] [MAIN ] BXMX: Full history saved. [2025-09-15T17:39:13.053175] [INFO ] [MAIN ] Update Progress: 375/2369 symbols completed. BXMX took 21.1s. Estimated remaining: 3h 28m 14s. Rate: 9.6 symbols/min [2025-09-15T17:39:13.232503] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:39:13.265929] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-09-15T17:39:13.267927] [DEBUG] [LOCAL ] BYD: Loaded 33858 existing records from primary storage. [2025-09-15T17:39:13.268774] [INFO ] [MAIN ] BYD: Loaded 33858 existing records. [2025-09-15T17:39:13.455919] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:39:13.456215] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-09-15T17:39:13.456379] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-09-15T17:39:13.462303] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-09-15T17:39:13.471273] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-09-15T17:39:13.477593] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-15T17:39:13.842165] [INFO ] [REMOTE ] BYD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:39:14.057905] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-09-15T17:39:14.656415] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-15T17:39:14.857886] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-09-15T17:39:15.015557] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-15T17:39:15.657855] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-09-15T17:39:15.744262] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-15T17:39:16.457916] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-09-15T17:39:17.257885] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-09-15T17:39:17.318941] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-15T17:39:17.355238] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-15T17:39:18.057891] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-09-15T17:39:18.664337] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T17:39:18.857922] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-09-15T17:39:19.504934] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-15T17:39:19.657870] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-09-15T17:39:19.822719] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T17:39:20.457914] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-09-15T17:39:20.925111] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T17:39:20.931073] [INFO ] [REMOTE ] BXP: Full fetch complete (54118 records). [2025-09-15T17:39:20.931184] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-09-15T17:39:21.264335] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-09-15T17:39:21.318563] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-09-15T17:39:21.318671] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-09-15T17:39:21.319326] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-09-15T17:39:21.319370] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-09-15T17:39:21.320663] [DEBUG] [LOCAL ] BXP: Trimmed 54118 records to 36565 (keeping 150 days of data) [2025-09-15T17:39:21.553515] [DEBUG] [LOCAL ] BXP: Primary data saved (36565 records). [2025-09-15T17:39:21.553756] [INFO ] [MAIN ] BXP: Full history saved. [2025-09-15T17:39:21.555133] [INFO ] [MAIN ] Update Progress: 376/2369 symbols completed. BXP took 27.1s. Estimated remaining: 3h 28m 20s. Rate: 9.6 symbols/min [2025-09-15T17:39:21.725478] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:39:21.771428] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T17:39:21.771781] [DEBUG] [LOCAL ] BYM: Loaded 8535 existing records from primary storage. [2025-09-15T17:39:21.785905] [INFO ] [MAIN ] BYM: Loaded 8535 existing records. [2025-09-15T17:39:21.965822] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:39:21.966108] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-09-15T17:39:21.966158] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-09-15T17:39:21.966515] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-09-15T17:39:21.966571] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-09-15T17:39:22.063755] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-09-15T17:39:22.319378] [INFO ] [REMOTE ] BYM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:39:22.610813] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T17:39:22.615005] [INFO ] [REMOTE ] BY: Full fetch complete (22517 records). [2025-09-15T17:39:22.615102] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-09-15T17:39:22.869795] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-09-15T17:39:23.009852] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-09-15T17:39:23.009940] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-09-15T17:39:23.010374] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-09-15T17:39:23.010415] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-09-15T17:39:23.011057] [DEBUG] [LOCAL ] BY: Trimmed 22517 records to 15598 (keeping 150 days of data) [2025-09-15T17:39:23.111691] [DEBUG] [LOCAL ] BY: Primary data saved (15598 records). [2025-09-15T17:39:23.111857] [INFO ] [MAIN ] BY: Full history saved. [2025-09-15T17:39:23.111962] [INFO ] [MAIN ] Update Progress: 377/2369 symbols completed. BY took 17.0s. Estimated remaining: 3h 27m 49s. Rate: 9.6 symbols/min [2025-09-15T17:39:23.286875] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:39:23.310559] [DEBUG] [LOCAL ] BZH: Loaded 24562 existing records from primary storage. [2025-09-15T17:39:23.310758] [INFO ] [MAIN ] BZH: Loaded 24562 existing records. [2025-09-15T17:39:23.499383] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:39:23.499685] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-09-15T17:39:23.499748] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-09-15T17:39:23.500322] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-09-15T17:39:23.500373] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-09-15T17:39:23.660959] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-09-15T17:39:23.865390] [INFO ] [REMOTE ] BZH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:39:23.908921] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-15T17:39:24.457835] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-09-15T17:39:24.571706] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T17:39:24.603057] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T17:39:25.257930] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-09-15T17:39:25.798276] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-15T17:39:26.057924] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-09-15T17:39:26.808892] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T17:39:26.857817] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-09-15T17:39:27.108273] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-15T17:39:27.657871] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-09-15T17:39:28.296145] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T17:39:28.457867] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-09-15T17:39:29.076811] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T17:39:29.257890] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-09-15T17:39:29.789002] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-15T17:39:29.822466] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-15T17:39:30.057898] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-09-15T17:39:30.857944] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-09-15T17:39:31.071555] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-15T17:39:31.657869] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-09-15T17:39:32.357122] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-15T17:39:32.424344] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-15T17:39:32.457894] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-09-15T17:39:33.210432] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-15T17:39:33.257846] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-09-15T17:39:34.057874] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-09-15T17:39:34.660416] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-15T17:39:34.665245] [INFO ] [REMOTE ] BYD: Full fetch complete (49237 records). [2025-09-15T17:39:34.665330] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-09-15T17:39:34.794868] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-15T17:39:34.867036] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-09-15T17:39:35.056229] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-09-15T17:39:35.056329] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-09-15T17:39:35.056968] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-09-15T17:39:35.057014] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-09-15T17:39:35.058264] [DEBUG] [LOCAL ] BYD: Trimmed 49237 records to 33316 (keeping 150 days of data) [2025-09-15T17:39:35.260965] [DEBUG] [LOCAL ] BYD: Primary data saved (33316 records). [2025-09-15T17:39:35.261104] [INFO ] [MAIN ] BYD: Full history saved. [2025-09-15T17:39:35.261694] [INFO ] [MAIN ] Update Progress: 378/2369 symbols completed. BYD took 22.2s. Estimated remaining: 3h 28m 13s. Rate: 9.6 symbols/min [2025-09-15T17:39:35.429807] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:39:35.435754] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-15T17:39:35.477046] [DEBUG] [LOCAL ] C: Loaded 40482 existing records from primary storage. [2025-09-15T17:39:35.477182] [INFO ] [MAIN ] C: Loaded 40482 existing records. [2025-09-15T17:39:35.654518] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:39:35.654915] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-09-15T17:39:35.654970] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-09-15T17:39:35.655819] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-09-15T17:39:35.655872] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-09-15T17:39:35.666624] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-09-15T17:39:36.008414] [INFO ] [REMOTE ] C: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:39:36.457919] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-09-15T17:39:36.524058] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-15T17:39:36.526667] [INFO ] [REMOTE ] BYM: Full fetch complete (13073 records). [2025-09-15T17:39:36.526747] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-09-15T17:39:36.898523] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-09-15T17:39:36.898701] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-09-15T17:39:36.899155] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-09-15T17:39:36.899214] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-09-15T17:39:36.900334] [DEBUG] [LOCAL ] BYM: Trimmed 13073 records to 8410 (keeping 150 days of data) [2025-09-15T17:39:36.955968] [DEBUG] [LOCAL ] BYM: Primary data saved (8410 records). [2025-09-15T17:39:36.956116] [INFO ] [MAIN ] BYM: Full history saved. [2025-09-15T17:39:36.956220] [INFO ] [MAIN ] Update Progress: 379/2369 symbols completed. BYM took 15.4s. Estimated remaining: 3h 27m 43s. Rate: 9.6 symbols/min [2025-09-15T17:39:37.123944] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:39:37.140478] [DEBUG] [LOCAL ] CAAP: Loaded 13531 existing records from primary storage. [2025-09-15T17:39:37.140610] [INFO ] [MAIN ] CAAP: Loaded 13531 existing records. [2025-09-15T17:39:37.263039] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-09-15T17:39:37.317015] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:39:37.317210] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-09-15T17:39:37.317261] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-09-15T17:39:37.317752] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-09-15T17:39:37.317804] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-09-15T17:39:37.664982] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:39:38.057859] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-09-15T17:39:38.352393] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-15T17:39:38.547101] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T17:39:38.715502] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-15T17:39:38.857862] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-09-15T17:39:39.657880] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-09-15T17:39:39.674569] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-15T17:39:40.457878] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-09-15T17:39:41.082849] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-15T17:39:41.257861] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-09-15T17:39:42.057862] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-09-15T17:39:42.151992] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T17:39:42.593994] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-15T17:39:42.857937] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-09-15T17:39:43.406213] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-15T17:39:43.657859] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-09-15T17:39:44.457896] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-09-15T17:39:44.766634] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-15T17:39:44.996141] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-15T17:39:45.257928] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-09-15T17:39:45.448592] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-15T17:39:46.057930] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-09-15T17:39:46.857859] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-09-15T17:39:46.918401] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T17:39:47.001565] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-15T17:39:47.591633] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-15T17:39:47.657849] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-09-15T17:39:48.208123] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-15T17:39:48.457904] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-09-15T17:39:49.257881] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-09-15T17:39:49.430986] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-15T17:39:50.057873] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-09-15T17:39:50.857891] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-09-15T17:39:50.980433] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-15T17:39:51.017699] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T17:39:51.657884] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-09-15T17:39:52.043948] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-15T17:39:52.457922] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-09-15T17:39:53.076288] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-15T17:39:53.082824] [INFO ] [REMOTE ] BXSL: Full fetch complete (51480 records). [2025-09-15T17:39:53.083191] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-09-15T17:39:53.268362] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-09-15T17:39:53.493155] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-09-15T17:39:53.493254] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-09-15T17:39:53.493970] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-09-15T17:39:53.494023] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-09-15T17:39:53.495358] [DEBUG] [LOCAL ] BXSL: Trimmed 51480 records to 34368 (keeping 150 days of data) [2025-09-15T17:39:53.722189] [DEBUG] [LOCAL ] BXSL: Primary data saved (34368 records). [2025-09-15T17:39:53.722352] [INFO ] [MAIN ] BXSL: Full history saved. [2025-09-15T17:39:53.723416] [INFO ] [MAIN ] Update Progress: 380/2369 symbols completed. BXSL took 48.0s. Estimated remaining: 3h 28m 32s. Rate: 9.5 symbols/min [2025-09-15T17:39:53.895065] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:39:53.912288] [DEBUG] [LOCAL ] CABO: Loaded 13907 existing records from primary storage. [2025-09-15T17:39:53.912419] [INFO ] [MAIN ] CABO: Loaded 13907 existing records. [2025-09-15T17:39:54.064469] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-09-15T17:39:54.094190] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:39:54.095895] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-09-15T17:39:54.095957] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-09-15T17:39:54.096512] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-09-15T17:39:54.096565] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-09-15T17:39:54.453506] [INFO ] [REMOTE ] CABO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:39:54.480371] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T17:39:54.802109] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-15T17:39:54.857880] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-09-15T17:39:54.967884] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T17:39:54.971036] [INFO ] [REMOTE ] CAAP: Full fetch complete (20168 records). [2025-09-15T17:39:54.971131] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-09-15T17:39:55.340885] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-09-15T17:39:55.340994] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-09-15T17:39:55.341579] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-09-15T17:39:55.341634] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-09-15T17:39:55.342497] [DEBUG] [LOCAL ] CAAP: Trimmed 20168 records to 13239 (keeping 150 days of data) [2025-09-15T17:39:55.427254] [DEBUG] [LOCAL ] CAAP: Primary data saved (13239 records). [2025-09-15T17:39:55.427486] [INFO ] [MAIN ] CAAP: Full history saved. [2025-09-15T17:39:55.427608] [INFO ] [MAIN ] Update Progress: 381/2369 symbols completed. CAAP took 18.5s. Estimated remaining: 3h 28m 2s. Rate: 9.6 symbols/min [2025-09-15T17:39:55.608578] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:39:55.622905] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T17:39:55.644755] [DEBUG] [LOCAL ] CACI: Loaded 17208 existing records from primary storage. [2025-09-15T17:39:55.644950] [INFO ] [MAIN ] CACI: Loaded 17208 existing records. [2025-09-15T17:39:55.666615] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-09-15T17:39:55.829297] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:39:55.829672] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-09-15T17:39:55.829732] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-09-15T17:39:55.830256] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-09-15T17:39:55.830305] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-09-15T17:39:56.183412] [INFO ] [REMOTE ] CACI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:39:56.457896] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-09-15T17:39:57.267999] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-09-15T17:39:57.293969] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T17:39:57.431002] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-15T17:39:58.000398] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-15T17:39:58.057872] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-09-15T17:39:58.857932] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-09-15T17:39:58.936671] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-15T17:39:59.657861] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-09-15T17:40:00.457869] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-09-15T17:40:00.628328] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-15T17:40:00.636580] [INFO ] [REMOTE ] C: Full fetch complete (58421 records). [2025-09-15T17:40:00.636752] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-09-15T17:40:01.062306] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-09-15T17:40:01.062455] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-09-15T17:40:01.063253] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-09-15T17:40:01.063312] [DEBUG] [LOCAL ] C: Saving primary data. [2025-09-15T17:40:01.064762] [DEBUG] [LOCAL ] C: Trimmed 58421 records to 39702 (keeping 150 days of data) [2025-09-15T17:40:01.182201] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T17:40:01.276547] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-09-15T17:40:01.357317] [DEBUG] [LOCAL ] C: Primary data saved (39702 records). [2025-09-15T17:40:01.357592] [INFO ] [MAIN ] C: Full history saved. [2025-09-15T17:40:01.359064] [INFO ] [MAIN ] Update Progress: 382/2369 symbols completed. C took 26.1s. Estimated remaining: 3h 27m 53s. Rate: 9.6 symbols/min [2025-09-15T17:40:01.445808] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T17:40:01.485933] [INFO ] [REMOTE ] BZH: Full fetch complete (36374 records). [2025-09-15T17:40:01.501574] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-09-15T17:40:01.619904] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:40:01.964950] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-09-15T17:40:01.966357] [DEBUG] [LOCAL ] CADE: Loaded 37014 existing records from primary storage. [2025-09-15T17:40:01.966537] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-09-15T17:40:01.966677] [INFO ] [MAIN ] CADE: Loaded 37014 existing records. [2025-09-15T17:40:01.967465] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-09-15T17:40:02.015292] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-09-15T17:40:02.062977] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-09-15T17:40:02.088770] [DEBUG] [LOCAL ] BZH: Trimmed 36374 records to 24078 (keeping 150 days of data) [2025-09-15T17:40:02.213521] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:40:02.255743] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-09-15T17:40:02.256682] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-09-15T17:40:02.259266] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-09-15T17:40:02.259987] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-09-15T17:40:02.644965] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T17:40:02.683484] [INFO ] [REMOTE ] CADE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:40:02.717951] [DEBUG] [LOCAL ] BZH: Primary data saved (24078 records). [2025-09-15T17:40:02.718120] [INFO ] [MAIN ] BZH: Full history saved. [2025-09-15T17:40:02.718235] [INFO ] [MAIN ] Update Progress: 383/2369 symbols completed. BZH took 39.6s. Estimated remaining: 3h 27m 22s. Rate: 9.6 symbols/min [2025-09-15T17:40:02.866108] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-09-15T17:40:02.898470] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:40:02.932565] [DEBUG] [LOCAL ] CAE: Loaded 28792 existing records from primary storage. [2025-09-15T17:40:02.932752] [INFO ] [MAIN ] CAE: Loaded 28792 existing records. [2025-09-15T17:40:03.116875] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:40:03.117210] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-09-15T17:40:03.117327] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-09-15T17:40:03.123328] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-09-15T17:40:03.131076] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-09-15T17:40:03.137271] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-15T17:40:03.553023] [INFO ] [REMOTE ] CAE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:40:03.657868] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-09-15T17:40:04.457935] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-09-15T17:40:04.531731] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-15T17:40:05.257858] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-09-15T17:40:05.299417] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-15T17:40:05.479628] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T17:40:06.057880] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-09-15T17:40:06.115307] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T17:40:06.857907] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-09-15T17:40:07.182519] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-15T17:40:07.657857] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-09-15T17:40:07.962974] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-15T17:40:08.457857] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-09-15T17:40:08.721070] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-15T17:40:09.257890] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-09-15T17:40:09.368755] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-15T17:40:09.967067] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-15T17:40:10.057867] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-09-15T17:40:10.857885] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-09-15T17:40:11.133244] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-15T17:40:11.657857] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-09-15T17:40:12.248940] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-15T17:40:12.328874] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-15T17:40:12.331432] [INFO ] [REMOTE ] CACI: Full fetch complete (29622 records). [2025-09-15T17:40:12.331508] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-09-15T17:40:12.472970] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-09-15T17:40:12.728320] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-09-15T17:40:12.728432] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-09-15T17:40:12.728898] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-09-15T17:40:12.728941] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-09-15T17:40:12.729664] [DEBUG] [LOCAL ] CACI: Trimmed 29622 records to 16695 (keeping 150 days of data) [2025-09-15T17:40:12.834266] [DEBUG] [LOCAL ] CACI: Primary data saved (16695 records). [2025-09-15T17:40:12.834420] [INFO ] [MAIN ] CACI: Full history saved. [2025-09-15T17:40:12.834507] [INFO ] [MAIN ] Update Progress: 384/2369 symbols completed. CACI took 17.4s. Estimated remaining: 3h 27m 35s. Rate: 9.6 symbols/min [2025-09-15T17:40:13.001381] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:40:13.005561] [DEBUG] [LOCAL ] CAF: Loaded 2328 existing records from primary storage. [2025-09-15T17:40:13.005669] [INFO ] [MAIN ] CAF: Loaded 2328 existing records. [2025-09-15T17:40:13.181577] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:40:13.181861] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-09-15T17:40:13.181908] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-09-15T17:40:13.182151] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-09-15T17:40:13.182197] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-09-15T17:40:13.263070] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-09-15T17:40:13.540269] [INFO ] [REMOTE ] CAF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:40:14.057866] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-09-15T17:40:14.099584] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-15T17:40:14.167630] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T17:40:14.169675] [INFO ] [REMOTE ] CABO: Full fetch complete (19093 records). [2025-09-15T17:40:14.169750] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-09-15T17:40:14.544784] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-09-15T17:40:14.544901] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-09-15T17:40:14.545350] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-09-15T17:40:14.545399] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-09-15T17:40:14.546124] [DEBUG] [LOCAL ] CABO: Trimmed 19093 records to 13796 (keeping 150 days of data) [2025-09-15T17:40:14.636808] [DEBUG] [LOCAL ] CABO: Primary data saved (13796 records). [2025-09-15T17:40:14.636965] [INFO ] [MAIN ] CABO: Full history saved. [2025-09-15T17:40:14.637056] [INFO ] [MAIN ] Update Progress: 385/2369 symbols completed. CABO took 20.9s. Estimated remaining: 3h 27m 6s. Rate: 9.6 symbols/min [2025-09-15T17:40:14.815019] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:40:14.859907] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-09-15T17:40:14.861633] [DEBUG] [LOCAL ] CAG: Loaded 40406 existing records from primary storage. [2025-09-15T17:40:14.861752] [INFO ] [MAIN ] CAG: Loaded 40406 existing records. [2025-09-15T17:40:15.058718] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:40:15.059662] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-09-15T17:40:15.059720] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-09-15T17:40:15.061027] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-09-15T17:40:15.061085] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-09-15T17:40:15.453163] [INFO ] [REMOTE ] CAG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:40:15.657901] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-09-15T17:40:16.335187] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-15T17:40:16.460907] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-09-15T17:40:16.463573] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-15T17:40:17.257878] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-09-15T17:40:17.908894] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T17:40:18.064691] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-09-15T17:40:18.067012] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (4.01 seconds). [2025-09-15T17:40:18.386708] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-15T17:40:18.857876] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-09-15T17:40:19.657864] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-09-15T17:40:19.725409] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-15T17:40:20.233249] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T17:40:20.457844] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-09-15T17:40:21.003488] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-15T17:40:21.257846] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-09-15T17:40:21.330108] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-15T17:40:21.595637] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-15T17:40:22.057921] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-09-15T17:40:22.465398] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-15T17:40:22.857954] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-09-15T17:40:23.657944] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-09-15T17:40:24.140022] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T17:40:24.274303] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-15T17:40:24.457900] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-09-15T17:40:25.257905] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-09-15T17:40:25.796628] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-15T17:40:25.860502] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T17:40:26.057866] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-09-15T17:40:26.857936] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-09-15T17:40:27.455766] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T17:40:27.657873] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-09-15T17:40:28.457872] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-09-15T17:40:28.536360] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-15T17:40:28.541929] [INFO ] [REMOTE ] CADE: Full fetch complete (52696 records). [2025-09-15T17:40:28.542034] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-09-15T17:40:28.918718] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-09-15T17:40:28.918818] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-09-15T17:40:28.919520] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-09-15T17:40:28.919567] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-09-15T17:40:28.920874] [DEBUG] [LOCAL ] CADE: Trimmed 52696 records to 36349 (keeping 150 days of data) [2025-09-15T17:40:29.151294] [DEBUG] [LOCAL ] CADE: Primary data saved (36349 records). [2025-09-15T17:40:29.151549] [INFO ] [MAIN ] CADE: Full history saved. [2025-09-15T17:40:29.151881] [INFO ] [MAIN ] Update Progress: 386/2369 symbols completed. CADE took 27.8s. Estimated remaining: 3h 27m 42s. Rate: 9.5 symbols/min [2025-09-15T17:40:29.259737] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-09-15T17:40:29.353058] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:40:29.407777] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-15T17:40:29.433271] [DEBUG] [LOCAL ] CAH: Loaded 38710 existing records from primary storage. [2025-09-15T17:40:29.433427] [INFO ] [MAIN ] CAH: Loaded 38710 existing records. [2025-09-15T17:40:29.611178] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:40:29.611413] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-09-15T17:40:29.611459] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-09-15T17:40:29.612343] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-09-15T17:40:29.612392] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-09-15T17:40:29.879475] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-15T17:40:29.981153] [INFO ] [REMOTE ] CAH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:40:30.005110] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T17:40:30.057837] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-09-15T17:40:30.857882] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-09-15T17:40:31.183531] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-15T17:40:31.183857] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-15T17:40:31.190439] [INFO ] [REMOTE ] CAE: Full fetch complete (42467 records). [2025-09-15T17:40:31.190565] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-09-15T17:40:31.585791] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-09-15T17:40:31.585886] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-09-15T17:40:31.586465] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-09-15T17:40:31.586510] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-09-15T17:40:31.587622] [DEBUG] [LOCAL ] CAE: Trimmed 42467 records to 28270 (keeping 150 days of data) [2025-09-15T17:40:31.673688] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-09-15T17:40:31.772384] [DEBUG] [LOCAL ] CAE: Primary data saved (28270 records). [2025-09-15T17:40:31.772557] [INFO ] [MAIN ] CAE: Full history saved. [2025-09-15T17:40:31.772680] [INFO ] [MAIN ] Update Progress: 387/2369 symbols completed. CAE took 29.1s. Estimated remaining: 3h 27m 17s. Rate: 9.6 symbols/min [2025-09-15T17:40:31.955305] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:40:31.991303] [DEBUG] [LOCAL ] CAL: Loaded 32070 existing records from primary storage. [2025-09-15T17:40:31.991486] [INFO ] [MAIN ] CAL: Loaded 32070 existing records. [2025-09-15T17:40:32.168893] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:40:32.169143] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-09-15T17:40:32.169190] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-09-15T17:40:32.169893] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-09-15T17:40:32.169941] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-09-15T17:40:32.463127] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-09-15T17:40:32.536014] [INFO ] [REMOTE ] CAL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:40:33.126846] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T17:40:33.257888] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-09-15T17:40:33.907313] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-15T17:40:34.057858] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-09-15T17:40:34.739141] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-15T17:40:34.857914] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-09-15T17:40:35.577110] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T17:40:35.657888] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-09-15T17:40:36.149536] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-15T17:40:36.272945] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T17:40:36.273925] [INFO ] [REMOTE ] CAF: Full fetch complete (3939 records). [2025-09-15T17:40:36.273994] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-09-15T17:40:36.465401] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-09-15T17:40:36.641193] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-09-15T17:40:36.641301] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-09-15T17:40:36.641452] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-09-15T17:40:36.641493] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-09-15T17:40:36.641998] [DEBUG] [LOCAL ] CAF: Trimmed 3939 records to 2269 (keeping 150 days of data) [2025-09-15T17:40:36.657116] [DEBUG] [LOCAL ] CAF: Primary data saved (2269 records). [2025-09-15T17:40:36.657190] [INFO ] [MAIN ] CAF: Full history saved. [2025-09-15T17:40:36.657289] [INFO ] [MAIN ] Update Progress: 388/2369 symbols completed. CAF took 23.8s. Estimated remaining: 3h 27m 4s. Rate: 9.6 symbols/min [2025-09-15T17:40:36.830080] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:40:36.858256] [DEBUG] [LOCAL ] CALX: Loaded 28955 existing records from primary storage. [2025-09-15T17:40:36.858399] [INFO ] [MAIN ] CALX: Loaded 28955 existing records. [2025-09-15T17:40:37.033472] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:40:37.033740] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-09-15T17:40:37.033799] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-09-15T17:40:37.034380] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-09-15T17:40:37.034444] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-09-15T17:40:37.271141] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-09-15T17:40:37.391480] [INFO ] [REMOTE ] CALX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:40:38.057891] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-09-15T17:40:38.258431] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-15T17:40:38.857882] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-09-15T17:40:39.223230] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-15T17:40:39.400167] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-15T17:40:39.657954] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-09-15T17:40:40.457938] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-09-15T17:40:40.513470] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T17:40:41.084539] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T17:40:41.257857] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-09-15T17:40:41.789999] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-15T17:40:42.057880] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-09-15T17:40:42.769754] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-15T17:40:42.857893] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-09-15T17:40:43.657932] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-09-15T17:40:43.720572] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-15T17:40:43.726444] [INFO ] [REMOTE ] CAG: Full fetch complete (58335 records). [2025-09-15T17:40:43.726563] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-09-15T17:40:44.103105] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-09-15T17:40:44.103184] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-09-15T17:40:44.103869] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-09-15T17:40:44.103923] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-09-15T17:40:44.105076] [DEBUG] [LOCAL ] CAG: Trimmed 58335 records to 39628 (keeping 150 days of data) [2025-09-15T17:40:44.353433] [DEBUG] [LOCAL ] CAG: Primary data saved (39628 records). [2025-09-15T17:40:44.353615] [INFO ] [MAIN ] CAG: Full history saved. [2025-09-15T17:40:44.354231] [INFO ] [MAIN ] Update Progress: 389/2369 symbols completed. CAG took 29.7s. Estimated remaining: 3h 27m 5s. Rate: 9.6 symbols/min [2025-09-15T17:40:44.460699] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-09-15T17:40:44.542472] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:40:44.565625] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-15T17:40:44.599367] [DEBUG] [LOCAL ] CANG: Loaded 20289 existing records from primary storage. [2025-09-15T17:40:44.599499] [INFO ] [MAIN ] CANG: Loaded 20289 existing records. [2025-09-15T17:40:44.775011] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:40:44.775341] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-09-15T17:40:44.775471] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-09-15T17:40:44.776107] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-09-15T17:40:44.776228] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-09-15T17:40:44.978473] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-15T17:40:45.165476] [INFO ] [REMOTE ] CANG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:40:45.257822] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-09-15T17:40:45.488374] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-15T17:40:46.057883] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-09-15T17:40:46.414395] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T17:40:46.857886] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-09-15T17:40:47.277083] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T17:40:47.657848] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-09-15T17:40:47.736943] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-15T17:40:48.457952] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-09-15T17:40:49.104195] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-15T17:40:49.257868] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-09-15T17:40:49.930731] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T17:40:50.057850] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-09-15T17:40:50.692531] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T17:40:50.697799] [INFO ] [REMOTE ] CAL: Full fetch complete (46959 records). [2025-09-15T17:40:50.697914] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-09-15T17:40:50.858179] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-09-15T17:40:51.114889] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-09-15T17:40:51.114977] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-09-15T17:40:51.115593] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-09-15T17:40:51.115636] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-09-15T17:40:51.116728] [DEBUG] [LOCAL ] CAL: Trimmed 46959 records to 31389 (keeping 150 days of data) [2025-09-15T17:40:51.315213] [DEBUG] [LOCAL ] CAL: Primary data saved (31389 records). [2025-09-15T17:40:51.315395] [INFO ] [MAIN ] CAL: Full history saved. [2025-09-15T17:40:51.315717] [INFO ] [MAIN ] Update Progress: 390/2369 symbols completed. CAL took 19.5s. Estimated remaining: 3h 27m 2s. Rate: 9.6 symbols/min [2025-09-15T17:40:51.487780] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:40:51.515062] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T17:40:51.527821] [DEBUG] [LOCAL ] CAPL: Loaded 3919 existing records from primary storage. [2025-09-15T17:40:51.528635] [INFO ] [MAIN ] CAPL: Loaded 3919 existing records. [2025-09-15T17:40:51.668760] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-09-15T17:40:51.706954] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:40:51.707211] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-09-15T17:40:51.707257] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-09-15T17:40:51.707532] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-09-15T17:40:51.707577] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-09-15T17:40:52.068315] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:40:52.080983] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-15T17:40:52.457885] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-09-15T17:40:52.879162] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-15T17:40:52.999756] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-15T17:40:53.257878] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-09-15T17:40:54.057879] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-09-15T17:40:54.560797] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-15T17:40:54.857876] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-09-15T17:40:55.271929] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T17:40:55.565899] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-15T17:40:55.657864] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-09-15T17:40:56.457885] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-09-15T17:40:56.786189] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-15T17:40:57.160636] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-15T17:40:57.257817] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-09-15T17:40:57.665949] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-15T17:40:58.057869] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-09-15T17:40:58.550254] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-15T17:40:58.857881] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-09-15T17:40:59.657867] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-09-15T17:41:00.102996] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-15T17:41:00.108689] [INFO ] [REMOTE ] CAH: Full fetch complete (56139 records). [2025-09-15T17:41:00.108824] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-09-15T17:41:00.470477] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-09-15T17:41:00.489986] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-09-15T17:41:00.490068] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-09-15T17:41:00.490877] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-09-15T17:41:00.491032] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-09-15T17:41:00.507354] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-15T17:41:00.512798] [DEBUG] [LOCAL ] CAH: Trimmed 56139 records to 37932 (keeping 150 days of data) [2025-09-15T17:41:00.759821] [DEBUG] [LOCAL ] CAH: Primary data saved (37932 records). [2025-09-15T17:41:00.760001] [INFO ] [MAIN ] CAH: Full history saved. [2025-09-15T17:41:00.760729] [INFO ] [MAIN ] Update Progress: 391/2369 symbols completed. CAH took 31.6s. Estimated remaining: 3h 27m 12s. Rate: 9.5 symbols/min [2025-09-15T17:41:00.931552] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:41:00.971445] [DEBUG] [LOCAL ] CARR: Loaded 40349 existing records from primary storage. [2025-09-15T17:41:00.971596] [INFO ] [MAIN ] CARR: Loaded 40349 existing records. [2025-09-15T17:41:01.149235] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:41:01.149550] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-09-15T17:41:01.149619] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-09-15T17:41:01.150627] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-09-15T17:41:01.150723] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-09-15T17:41:01.257856] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-09-15T17:41:01.334379] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-15T17:41:01.522457] [INFO ] [REMOTE ] CARR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:41:02.057867] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-09-15T17:41:02.773192] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-15T17:41:02.777040] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-15T17:41:02.857888] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-09-15T17:41:03.392261] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-15T17:41:03.393704] [INFO ] [REMOTE ] CAPL: Full fetch complete (6447 records). [2025-09-15T17:41:03.393828] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-09-15T17:41:03.663075] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-09-15T17:41:03.772576] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-09-15T17:41:03.772711] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-09-15T17:41:03.772953] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-09-15T17:41:03.773002] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-09-15T17:41:03.773990] [DEBUG] [LOCAL ] CAPL: Trimmed 6447 records to 3877 (keeping 150 days of data) [2025-09-15T17:41:03.798906] [DEBUG] [LOCAL ] CAPL: Primary data saved (3877 records). [2025-09-15T17:41:03.799050] [INFO ] [MAIN ] CAPL: Full history saved. [2025-09-15T17:41:03.799156] [INFO ] [MAIN ] Update Progress: 392/2369 symbols completed. CAPL took 12.5s. Estimated remaining: 3h 26m 49s. Rate: 9.6 symbols/min [2025-09-15T17:41:03.972236] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:41:04.004632] [DEBUG] [LOCAL ] CARS: Loaded 29560 existing records from primary storage. [2025-09-15T17:41:04.004806] [INFO ] [MAIN ] CARS: Loaded 29560 existing records. [2025-09-15T17:41:04.181760] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:41:04.182026] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-09-15T17:41:04.182077] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-09-15T17:41:04.182860] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-09-15T17:41:04.182922] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-09-15T17:41:04.457943] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-09-15T17:41:04.537570] [INFO ] [REMOTE ] CARS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:41:05.174846] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T17:41:05.257853] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-09-15T17:41:05.700543] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-15T17:41:06.057886] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-09-15T17:41:06.561282] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-15T17:41:06.857899] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-09-15T17:41:07.460114] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T17:41:07.657880] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-09-15T17:41:08.212271] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T17:41:08.216236] [INFO ] [REMOTE ] CANG: Full fetch complete (29085 records). [2025-09-15T17:41:08.216338] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-09-15T17:41:08.465697] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-09-15T17:41:08.589779] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-09-15T17:41:08.589861] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-09-15T17:41:08.590326] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-09-15T17:41:08.590377] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-09-15T17:41:08.591867] [DEBUG] [LOCAL ] CANG: Trimmed 29085 records to 20242 (keeping 150 days of data) [2025-09-15T17:41:08.711471] [DEBUG] [LOCAL ] CANG: Primary data saved (20242 records). [2025-09-15T17:41:08.711675] [INFO ] [MAIN ] CANG: Full history saved. [2025-09-15T17:41:08.717189] [INFO ] [MAIN ] Update Progress: 393/2369 symbols completed. CANG took 24.4s. Estimated remaining: 3h 26m 36s. Rate: 9.6 symbols/min [2025-09-15T17:41:08.796745] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-15T17:41:08.846253] [INFO ] [REMOTE ] CALX: Full fetch complete (41895 records). [2025-09-15T17:41:08.861865] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-09-15T17:41:08.906705] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:41:09.277119] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-09-15T17:41:09.303923] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-09-15T17:41:09.304023] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-09-15T17:41:09.304621] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-09-15T17:41:09.309843] [DEBUG] [LOCAL ] CAT: Loaded 39807 existing records from primary storage. [2025-09-15T17:41:09.310194] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-09-15T17:41:09.310296] [INFO ] [MAIN ] CAT: Loaded 39807 existing records. [2025-09-15T17:41:09.419948] [DEBUG] [LOCAL ] CALX: Trimmed 41895 records to 28396 (keeping 150 days of data) [2025-09-15T17:41:09.550220] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:41:09.583562] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-09-15T17:41:09.584609] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-09-15T17:41:09.587895] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-09-15T17:41:09.589292] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-09-15T17:41:10.036384] [INFO ] [REMOTE ] CAT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:41:10.047209] [DEBUG] [LOCAL ] CALX: Primary data saved (28396 records). [2025-09-15T17:41:10.057397] [INFO ] [MAIN ] CALX: Full history saved. [2025-09-15T17:41:10.057624] [INFO ] [MAIN ] Update Progress: 394/2369 symbols completed. CALX took 33.4s. Estimated remaining: 3h 26m 5s. Rate: 9.6 symbols/min [2025-09-15T17:41:10.064360] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-09-15T17:41:10.064303] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T17:41:10.247057] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:41:10.255681] [DEBUG] [LOCAL ] CATO: Loaded 5126 existing records from primary storage. [2025-09-15T17:41:10.255830] [INFO ] [MAIN ] CATO: Loaded 5126 existing records. [2025-09-15T17:41:10.432151] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:41:10.432455] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-09-15T17:41:10.432510] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-09-15T17:41:10.432767] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-09-15T17:41:10.432860] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-09-15T17:41:10.783209] [INFO ] [REMOTE ] CATO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:41:10.870088] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-09-15T17:41:10.876130] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-15T17:41:11.598088] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-15T17:41:11.657888] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-09-15T17:41:11.851069] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-15T17:41:12.457873] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-09-15T17:41:13.204088] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T17:41:13.257891] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-09-15T17:41:14.057903] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-09-15T17:41:14.441896] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-15T17:41:14.857903] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-09-15T17:41:15.023579] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-15T17:41:15.275174] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T17:41:15.498192] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-15T17:41:15.658008] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-09-15T17:41:16.457929] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-09-15T17:41:16.981434] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T17:41:17.257875] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-09-15T17:41:18.057896] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-09-15T17:41:18.626825] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-15T17:41:18.868601] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-09-15T17:41:18.877250] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-15T17:41:19.013564] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-15T17:41:19.657918] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-09-15T17:41:20.341214] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-15T17:41:20.457878] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-09-15T17:41:20.771716] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-15T17:41:20.924756] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-15T17:41:21.257919] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-09-15T17:41:22.057883] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-09-15T17:41:22.857867] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-09-15T17:41:22.943755] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T17:41:23.186727] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-15T17:41:23.657892] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-09-15T17:41:24.040081] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-15T17:41:24.209911] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T17:41:24.457945] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-09-15T17:41:25.257897] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-09-15T17:41:25.743929] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-15T17:41:26.057931] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-09-15T17:41:26.340521] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-15T17:41:26.857883] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-09-15T17:41:27.405976] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T17:41:27.657896] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-09-15T17:41:28.133038] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-15T17:41:28.457898] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-09-15T17:41:28.630676] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-15T17:41:29.257923] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-09-15T17:41:29.913221] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T17:41:29.919156] [INFO ] [REMOTE ] CARR: Full fetch complete (58279 records). [2025-09-15T17:41:29.919256] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-09-15T17:41:30.062996] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-09-15T17:41:30.306903] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-09-15T17:41:30.307000] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-09-15T17:41:30.307728] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-09-15T17:41:30.307780] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-09-15T17:41:30.309402] [DEBUG] [LOCAL ] CARR: Trimmed 58279 records to 39576 (keeping 150 days of data) [2025-09-15T17:41:30.555355] [DEBUG] [LOCAL ] CARR: Primary data saved (39576 records). [2025-09-15T17:41:30.555501] [INFO ] [MAIN ] CARR: Full history saved. [2025-09-15T17:41:30.555585] [INFO ] [MAIN ] Update Progress: 395/2369 symbols completed. CARR took 29.8s. Estimated remaining: 3h 27m 10s. Rate: 9.5 symbols/min [2025-09-15T17:41:30.725132] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:41:30.764033] [DEBUG] [LOCAL ] CAVA: Loaded 40321 existing records from primary storage. [2025-09-15T17:41:30.764177] [INFO ] [MAIN ] CAVA: Loaded 40321 existing records. [2025-09-15T17:41:30.867415] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-09-15T17:41:30.872311] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T17:41:30.896070] [INFO ] [REMOTE ] CATO: Full fetch complete (8214 records). [2025-09-15T17:41:30.933602] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-09-15T17:41:30.987372] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:41:31.059393] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-09-15T17:41:31.059570] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-09-15T17:41:31.065871] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-09-15T17:41:31.076198] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-09-15T17:41:31.612297] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-09-15T17:41:31.623783] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-09-15T17:41:31.624396] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-09-15T17:41:31.650927] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-09-15T17:41:31.706486] [DEBUG] [LOCAL ] CATO: Trimmed 8214 records to 5040 (keeping 150 days of data) [2025-09-15T17:41:31.725639] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:41:31.729845] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-09-15T17:41:31.732592] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-09-15T17:41:31.768902] [INFO ] [REMOTE ] CAT: Full fetch complete (57572 records). [2025-09-15T17:41:31.773764] [DEBUG] [LOCAL ] CATO: Primary data saved (5040 records). [2025-09-15T17:41:31.773968] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-09-15T17:41:31.774908] [INFO ] [MAIN ] CATO: Full history saved. [2025-09-15T17:41:31.775169] [INFO ] [MAIN ] Update Progress: 396/2369 symbols completed. CATO took 21.7s. Estimated remaining: 3h 26m 38s. Rate: 9.5 symbols/min [2025-09-15T17:41:32.215773] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:41:32.444408] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-09-15T17:41:32.459299] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-09-15T17:41:32.448044] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-15T17:41:32.460862] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-09-15T17:41:32.461051] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-09-15T17:41:32.471500] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-09-15T17:41:32.474343] [DEBUG] [LOCAL ] CAT: Trimmed 57572 records to 39023 (keeping 150 days of data) [2025-09-15T17:41:32.488537] [DEBUG] [LOCAL ] CB: Loaded 37384 existing records from primary storage. [2025-09-15T17:41:32.489195] [INFO ] [MAIN ] CB: Loaded 37384 existing records. [2025-09-15T17:41:32.785926] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:41:32.787246] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-09-15T17:41:32.787316] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-09-15T17:41:32.789045] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-09-15T17:41:32.789621] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-09-15T17:41:33.165977] [INFO ] [REMOTE ] CB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:41:33.278617] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-09-15T17:41:33.321772] [DEBUG] [LOCAL ] CAT: Primary data saved (39023 records). [2025-09-15T17:41:33.322019] [INFO ] [MAIN ] CAT: Full history saved. [2025-09-15T17:41:33.323223] [INFO ] [MAIN ] Update Progress: 397/2369 symbols completed. CAT took 24.6s. Estimated remaining: 3h 26m 8s. Rate: 9.6 symbols/min [2025-09-15T17:41:33.428305] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T17:41:33.553488] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-15T17:41:34.057895] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-09-15T17:41:34.849461] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-15T17:41:34.858467] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-09-15T17:41:35.000040] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-15T17:41:35.004318] [INFO ] [REMOTE ] CARS: Full fetch complete (43503 records). [2025-09-15T17:41:35.004470] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-09-15T17:41:35.378776] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-09-15T17:41:35.378869] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-09-15T17:41:35.379448] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-09-15T17:41:35.379491] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-09-15T17:41:35.380611] [DEBUG] [LOCAL ] CARS: Trimmed 43503 records to 28899 (keeping 150 days of data) [2025-09-15T17:41:35.562701] [DEBUG] [LOCAL ] CARS: Primary data saved (28899 records). [2025-09-15T17:41:35.562865] [INFO ] [MAIN ] CARS: Full history saved. [2025-09-15T17:41:35.563004] [INFO ] [MAIN ] Update Progress: 398/2369 symbols completed. CARS took 31.8s. Estimated remaining: 3h 25m 42s. Rate: 9.6 symbols/min [2025-09-15T17:41:35.657937] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-09-15T17:41:36.473157] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T17:41:36.484828] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-09-15T17:41:37.296109] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T17:41:37.306755] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-09-15T17:41:38.042368] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-15T17:41:38.057814] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-09-15T17:41:39.106246] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-15T17:41:39.117191] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-09-15T17:41:39.567708] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-15T17:41:39.657880] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-09-15T17:41:40.843624] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-15T17:41:40.853816] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-09-15T17:41:41.702247] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-15T17:41:41.713069] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-09-15T17:41:42.432938] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-15T17:41:42.443052] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-09-15T17:41:43.311658] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-15T17:41:43.323514] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-09-15T17:41:43.922100] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T17:41:43.933307] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-09-15T17:41:45.632461] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-15T17:41:45.643193] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-09-15T17:41:45.721317] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-09-15T17:41:45.733976] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-09-15T17:41:47.449695] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-15T17:41:47.454981] [INFO ] [REMOTE ] CB: Full fetch complete (53989 records). [2025-09-15T17:41:47.455081] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-09-15T17:41:47.455695] [FATAL] [VALIDATOR ] CB: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:41:47.455772] [FATAL] [MAIN ] CB: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:41:47.455827] [WARN ] [MAIN ] CB: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:41:47.455870] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-09-15T17:41:47.455930] [DEBUG] [LOCAL ] CB: No primary data file found to delete. [2025-09-15T17:41:47.455987] [INFO ] [LOCAL ] CB: Starting deletion of derivative data. [2025-09-15T17:41:47.456413] [DEBUG] [LOCAL ] CB: Deleted derivative data file. [2025-09-15T17:41:47.456512] [INFO ] [MAIN ] Update Progress: 399/2369 symbols completed. CB took 15.7s. Estimated remaining: 3h 26m 4s. Rate: 9.6 symbols/min [2025-09-15T17:41:47.662303] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-15T17:41:47.667719] [INFO ] [REMOTE ] CAVA: Full fetch complete (57804 records). [2025-09-15T17:41:47.667837] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-09-15T17:41:47.668564] [FATAL] [VALIDATOR ] CAVA: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:41:47.668661] [FATAL] [MAIN ] CAVA: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:41:47.668702] [WARN ] [MAIN ] CAVA: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:41:47.668745] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-09-15T17:41:47.668803] [DEBUG] [LOCAL ] CAVA: No primary data file found to delete. [2025-09-15T17:41:47.668838] [INFO ] [LOCAL ] CAVA: Starting deletion of derivative data. [2025-09-15T17:41:47.669080] [DEBUG] [LOCAL ] CAVA: Deleted derivative data file. [2025-09-15T17:41:47.669160] [INFO ] [MAIN ] Update Progress: 400/2369 symbols completed. CAVA took 17.1s. Estimated remaining: 3h 25m 28s. Rate: 9.6 symbols/min [2025-09-15T17:41:48.245581] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:41:48.247300] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:41:48.301629] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-09-15T17:41:48.347584] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-09-15T17:41:48.347492] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:41:48.374278] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:41:48.373391] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-09-15T17:41:48.375249] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-15T17:41:48.375332] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-15T17:41:48.375370] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-09-15T17:41:48.422708] [DEBUG] [LOCAL ] CBAN: Loaded 7543 existing records from primary storage. [2025-09-15T17:41:48.466042] [DEBUG] [LOCAL ] CBNA: Loaded 2374 existing records from primary storage. [2025-09-15T17:41:48.476722] [INFO ] [MAIN ] CBNA: Loaded 2374 existing records. [2025-09-15T17:41:48.471337] [INFO ] [MAIN ] CBAN: Loaded 7543 existing records. [2025-09-15T17:41:48.583355] [DEBUG] [LOCAL ] CBL: Loaded 12055 existing records from primary storage. [2025-09-15T17:41:48.759569] [INFO ] [MAIN ] CBL: Loaded 12055 existing records. [2025-09-15T17:41:49.021419] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:41:49.104723] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-09-15T17:41:49.170853] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-09-15T17:41:49.165361] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:41:49.191596] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-09-15T17:41:49.202206] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-09-15T17:41:49.202297] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-09-15T17:41:49.237004] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-09-15T17:41:49.274189] [INFO ] [REMOTE ] CBO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:41:49.280365] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-02. [2025-09-15T17:41:49.289593] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-09-15T17:41:49.330740] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-09-15T17:41:49.444064] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:41:49.529782] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-09-15T17:41:49.538773] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-09-15T17:41:49.611062] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-09-15T17:41:49.659382] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-09-15T17:41:49.659103] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:41:49.903691] [WARN ] [REMOTE ] CBO: No data returned for month 2025-02 [2025-09-15T17:41:49.958387] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-03. [2025-09-15T17:41:50.161431] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:41:50.204550] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-09-15T17:41:50.452344] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:41:50.461153] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-09-15T17:41:50.482492] [INFO ] [REMOTE ] CBL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:41:50.482874] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-09-15T17:41:50.543067] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-15T17:41:50.543930] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-04. [2025-09-15T17:41:50.767218] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-04 (0.22 seconds). [2025-09-15T17:41:50.857867] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-05. [2025-09-15T17:41:50.893387] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-15T17:41:50.978273] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-15T17:41:51.265593] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-15T17:41:51.553300] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-15T17:41:51.657876] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-09-15T17:41:52.285289] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-15T17:41:52.457870] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-09-15T17:41:52.830772] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-15T17:41:53.257870] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-09-15T17:41:54.057909] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-09-15T17:41:54.188221] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-15T17:41:54.499339] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-15T17:41:54.857879] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-09-15T17:41:55.440754] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-15T17:41:55.657878] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-09-15T17:41:56.050757] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-15T17:41:56.457871] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-06. [2025-09-15T17:41:56.703559] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-15T17:41:57.257870] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-07. [2025-09-15T17:41:57.473789] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-09-15T17:41:58.057885] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-09-15T17:41:58.815986] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-15T17:41:58.857886] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-09-15T17:41:59.587673] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-15T17:41:59.657874] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-09-15T17:42:00.400058] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-15T17:42:00.457875] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-09-15T17:42:00.887116] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-15T17:42:01.257874] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-09-15T17:42:01.840451] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-15T17:42:02.057863] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-09-15T17:42:02.597716] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-15T17:42:02.598612] [INFO ] [REMOTE ] CBNA: Full fetch complete (3201 records). [2025-09-15T17:42:02.598699] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-09-15T17:42:02.862938] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-09-15T17:42:02.972251] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-09-15T17:42:02.972331] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-09-15T17:42:02.972446] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-09-15T17:42:02.972485] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-09-15T17:42:02.972881] [DEBUG] [LOCAL ] CBNA: Trimmed 3201 records to 2270 (keeping 150 days of data) [2025-09-15T17:42:02.987867] [DEBUG] [LOCAL ] CBNA: Primary data saved (2270 records). [2025-09-15T17:42:02.988001] [INFO ] [MAIN ] CBNA: Full history saved. [2025-09-15T17:42:02.988103] [INFO ] [MAIN ] Update Progress: 401/2369 symbols completed. CBNA took 15.3s. Estimated remaining: 3h 26m 6s. Rate: 9.5 symbols/min [2025-09-15T17:42:03.161037] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:42:03.198350] [DEBUG] [LOCAL ] CBRE: Loaded 37804 existing records from primary storage. [2025-09-15T17:42:03.198516] [INFO ] [MAIN ] CBRE: Loaded 37804 existing records. [2025-09-15T17:42:03.372499] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:42:03.372744] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-09-15T17:42:03.372789] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-09-15T17:42:03.373527] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-09-15T17:42:03.373572] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-09-15T17:42:03.661840] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-08. [2025-09-15T17:42:03.733726] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:42:03.736604] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-15T17:42:04.125921] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:42:04.126384] [WARN ] [REMOTE ] CBO: No data returned for month 2025-08 [2025-09-15T17:42:04.457860] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-09-15T17:42:05.181952] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-15T17:42:05.257957] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-09-15T17:42:06.057837] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-09-15T17:42:06.206545] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T17:42:06.857893] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-09. [2025-09-15T17:42:06.915908] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-15T17:42:07.181027] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:42:07.181342] [WARN ] [REMOTE ] CBO: No data returned for month 2025-09 [2025-09-15T17:42:07.181429] [INFO ] [REMOTE ] CBO: Full fetch complete (1016 records). [2025-09-15T17:42:07.181491] [DEBUG] [VALIDATOR ] CBO: Validating primary data. [2025-09-15T17:42:07.182131] [FATAL] [VALIDATOR ] CBO: Data is stale - most recent date (2025-07-10) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:42:07.182202] [FATAL] [MAIN ] CBO: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:42:07.182242] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:42:07.182287] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-15T17:42:07.182347] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-15T17:42:07.182383] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-09-15T17:42:07.182447] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-09-15T17:42:07.182510] [INFO ] [MAIN ] Update Progress: 402/2369 symbols completed. CBO took 19.5s. Estimated remaining: 3h 25m 49s. Rate: 9.6 symbols/min [2025-09-15T17:42:07.349581] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:42:07.371257] [DEBUG] [LOCAL ] CBT: Loaded 23085 existing records from primary storage. [2025-09-15T17:42:07.371396] [INFO ] [MAIN ] CBT: Loaded 23085 existing records. [2025-09-15T17:42:07.551991] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:42:07.552279] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-09-15T17:42:07.552328] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-09-15T17:42:07.553049] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-09-15T17:42:07.553124] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-09-15T17:42:07.663060] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-09-15T17:42:08.027425] [INFO ] [REMOTE ] CBT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:42:08.457952] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-09-15T17:42:09.079961] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T17:42:09.257897] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-09-15T17:42:10.061471] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-09-15T17:42:10.063451] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-15T17:42:10.184725] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-15T17:42:10.676374] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-15T17:42:10.857893] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-09-15T17:42:11.657885] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-09-15T17:42:12.457888] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-09-15T17:42:12.498903] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T17:42:12.971310] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T17:42:13.257916] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-09-15T17:42:13.358353] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T17:42:13.360439] [INFO ] [REMOTE ] CBL: Full fetch complete (18646 records). [2025-09-15T17:42:13.360553] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-09-15T17:42:13.729620] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-09-15T17:42:13.729737] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-09-15T17:42:13.730138] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-09-15T17:42:13.730178] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-09-15T17:42:13.730743] [DEBUG] [LOCAL ] CBL: Trimmed 18646 records to 11888 (keeping 150 days of data) [2025-09-15T17:42:13.803415] [DEBUG] [LOCAL ] CBL: Primary data saved (11888 records). [2025-09-15T17:42:13.803553] [INFO ] [MAIN ] CBL: Full history saved. [2025-09-15T17:42:13.803655] [INFO ] [MAIN ] Update Progress: 403/2369 symbols completed. CBL took 26.1s. Estimated remaining: 3h 25m 45s. Rate: 9.6 symbols/min [2025-09-15T17:42:13.969969] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:42:13.986139] [DEBUG] [LOCAL ] CBU: Loaded 16496 existing records from primary storage. [2025-09-15T17:42:13.986252] [INFO ] [MAIN ] CBU: Loaded 16496 existing records. [2025-09-15T17:42:14.063027] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-09-15T17:42:14.160876] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:42:14.161109] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-09-15T17:42:14.161154] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-09-15T17:42:14.161894] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-09-15T17:42:14.162029] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-09-15T17:42:14.521572] [INFO ] [REMOTE ] CBU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:42:14.609597] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T17:42:14.857858] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-09-15T17:42:15.234456] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-15T17:42:15.657858] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-09-15T17:42:16.023292] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-15T17:42:16.132915] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-15T17:42:16.457926] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-09-15T17:42:17.257898] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-09-15T17:42:18.057867] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-09-15T17:42:18.116565] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T17:42:18.117269] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-15T17:42:18.129726] [INFO ] [REMOTE ] CBAN: Full fetch complete (12326 records). [2025-09-15T17:42:18.129823] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-09-15T17:42:18.496813] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-09-15T17:42:18.496914] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-09-15T17:42:18.497197] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-09-15T17:42:18.497246] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-09-15T17:42:18.497753] [DEBUG] [LOCAL ] CBAN: Trimmed 12326 records to 7399 (keeping 150 days of data) [2025-09-15T17:42:18.548023] [DEBUG] [LOCAL ] CBAN: Primary data saved (7399 records). [2025-09-15T17:42:18.548182] [INFO ] [MAIN ] CBAN: Full history saved. [2025-09-15T17:42:18.548276] [INFO ] [MAIN ] Update Progress: 404/2369 symbols completed. CBAN took 30.9s. Estimated remaining: 3h 25m 31s. Rate: 9.6 symbols/min [2025-09-15T17:42:18.719588] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:42:18.719816] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-09-15T17:42:18.719858] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-09-15T17:42:18.719992] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-09-15T17:42:18.720033] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-15T17:42:18.720079] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-15T17:42:18.720111] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-09-15T17:42:18.862965] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-09-15T17:42:19.085323] [INFO ] [REMOTE ] CBX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:42:19.135983] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-15T17:42:19.657888] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-09-15T17:42:20.196160] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T17:42:20.415751] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-15T17:42:20.457817] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-09-15T17:42:21.257906] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-09-15T17:42:21.458332] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-15T17:42:22.057929] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-09-15T17:42:22.662506] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-15T17:42:22.699867] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T17:42:22.857882] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-09-15T17:42:23.657905] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-09-15T17:42:24.444123] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-15T17:42:24.457805] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-09-15T17:42:24.831238] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-15T17:42:25.257922] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-09-15T17:42:25.713810] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T17:42:26.057941] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-02. [2025-09-15T17:42:26.331445] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:42:26.331804] [WARN ] [REMOTE ] CBX: No data returned for month 2025-02 [2025-09-15T17:42:26.494731] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-15T17:42:26.857903] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-03. [2025-09-15T17:42:27.042356] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:42:27.042685] [WARN ] [REMOTE ] CBX: No data returned for month 2025-03 [2025-09-15T17:42:27.657888] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-09-15T17:42:28.457897] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-09-15T17:42:28.918838] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T17:42:29.257886] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-09-15T17:42:30.057900] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-04. [2025-09-15T17:42:30.151340] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-15T17:42:30.157085] [INFO ] [REMOTE ] CBRE: Full fetch complete (55239 records). [2025-09-15T17:42:30.157208] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-09-15T17:42:30.306033] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:42:30.316034] [WARN ] [REMOTE ] CBX: No data returned for month 2025-04 [2025-09-15T17:42:30.564808] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-09-15T17:42:30.564983] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-09-15T17:42:30.565874] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-09-15T17:42:30.572284] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-09-15T17:42:30.584312] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-15T17:42:30.591629] [DEBUG] [LOCAL ] CBRE: Trimmed 55239 records to 37044 (keeping 150 days of data) [2025-09-15T17:42:30.835144] [DEBUG] [LOCAL ] CBRE: Primary data saved (37044 records). [2025-09-15T17:42:30.835300] [INFO ] [MAIN ] CBRE: Full history saved. [2025-09-15T17:42:30.837885] [INFO ] [MAIN ] Update Progress: 405/2369 symbols completed. CBRE took 27.8s. Estimated remaining: 3h 25m 54s. Rate: 9.5 symbols/min [2025-09-15T17:42:30.868013] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-09-15T17:42:31.017451] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:42:31.043578] [DEBUG] [LOCAL ] CBZ: Loaded 25154 existing records from primary storage. [2025-09-15T17:42:31.043740] [INFO ] [MAIN ] CBZ: Loaded 25154 existing records. [2025-09-15T17:42:31.226392] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:42:31.226715] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-09-15T17:42:31.226772] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-09-15T17:42:31.227500] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-09-15T17:42:31.227561] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-09-15T17:42:31.590439] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:42:31.657850] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-09-15T17:42:32.245948] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-15T17:42:32.457863] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-09-15T17:42:32.830531] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-15T17:42:33.257892] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-05. [2025-09-15T17:42:33.631083] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-15T17:42:33.634670] [INFO ] [REMOTE ] CBT: Full fetch complete (34500 records). [2025-09-15T17:42:33.634773] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-09-15T17:42:34.009024] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-09-15T17:42:34.009106] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-09-15T17:42:34.009589] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-09-15T17:42:34.009629] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-09-15T17:42:34.010455] [DEBUG] [LOCAL ] CBT: Trimmed 34500 records to 22706 (keeping 150 days of data) [2025-09-15T17:42:34.067459] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-09-15T17:42:34.124186] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-15T17:42:34.170455] [DEBUG] [LOCAL ] CBT: Primary data saved (22706 records). [2025-09-15T17:42:34.170598] [INFO ] [MAIN ] CBT: Full history saved. [2025-09-15T17:42:34.170707] [INFO ] [MAIN ] Update Progress: 406/2369 symbols completed. CBT took 27.0s. Estimated remaining: 3h 25m 33s. Rate: 9.5 symbols/min [2025-09-15T17:42:34.365014] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:42:34.404411] [DEBUG] [LOCAL ] CC: Loaded 39907 existing records from primary storage. [2025-09-15T17:42:34.404610] [INFO ] [MAIN ] CC: Loaded 39907 existing records. [2025-09-15T17:42:34.589508] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:42:34.589870] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-09-15T17:42:34.589934] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-09-15T17:42:34.591167] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-09-15T17:42:34.591232] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-09-15T17:42:34.863093] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-06. [2025-09-15T17:42:34.962771] [INFO ] [REMOTE ] CC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:42:35.171780] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-15T17:42:35.305917] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-15T17:42:35.657870] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-07. [2025-09-15T17:42:35.881059] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-09-15T17:42:36.457912] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-09-15T17:42:37.257927] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-08. [2025-09-15T17:42:37.446201] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:42:37.446549] [WARN ] [REMOTE ] CBX: No data returned for month 2025-08 [2025-09-15T17:42:37.514198] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T17:42:37.516987] [INFO ] [REMOTE ] CBU: Full fetch complete (24320 records). [2025-09-15T17:42:37.517074] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-09-15T17:42:37.887515] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-09-15T17:42:37.887614] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-09-15T17:42:37.888057] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-09-15T17:42:37.888101] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-09-15T17:42:37.888792] [DEBUG] [LOCAL ] CBU: Trimmed 24320 records to 16204 (keeping 150 days of data) [2025-09-15T17:42:37.990549] [DEBUG] [LOCAL ] CBU: Primary data saved (16204 records). [2025-09-15T17:42:37.990709] [INFO ] [MAIN ] CBU: Full history saved. [2025-09-15T17:42:37.990810] [INFO ] [MAIN ] Update Progress: 407/2369 symbols completed. CBU took 24.2s. Estimated remaining: 3h 25m 15s. Rate: 9.6 symbols/min [2025-09-15T17:42:38.063107] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-09-15T17:42:38.160854] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:42:38.198984] [DEBUG] [LOCAL ] CCI: Loaded 39942 existing records from primary storage. [2025-09-15T17:42:38.199132] [INFO ] [MAIN ] CCI: Loaded 39942 existing records. [2025-09-15T17:42:38.375280] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:42:38.375522] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-09-15T17:42:38.375567] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-09-15T17:42:38.376504] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-09-15T17:42:38.376554] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-09-15T17:42:38.735277] [INFO ] [REMOTE ] CCI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:42:38.857916] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-09. [2025-09-15T17:42:39.158280] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:42:39.158611] [WARN ] [REMOTE ] CBX: No data returned for month 2025-09 [2025-09-15T17:42:39.158727] [INFO ] [REMOTE ] CBX: Full fetch complete (1040 records). [2025-09-15T17:42:39.158809] [DEBUG] [VALIDATOR ] CBX: Validating primary data. [2025-09-15T17:42:39.159452] [FATAL] [VALIDATOR ] CBX: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:42:39.159531] [FATAL] [MAIN ] CBX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:42:39.159574] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:42:39.159617] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-15T17:42:39.159712] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-15T17:42:39.159761] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-09-15T17:42:39.159803] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-09-15T17:42:39.159861] [INFO ] [MAIN ] Update Progress: 408/2369 symbols completed. CBX took 20.6s. Estimated remaining: 3h 24m 44s. Rate: 9.6 symbols/min [2025-09-15T17:42:39.351548] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:42:39.351786] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-09-15T17:42:39.351828] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-09-15T17:42:39.351954] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-09-15T17:42:39.351995] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-15T17:42:39.352038] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-15T17:42:39.352072] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-09-15T17:42:39.666861] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-09-15T17:42:39.726235] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:42:39.752415] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-15T17:42:40.457894] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-09-15T17:42:40.982125] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-15T17:42:41.243383] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-15T17:42:41.257818] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-09-15T17:42:42.057896] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-09-15T17:42:42.857994] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-09-15T17:42:43.268967] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-15T17:42:43.449339] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-15T17:42:43.657890] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-09-15T17:42:44.216270] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-15T17:42:44.459778] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-09-15T17:42:44.462266] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-15T17:42:45.257911] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-09-15T17:42:46.057880] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-09-15T17:42:46.198416] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-15T17:42:46.262915] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T17:42:46.857884] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-09-15T17:42:47.194684] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-15T17:42:47.657943] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-09-15T17:42:48.041605] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-15T17:42:48.063945] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-15T17:42:48.457875] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-09-15T17:42:49.257887] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-09-15T17:42:49.840244] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-15T17:42:50.057868] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-09-15T17:42:50.857985] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-09-15T17:42:50.987016] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-15T17:42:51.360536] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-15T17:42:51.365082] [INFO ] [REMOTE ] CBZ: Full fetch complete (35398 records). [2025-09-15T17:42:51.365168] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-09-15T17:42:51.488393] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-15T17:42:51.663138] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-09-15T17:42:51.767137] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-09-15T17:42:51.767228] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-09-15T17:42:51.767767] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-09-15T17:42:51.767821] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-09-15T17:42:51.768714] [DEBUG] [LOCAL ] CBZ: Trimmed 35398 records to 24586 (keeping 150 days of data) [2025-09-15T17:42:51.922164] [DEBUG] [LOCAL ] CBZ: Primary data saved (24586 records). [2025-09-15T17:42:51.922343] [INFO ] [MAIN ] CBZ: Full history saved. [2025-09-15T17:42:51.922461] [INFO ] [MAIN ] Update Progress: 409/2369 symbols completed. CBZ took 21.1s. Estimated remaining: 3h 25m 9s. Rate: 9.6 symbols/min [2025-09-15T17:42:52.029396] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-15T17:42:52.100279] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:42:52.112458] [DEBUG] [LOCAL ] CCIF: Loaded 11453 existing records from primary storage. [2025-09-15T17:42:52.112591] [INFO ] [MAIN ] CCIF: Loaded 11453 existing records. [2025-09-15T17:42:52.290130] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:42:52.290406] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-09-15T17:42:52.290452] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-09-15T17:42:52.290879] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-09-15T17:42:52.290933] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-09-15T17:42:52.464018] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-09-15T17:42:52.655580] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:42:53.257878] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-09-15T17:42:53.514622] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-15T17:42:54.109827] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-09-15T17:42:54.131541] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-15T17:42:54.857879] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-09-15T17:42:55.518904] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-15T17:42:55.657854] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-09-15T17:42:56.339148] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T17:42:56.457873] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-09-15T17:42:57.003063] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T17:42:57.257891] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-09-15T17:42:58.057900] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-09-15T17:42:58.275694] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-15T17:42:58.389869] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-15T17:42:58.857880] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-09-15T17:42:58.894845] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-15T17:42:59.317996] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-15T17:42:59.318917] [INFO ] [REMOTE ] CCIA: Full fetch complete (1536 records). [2025-09-15T17:42:59.318987] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-09-15T17:42:59.496450] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-15T17:42:59.496704] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:42:59.496761] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:42:59.496804] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-15T17:42:59.496864] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-15T17:42:59.496901] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-09-15T17:42:59.496955] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-09-15T17:42:59.497018] [INFO ] [MAIN ] Update Progress: 410/2369 symbols completed. CCIA took 20.3s. Estimated remaining: 3h 25m 9s. Rate: 9.5 symbols/min [2025-09-15T17:42:59.668185] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-09-15T17:42:59.670760] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:42:59.717371] [DEBUG] [LOCAL ] CCJ: Loaded 40437 existing records from primary storage. [2025-09-15T17:42:59.717525] [INFO ] [MAIN ] CCJ: Loaded 40437 existing records. [2025-09-15T17:42:59.891595] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:42:59.891879] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-09-15T17:42:59.891926] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-09-15T17:42:59.892775] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-09-15T17:42:59.892851] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-09-15T17:43:00.246482] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:43:00.457922] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-09-15T17:43:00.875786] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T17:43:01.257974] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-09-15T17:43:02.057859] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-09-15T17:43:02.267496] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-15T17:43:02.857910] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-09-15T17:43:03.354399] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-15T17:43:03.422578] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-15T17:43:03.657904] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-09-15T17:43:03.700094] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T17:43:03.706541] [INFO ] [REMOTE ] CCI: Full fetch complete (57794 records). [2025-09-15T17:43:03.706716] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-09-15T17:43:04.116590] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-09-15T17:43:04.116734] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-09-15T17:43:04.117607] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-09-15T17:43:04.117676] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-09-15T17:43:04.119386] [DEBUG] [LOCAL ] CCI: Trimmed 57794 records to 39172 (keeping 150 days of data) [2025-09-15T17:43:04.383107] [DEBUG] [LOCAL ] CCI: Primary data saved (39172 records). [2025-09-15T17:43:04.383360] [INFO ] [MAIN ] CCI: Full history saved. [2025-09-15T17:43:04.383484] [INFO ] [MAIN ] Update Progress: 411/2369 symbols completed. CCI took 26.4s. Estimated remaining: 3h 24m 56s. Rate: 9.6 symbols/min [2025-09-15T17:43:04.463039] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-09-15T17:43:04.596952] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:43:04.638762] [DEBUG] [LOCAL ] CCK: Loaded 34738 existing records from primary storage. [2025-09-15T17:43:04.638967] [INFO ] [MAIN ] CCK: Loaded 34738 existing records. [2025-09-15T17:43:04.823993] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:43:04.824326] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-09-15T17:43:04.824378] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-09-15T17:43:04.825367] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-09-15T17:43:04.825429] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-09-15T17:43:05.195780] [INFO ] [REMOTE ] CCK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:43:05.257913] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-09-15T17:43:05.581471] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-15T17:43:06.057888] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-09-15T17:43:06.567211] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-15T17:43:06.610350] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T17:43:06.857888] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-09-15T17:43:07.657888] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-09-15T17:43:07.960210] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-15T17:43:07.980954] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-15T17:43:08.457916] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-09-15T17:43:09.177951] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-15T17:43:09.183704] [INFO ] [REMOTE ] CC: Full fetch complete (57543 records). [2025-09-15T17:43:09.183803] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-09-15T17:43:09.262993] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-09-15T17:43:09.578433] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-09-15T17:43:09.578552] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-09-15T17:43:09.579252] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-09-15T17:43:09.579307] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-09-15T17:43:09.580596] [DEBUG] [LOCAL ] CC: Trimmed 57543 records to 39175 (keeping 150 days of data) [2025-09-15T17:43:09.836853] [DEBUG] [LOCAL ] CC: Primary data saved (39175 records). [2025-09-15T17:43:09.837005] [INFO ] [MAIN ] CC: Full history saved. [2025-09-15T17:43:09.837092] [INFO ] [MAIN ] Update Progress: 412/2369 symbols completed. CC took 35.7s. Estimated remaining: 3h 24m 46s. Rate: 9.6 symbols/min [2025-09-15T17:43:10.019503] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:43:10.060818] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-09-15T17:43:10.062383] [DEBUG] [LOCAL ] CCL: Loaded 40540 existing records from primary storage. [2025-09-15T17:43:10.062466] [INFO ] [MAIN ] CCL: Loaded 40540 existing records. [2025-09-15T17:43:10.254007] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:43:10.261161] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-09-15T17:43:10.262809] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-15T17:43:10.267226] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-09-15T17:43:10.268683] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-09-15T17:43:10.268810] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-09-15T17:43:10.605270] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-15T17:43:10.677974] [INFO ] [REMOTE ] CCL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:43:10.857887] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-09-15T17:43:11.657880] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-09-15T17:43:11.751490] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T17:43:12.457875] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-09-15T17:43:13.121876] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-15T17:43:13.257838] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-09-15T17:43:13.702102] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-15T17:43:13.882960] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-15T17:43:14.057854] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-09-15T17:43:14.857869] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-09-15T17:43:15.657859] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-09-15T17:43:15.705905] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-15T17:43:16.252771] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-15T17:43:16.457929] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-09-15T17:43:16.491961] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T17:43:16.704890] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-15T17:43:17.257887] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-09-15T17:43:18.057879] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-09-15T17:43:18.100745] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-15T17:43:18.857940] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-09-15T17:43:19.473715] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-15T17:43:19.657885] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-09-15T17:43:19.750442] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T17:43:20.238228] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-15T17:43:20.457959] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-09-15T17:43:20.872820] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-15T17:43:20.880503] [INFO ] [REMOTE ] CCJ: Full fetch complete (58354 records). [2025-09-15T17:43:20.880615] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-09-15T17:43:21.263851] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-09-15T17:43:21.267865] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-09-15T17:43:21.267948] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-09-15T17:43:21.268706] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-09-15T17:43:21.268853] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-09-15T17:43:21.270054] [DEBUG] [LOCAL ] CCJ: Trimmed 58354 records to 39663 (keeping 150 days of data) [2025-09-15T17:43:21.516728] [DEBUG] [LOCAL ] CCJ: Primary data saved (39663 records). [2025-09-15T17:43:21.516890] [INFO ] [MAIN ] CCJ: Full history saved. [2025-09-15T17:43:21.517464] [INFO ] [MAIN ] Update Progress: 413/2369 symbols completed. CCJ took 22.0s. Estimated remaining: 3h 25m 5s. Rate: 9.5 symbols/min [2025-09-15T17:43:21.684785] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:43:21.723107] [DEBUG] [LOCAL ] CCO: Loaded 36522 existing records from primary storage. [2025-09-15T17:43:21.723278] [INFO ] [MAIN ] CCO: Loaded 36522 existing records. [2025-09-15T17:43:21.902431] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:43:21.902789] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-09-15T17:43:21.902850] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-09-15T17:43:21.903584] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-09-15T17:43:21.903632] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-09-15T17:43:22.058598] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-09-15T17:43:22.264515] [INFO ] [REMOTE ] CCO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:43:22.500852] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-15T17:43:22.776575] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T17:43:22.857870] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-09-15T17:43:22.992190] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-15T17:43:23.657917] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-09-15T17:43:24.330704] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-15T17:43:24.332895] [INFO ] [REMOTE ] CCIF: Full fetch complete (16572 records). [2025-09-15T17:43:24.333039] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-09-15T17:43:24.462779] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-09-15T17:43:24.646881] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-15T17:43:24.748627] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-09-15T17:43:24.748760] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-09-15T17:43:24.749136] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-09-15T17:43:24.749177] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-09-15T17:43:24.749825] [DEBUG] [LOCAL ] CCIF: Trimmed 16572 records to 11217 (keeping 150 days of data) [2025-09-15T17:43:24.822400] [DEBUG] [LOCAL ] CCIF: Primary data saved (11217 records). [2025-09-15T17:43:24.822551] [INFO ] [MAIN ] CCIF: Full history saved. [2025-09-15T17:43:24.822661] [INFO ] [MAIN ] Update Progress: 414/2369 symbols completed. CCIF took 32.9s. Estimated remaining: 3h 24m 45s. Rate: 9.5 symbols/min [2025-09-15T17:43:24.993132] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:43:25.004138] [DEBUG] [LOCAL ] CCRD: Loaded 7757 existing records from primary storage. [2025-09-15T17:43:25.004279] [INFO ] [MAIN ] CCRD: Loaded 7757 existing records. [2025-09-15T17:43:25.187303] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:43:25.187538] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-09-15T17:43:25.187589] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-09-15T17:43:25.187976] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-09-15T17:43:25.188025] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-09-15T17:43:25.265195] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-09-15T17:43:25.569789] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:43:25.622672] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T17:43:26.057883] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-09-15T17:43:26.548039] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-15T17:43:26.634617] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-15T17:43:26.641183] [INFO ] [REMOTE ] CCK: Full fetch complete (50793 records). [2025-09-15T17:43:26.641375] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-09-15T17:43:26.866220] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-09-15T17:43:27.046187] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-09-15T17:43:27.046283] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-09-15T17:43:27.047058] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-09-15T17:43:27.047123] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-09-15T17:43:27.049038] [DEBUG] [LOCAL ] CCK: Trimmed 50793 records to 34145 (keeping 150 days of data) [2025-09-15T17:43:27.273404] [DEBUG] [LOCAL ] CCK: Primary data saved (34145 records). [2025-09-15T17:43:27.273569] [INFO ] [MAIN ] CCK: Full history saved. [2025-09-15T17:43:27.274106] [INFO ] [MAIN ] Update Progress: 415/2369 symbols completed. CCK took 22.9s. Estimated remaining: 3h 24m 20s. Rate: 9.6 symbols/min [2025-09-15T17:43:27.442428] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:43:27.468198] [DEBUG] [LOCAL ] CCS: Loaded 22771 existing records from primary storage. [2025-09-15T17:43:27.468337] [INFO ] [MAIN ] CCS: Loaded 22771 existing records. [2025-09-15T17:43:27.647899] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:43:27.648325] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-09-15T17:43:27.648395] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-09-15T17:43:27.649229] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-09-15T17:43:27.649298] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-09-15T17:43:27.663127] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-09-15T17:43:28.023983] [INFO ] [REMOTE ] CCS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:43:28.457917] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-09-15T17:43:28.568343] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-15T17:43:29.174053] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-15T17:43:29.257893] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-09-15T17:43:29.818053] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-15T17:43:30.057940] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-09-15T17:43:30.857887] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-09-15T17:43:31.254360] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T17:43:31.310235] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-15T17:43:31.657922] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-09-15T17:43:32.136817] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T17:43:32.457876] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-09-15T17:43:33.257871] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-09-15T17:43:33.702545] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-15T17:43:33.735311] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-15T17:43:33.818302] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-15T17:43:34.057878] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-09-15T17:43:34.516255] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-15T17:43:34.857886] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-09-15T17:43:35.657903] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-09-15T17:43:36.348414] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-15T17:43:36.457915] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-09-15T17:43:36.510708] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-15T17:43:37.257870] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-09-15T17:43:38.057903] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-09-15T17:43:38.754572] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-15T17:43:38.800195] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-15T17:43:38.806274] [INFO ] [REMOTE ] CCL: Full fetch complete (58480 records). [2025-09-15T17:43:38.806437] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-09-15T17:43:38.863289] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-09-15T17:43:39.214110] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-09-15T17:43:39.214801] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-09-15T17:43:39.215671] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-09-15T17:43:39.216508] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-09-15T17:43:39.216422] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-15T17:43:39.224635] [DEBUG] [LOCAL ] CCL: Trimmed 58480 records to 39760 (keeping 150 days of data) [2025-09-15T17:43:39.468256] [DEBUG] [LOCAL ] CCL: Primary data saved (39760 records). [2025-09-15T17:43:39.468404] [INFO ] [MAIN ] CCL: Full history saved. [2025-09-15T17:43:39.468488] [INFO ] [MAIN ] Update Progress: 416/2369 symbols completed. CCL took 29.6s. Estimated remaining: 3h 24m 42s. Rate: 9.5 symbols/min [2025-09-15T17:43:39.636790] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:43:39.653484] [DEBUG] [LOCAL ] CCU: Loaded 16710 existing records from primary storage. [2025-09-15T17:43:39.653610] [INFO ] [MAIN ] CCU: Loaded 16710 existing records. [2025-09-15T17:43:39.664688] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-09-15T17:43:39.830905] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:43:39.831148] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-09-15T17:43:39.831193] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-09-15T17:43:39.831689] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-09-15T17:43:39.831740] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-09-15T17:43:40.208235] [INFO ] [REMOTE ] CCU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:43:40.361082] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T17:43:40.457834] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-09-15T17:43:40.741684] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-15T17:43:41.257881] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-09-15T17:43:42.046305] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-15T17:43:42.057815] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-09-15T17:43:42.125941] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-15T17:43:42.857883] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-09-15T17:43:43.453106] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-15T17:43:43.458381] [INFO ] [REMOTE ] CCO: Full fetch complete (51032 records). [2025-09-15T17:43:43.458475] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-09-15T17:43:43.678760] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-15T17:43:43.668161] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-09-15T17:43:43.855837] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-09-15T17:43:43.855915] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-09-15T17:43:43.856529] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-09-15T17:43:43.856570] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-09-15T17:43:43.857619] [DEBUG] [LOCAL ] CCO: Trimmed 51032 records to 35835 (keeping 150 days of data) [2025-09-15T17:43:44.061269] [DEBUG] [LOCAL ] CCO: Primary data saved (35835 records). [2025-09-15T17:43:44.061413] [INFO ] [MAIN ] CCO: Full history saved. [2025-09-15T17:43:44.063065] [INFO ] [MAIN ] Update Progress: 417/2369 symbols completed. CCO took 22.5s. Estimated remaining: 3h 24m 28s. Rate: 9.5 symbols/min [2025-09-15T17:43:44.239695] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:43:44.239956] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-09-15T17:43:44.240016] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-09-15T17:43:44.240190] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-09-15T17:43:44.240270] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-15T17:43:44.240335] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-15T17:43:44.240377] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-09-15T17:43:44.465288] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-09-15T17:43:44.634514] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:43:45.075158] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T17:43:45.257895] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-09-15T17:43:45.272591] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-15T17:43:46.057922] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-09-15T17:43:46.115627] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-15T17:43:46.117266] [INFO ] [REMOTE ] CCRD: Full fetch complete (9284 records). [2025-09-15T17:43:46.117333] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-09-15T17:43:46.468014] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-09-15T17:43:46.468093] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-09-15T17:43:46.468312] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-09-15T17:43:46.468349] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-09-15T17:43:46.468806] [DEBUG] [LOCAL ] CCRD: Trimmed 9284 records to 7738 (keeping 150 days of data) [2025-09-15T17:43:46.516242] [DEBUG] [LOCAL ] CCRD: Primary data saved (7738 records). [2025-09-15T17:43:46.516352] [INFO ] [MAIN ] CCRD: Full history saved. [2025-09-15T17:43:46.516434] [INFO ] [MAIN ] Update Progress: 418/2369 symbols completed. CCRD took 21.7s. Estimated remaining: 3h 24m 4s. Rate: 9.6 symbols/min [2025-09-15T17:43:46.688822] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:43:46.730516] [DEBUG] [LOCAL ] CDE: Loaded 40384 existing records from primary storage. [2025-09-15T17:43:46.730678] [INFO ] [MAIN ] CDE: Loaded 40384 existing records. [2025-09-15T17:43:46.869083] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-09-15T17:43:46.908560] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:43:46.908790] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-09-15T17:43:46.908836] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-09-15T17:43:46.909632] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-09-15T17:43:46.909705] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-09-15T17:43:47.269987] [INFO ] [REMOTE ] CDE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:43:47.333683] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-15T17:43:47.370261] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-15T17:43:47.657885] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-09-15T17:43:48.457870] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-09-15T17:43:48.549788] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-15T17:43:49.257907] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-09-15T17:43:49.641352] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-15T17:43:50.057896] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-09-15T17:43:50.416804] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-15T17:43:50.596139] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-15T17:43:50.600694] [INFO ] [REMOTE ] CCS: Full fetch complete (33463 records). [2025-09-15T17:43:50.600803] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-09-15T17:43:50.863062] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-09-15T17:43:50.966677] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-09-15T17:43:50.966757] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-09-15T17:43:50.967258] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-09-15T17:43:50.967297] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-09-15T17:43:50.968031] [DEBUG] [LOCAL ] CCS: Trimmed 33463 records to 22400 (keeping 150 days of data) [2025-09-15T17:43:51.109417] [DEBUG] [LOCAL ] CCS: Primary data saved (22400 records). [2025-09-15T17:43:51.109577] [INFO ] [MAIN ] CCS: Full history saved. [2025-09-15T17:43:51.109690] [INFO ] [MAIN ] Update Progress: 419/2369 symbols completed. CCS took 23.8s. Estimated remaining: 3h 23m 50s. Rate: 9.6 symbols/min [2025-09-15T17:43:51.281470] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:43:51.289484] [DEBUG] [LOCAL ] CDLR: Loaded 7036 existing records from primary storage. [2025-09-15T17:43:51.289574] [INFO ] [MAIN ] CDLR: Loaded 7036 existing records. [2025-09-15T17:43:51.462519] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:43:51.462791] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-09-15T17:43:51.462837] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-09-15T17:43:51.463125] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-09-15T17:43:51.463170] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-09-15T17:43:51.665322] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-09-15T17:43:51.810386] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:43:52.033319] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-15T17:43:52.457914] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-09-15T17:43:52.907598] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-15T17:43:53.257913] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-09-15T17:43:53.308757] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-15T17:43:54.057889] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-09-15T17:43:54.851767] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-15T17:43:54.862329] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-09-15T17:43:55.260403] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-15T17:43:55.439809] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-15T17:43:55.657856] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-09-15T17:43:56.347489] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-15T17:43:56.457870] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-09-15T17:43:57.257927] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-09-15T17:43:57.333890] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-15T17:43:57.843980] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-15T17:43:58.057867] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-09-15T17:43:58.355816] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-15T17:43:58.857871] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-09-15T17:43:59.657854] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-09-15T17:43:59.969919] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-15T17:44:00.347545] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-15T17:44:00.457823] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-09-15T17:44:01.252187] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-15T17:44:01.254810] [INFO ] [REMOTE ] CCU: Full fetch complete (26284 records). [2025-09-15T17:44:01.254890] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-09-15T17:44:01.266116] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-09-15T17:44:01.679399] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-09-15T17:44:01.679478] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-09-15T17:44:01.679921] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-09-15T17:44:01.679963] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-09-15T17:44:01.680615] [DEBUG] [LOCAL ] CCU: Trimmed 26284 records to 16315 (keeping 150 days of data) [2025-09-15T17:44:01.776274] [DEBUG] [LOCAL ] CCU: Primary data saved (16315 records). [2025-09-15T17:44:01.776436] [INFO ] [MAIN ] CCU: Full history saved. [2025-09-15T17:44:01.776522] [INFO ] [MAIN ] Update Progress: 420/2369 symbols completed. CCU took 22.3s. Estimated remaining: 3h 24m 4s. Rate: 9.6 symbols/min [2025-09-15T17:44:01.971949] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:44:01.972186] [DEBUG] [LOCAL ] CDP: No existing data file found in primary storage. [2025-09-15T17:44:01.972229] [WARN ] [MAIN ] CDP: No existing data found, performing full refresh instead. [2025-09-15T17:44:01.972358] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-09-15T17:44:01.972399] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-09-15T17:44:01.972441] [DEBUG] [LOCAL ] CDP: No primary data file found to delete. [2025-09-15T17:44:01.972476] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-09-15T17:44:02.066437] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-09-15T17:44:02.274573] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-15T17:44:02.358312] [INFO ] [REMOTE ] CDP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:44:02.857919] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-09-15T17:44:03.462958] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-15T17:44:03.657905] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-09-15T17:44:03.892208] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:44:03.892746] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-09-15T17:44:04.149393] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-15T17:44:04.457898] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-09-15T17:44:05.257928] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-09-15T17:44:06.057841] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-09-15T17:44:06.142525] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-15T17:44:06.172145] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-15T17:44:06.857856] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-09-15T17:44:07.521082] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-15T17:44:07.657912] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-07. [2025-09-15T17:44:07.915858] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-15T17:44:08.458000] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-09-15T17:44:08.583197] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-15T17:44:08.907056] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-15T17:44:09.257918] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-08. [2025-09-15T17:44:09.566386] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-15T17:44:10.057878] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-09-15T17:44:10.857882] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-09-15T17:44:11.595194] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-15T17:44:11.657892] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-09-15T17:44:11.948716] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-15T17:44:12.457908] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-09-15T17:44:13.236080] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T17:44:13.257817] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-09-15T17:44:13.646421] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-15T17:44:14.057921] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-09-15T17:44:14.857884] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-09-15T17:44:15.352196] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-15T17:44:15.358046] [INFO ] [REMOTE ] CDE: Full fetch complete (58320 records). [2025-09-15T17:44:15.358147] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-09-15T17:44:15.661324] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-09. [2025-09-15T17:44:15.664140] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T17:44:15.707024] [INFO ] [REMOTE ] CDLR: Full fetch complete (10652 records). [2025-09-15T17:44:15.739796] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-09-15T17:44:15.759926] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-09-15T17:44:15.790618] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-09-15T17:44:15.828985] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-09-15T17:44:15.840838] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-09-15T17:44:15.925482] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-15T17:44:15.995116] [DEBUG] [LOCAL ] CDE: Trimmed 58320 records to 39604 (keeping 150 days of data) [2025-09-15T17:44:16.242488] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-09-15T17:44:16.243079] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-09-15T17:44:16.243606] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-09-15T17:44:16.243939] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-09-15T17:44:16.245989] [DEBUG] [LOCAL ] CDLR: Trimmed 10652 records to 6990 (keeping 150 days of data) [2025-09-15T17:44:16.293572] [DEBUG] [LOCAL ] CDLR: Primary data saved (6990 records). [2025-09-15T17:44:16.294435] [INFO ] [MAIN ] CDLR: Full history saved. [2025-09-15T17:44:16.295569] [INFO ] [MAIN ] Update Progress: 421/2369 symbols completed. CDLR took 25.2s. Estimated remaining: 3h 24m 35s. Rate: 9.5 symbols/min [2025-09-15T17:44:16.401052] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-15T17:44:16.413688] [INFO ] [REMOTE ] CCZ: Full fetch complete (76 records). [2025-09-15T17:44:16.430592] [DEBUG] [VALIDATOR ] CCZ: Validating primary data. [2025-09-15T17:44:16.461990] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-09-15T17:44:16.494357] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:44:16.744997] [WARN ] [VALIDATOR ] CCZ: Validation failed - insufficient historical data. Have 21 unique days, need 150 days [2025-09-15T17:44:16.761010] [FATAL] [MAIN ] CCZ: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:44:16.791401] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:44:16.790452] [DEBUG] [LOCAL ] CDRE: Loaded 18728 existing records from primary storage. [2025-09-15T17:44:16.792158] [INFO ] [MAIN ] CDRE: Loaded 18728 existing records. [2025-09-15T17:44:16.792093] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-15T17:44:16.798565] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-15T17:44:16.806542] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-09-15T17:44:16.827701] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-09-15T17:44:16.840438] [INFO ] [MAIN ] Update Progress: 422/2369 symbols completed. CCZ took 32.8s. Estimated remaining: 3h 24m 3s. Rate: 9.5 symbols/min [2025-09-15T17:44:17.113766] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:44:17.158551] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-09-15T17:44:17.158253] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:44:17.158934] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-09-15T17:44:17.160999] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-09-15T17:44:17.161753] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-09-15T17:44:17.465518] [DEBUG] [LOCAL ] CE: Loaded 38584 existing records from primary storage. [2025-09-15T17:44:17.476787] [INFO ] [MAIN ] CE: Loaded 38584 existing records. [2025-09-15T17:44:17.620456] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:44:17.624210] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-09-15T17:44:17.623919] [DEBUG] [LOCAL ] CDE: Primary data saved (39604 records). [2025-09-15T17:44:17.639731] [INFO ] [MAIN ] CDE: Full history saved. [2025-09-15T17:44:17.647673] [INFO ] [MAIN ] Update Progress: 423/2369 symbols completed. CDE took 31.1s. Estimated remaining: 3h 23m 31s. Rate: 9.6 symbols/min [2025-09-15T17:44:17.854684] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:44:17.855129] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-09-15T17:44:17.876125] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-09-15T17:44:17.927243] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:44:17.923981] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-09-15T17:44:17.927659] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-09-15T17:44:18.059394] [DEBUG] [LOCAL ] CEE: Loaded 4013 existing records from primary storage. [2025-09-15T17:44:18.071281] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T17:44:18.081765] [INFO ] [MAIN ] CEE: Loaded 4013 existing records. [2025-09-15T17:44:18.151733] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-09-15T17:44:18.486939] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:44:18.504756] [INFO ] [REMOTE ] CE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:44:18.504974] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-09-15T17:44:18.505231] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-09-15T17:44:18.505481] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-09-15T17:44:18.505528] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-09-15T17:44:18.856814] [INFO ] [REMOTE ] CEE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:44:18.864621] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-09-15T17:44:18.867999] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T17:44:19.657841] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-09-15T17:44:19.683149] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-15T17:44:19.772578] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-15T17:44:20.457890] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-09-15T17:44:20.985968] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-15T17:44:21.251214] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-15T17:44:21.260515] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-09-15T17:44:22.057922] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-09-15T17:44:22.233285] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-15T17:44:22.712902] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-15T17:44:22.857857] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-09-15T17:44:23.657903] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-09-15T17:44:23.947861] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-15T17:44:23.952774] [INFO ] [REMOTE ] CDP: Full fetch complete (46648 records). [2025-09-15T17:44:23.952888] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-09-15T17:44:24.341796] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-09-15T17:44:24.341880] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-09-15T17:44:24.342517] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-09-15T17:44:24.342565] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-09-15T17:44:24.343513] [DEBUG] [LOCAL ] CDP: Trimmed 46648 records to 31021 (keeping 150 days of data) [2025-09-15T17:44:24.460882] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-09-15T17:44:24.537365] [DEBUG] [LOCAL ] CDP: Primary data saved (31021 records). [2025-09-15T17:44:24.537498] [INFO ] [MAIN ] CDP: Full history saved. [2025-09-15T17:44:24.537581] [INFO ] [MAIN ] Update Progress: 424/2369 symbols completed. CDP took 22.8s. Estimated remaining: 3h 23m 28s. Rate: 9.6 symbols/min [2025-09-15T17:44:24.713894] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:44:24.733687] [DEBUG] [LOCAL ] CEPU: Loaded 18775 existing records from primary storage. [2025-09-15T17:44:24.733830] [INFO ] [MAIN ] CEPU: Loaded 18775 existing records. [2025-09-15T17:44:24.921966] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:44:24.922242] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-09-15T17:44:24.922290] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-09-15T17:44:24.922853] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-09-15T17:44:24.922905] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-09-15T17:44:25.261984] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-09-15T17:44:25.291777] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:44:25.325936] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-15T17:44:25.526145] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-15T17:44:25.895902] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-15T17:44:26.057878] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-09-15T17:44:26.857941] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-09-15T17:44:27.292533] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-15T17:44:27.482055] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-15T17:44:27.657871] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-09-15T17:44:28.099716] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-15T17:44:28.457882] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-09-15T17:44:29.257917] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-09-15T17:44:29.488503] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-15T17:44:30.018734] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-15T17:44:30.057815] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-09-15T17:44:30.830490] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T17:44:30.831553] [INFO ] [REMOTE ] CEE: Full fetch complete (8735 records). [2025-09-15T17:44:30.831622] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-09-15T17:44:30.862976] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-09-15T17:44:31.187235] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-09-15T17:44:31.187310] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-09-15T17:44:31.187516] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-09-15T17:44:31.187554] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-09-15T17:44:31.187968] [DEBUG] [LOCAL ] CEE: Trimmed 8735 records to 3994 (keeping 150 days of data) [2025-09-15T17:44:31.211435] [DEBUG] [LOCAL ] CEE: Primary data saved (3994 records). [2025-09-15T17:44:31.211506] [INFO ] [MAIN ] CEE: Full history saved. [2025-09-15T17:44:31.211578] [INFO ] [MAIN ] Update Progress: 425/2369 symbols completed. CEE took 13.6s. Estimated remaining: 3h 23m 23s. Rate: 9.6 symbols/min [2025-09-15T17:44:31.384940] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:44:31.425318] [DEBUG] [LOCAL ] CF: Loaded 39355 existing records from primary storage. [2025-09-15T17:44:31.425482] [INFO ] [MAIN ] CF: Loaded 39355 existing records. [2025-09-15T17:44:31.599944] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:44:31.600194] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-09-15T17:44:31.600242] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-09-15T17:44:31.601199] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-09-15T17:44:31.601256] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-09-15T17:44:31.663029] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-09-15T17:44:31.952262] [INFO ] [REMOTE ] CF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:44:32.174751] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-15T17:44:32.457869] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-09-15T17:44:32.828029] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-15T17:44:33.257829] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-09-15T17:44:33.659795] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-15T17:44:34.057878] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-09-15T17:44:34.650266] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-15T17:44:34.857880] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-09-15T17:44:34.964517] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-15T17:44:35.657868] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-09-15T17:44:36.348191] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T17:44:36.457891] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-09-15T17:44:36.598148] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-15T17:44:37.257953] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-09-15T17:44:37.945042] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-15T17:44:38.057870] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-09-15T17:44:38.857877] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-09-15T17:44:39.029581] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-15T17:44:39.657926] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-09-15T17:44:39.739363] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-15T17:44:39.776808] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-15T17:44:40.457886] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-09-15T17:44:41.263040] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-09-15T17:44:41.280307] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-15T17:44:41.961960] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-15T17:44:42.057890] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-09-15T17:44:42.335763] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-15T17:44:42.857934] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-09-15T17:44:43.490500] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T17:44:43.657879] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-09-15T17:44:43.685578] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-15T17:44:44.457877] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-09-15T17:44:45.176340] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-15T17:44:45.257991] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-09-15T17:44:45.661311] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-15T17:44:45.972919] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-15T17:44:45.975617] [INFO ] [REMOTE ] CDRE: Full fetch complete (26494 records). [2025-09-15T17:44:45.975728] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-09-15T17:44:46.062985] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-09-15T17:44:46.343358] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-09-15T17:44:46.343453] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-09-15T17:44:46.343917] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-09-15T17:44:46.343961] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-09-15T17:44:46.344729] [DEBUG] [LOCAL ] CDRE: Trimmed 26494 records to 18482 (keeping 150 days of data) [2025-09-15T17:44:46.457064] [DEBUG] [LOCAL ] CDRE: Primary data saved (18482 records). [2025-09-15T17:44:46.457227] [INFO ] [MAIN ] CDRE: Full history saved. [2025-09-15T17:44:46.457328] [INFO ] [MAIN ] Update Progress: 426/2369 symbols completed. CDRE took 30.2s. Estimated remaining: 3h 23m 58s. Rate: 9.5 symbols/min [2025-09-15T17:44:46.625330] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:44:46.662069] [DEBUG] [LOCAL ] CFG: Loaded 40366 existing records from primary storage. [2025-09-15T17:44:46.662219] [INFO ] [MAIN ] CFG: Loaded 40366 existing records. [2025-09-15T17:44:46.837146] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:44:46.837404] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-09-15T17:44:46.837452] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-09-15T17:44:46.838389] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-09-15T17:44:46.838441] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-09-15T17:44:46.868631] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-09-15T17:44:47.233308] [INFO ] [REMOTE ] CFG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:44:47.657889] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-09-15T17:44:47.804190] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-15T17:44:48.457871] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-09-15T17:44:48.586228] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-15T17:44:48.857581] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-15T17:44:49.257879] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-09-15T17:44:49.992008] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T17:44:50.013011] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-15T17:44:50.013150] [INFO ] [REMOTE ] CF: Full fetch complete (56911 records). [2025-09-15T17:44:50.018542] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-09-15T17:44:50.063014] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-09-15T17:44:50.406905] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-09-15T17:44:50.407000] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-09-15T17:44:50.407706] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-09-15T17:44:50.407753] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-09-15T17:44:50.409062] [DEBUG] [LOCAL ] CF: Trimmed 56911 records to 38590 (keeping 150 days of data) [2025-09-15T17:44:50.654459] [DEBUG] [LOCAL ] CF: Primary data saved (38590 records). [2025-09-15T17:44:50.654668] [INFO ] [MAIN ] CF: Full history saved. [2025-09-15T17:44:50.655547] [INFO ] [MAIN ] Update Progress: 427/2369 symbols completed. CF took 19.4s. Estimated remaining: 3h 23m 42s. Rate: 9.5 symbols/min [2025-09-15T17:44:50.829856] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:44:50.830096] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-09-15T17:44:50.830136] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-09-15T17:44:50.830243] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-09-15T17:44:50.830284] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-15T17:44:50.830325] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-15T17:44:50.830359] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-09-15T17:44:50.863011] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-09-15T17:44:51.198354] [INFO ] [REMOTE ] CFND: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:44:51.657883] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-09-15T17:44:51.977543] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-15T17:44:52.041481] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-15T17:44:52.045001] [INFO ] [REMOTE ] CEPU: Full fetch complete (27886 records). [2025-09-15T17:44:52.045076] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-09-15T17:44:52.411813] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-09-15T17:44:52.411896] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-09-15T17:44:52.412338] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-09-15T17:44:52.412378] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-09-15T17:44:52.413156] [DEBUG] [LOCAL ] CEPU: Trimmed 27886 records to 18551 (keeping 150 days of data) [2025-09-15T17:44:52.459669] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-09-15T17:44:52.524340] [DEBUG] [LOCAL ] CEPU: Primary data saved (18551 records). [2025-09-15T17:44:52.524519] [INFO ] [MAIN ] CEPU: Full history saved. [2025-09-15T17:44:52.524949] [INFO ] [MAIN ] Update Progress: 428/2369 symbols completed. CEPU took 28.0s. Estimated remaining: 3h 23m 16s. Rate: 9.5 symbols/min [2025-09-15T17:44:52.699844] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:44:52.728415] [DEBUG] [LOCAL ] CFR: Loaded 24399 existing records from primary storage. [2025-09-15T17:44:52.728602] [INFO ] [MAIN ] CFR: Loaded 24399 existing records. [2025-09-15T17:44:52.924081] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:44:52.924454] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-09-15T17:44:52.924525] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-09-15T17:44:52.925598] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-09-15T17:44:52.925743] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-09-15T17:44:53.265237] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-02. [2025-09-15T17:44:53.272313] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T17:44:53.373316] [INFO ] [REMOTE ] CFR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:44:53.517901] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:44:53.518218] [WARN ] [REMOTE ] CFND: No data returned for month 2025-02 [2025-09-15T17:44:54.001374] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-15T17:44:54.057873] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-09-15T17:44:54.857870] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-09-15T17:44:55.340479] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T17:44:55.657928] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-09-15T17:44:56.294994] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-15T17:44:56.457854] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-09-15T17:44:56.886954] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T17:44:56.892889] [INFO ] [REMOTE ] CE: Full fetch complete (56295 records). [2025-09-15T17:44:56.893008] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-09-15T17:44:57.260278] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-03. [2025-09-15T17:44:57.278523] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-09-15T17:44:57.278623] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-09-15T17:44:57.279400] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-09-15T17:44:57.279538] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-09-15T17:44:57.280945] [DEBUG] [LOCAL ] CE: Trimmed 56295 records to 37804 (keeping 150 days of data) [2025-09-15T17:44:57.518610] [DEBUG] [LOCAL ] CE: Primary data saved (37804 records). [2025-09-15T17:44:57.518776] [INFO ] [MAIN ] CE: Full history saved. [2025-09-15T17:44:57.518865] [INFO ] [MAIN ] Update Progress: 429/2369 symbols completed. CE took 40.7s. Estimated remaining: 3h 23m 3s. Rate: 9.6 symbols/min [2025-09-15T17:44:57.562709] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:44:57.596269] [WARN ] [REMOTE ] CFND: No data returned for month 2025-03 [2025-09-15T17:44:57.701098] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:44:57.735453] [DEBUG] [LOCAL ] CGAU: Loaded 31557 existing records from primary storage. [2025-09-15T17:44:57.735729] [INFO ] [MAIN ] CGAU: Loaded 31557 existing records. [2025-09-15T17:44:57.926471] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:44:57.946406] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-09-15T17:44:57.946523] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-09-15T17:44:57.947247] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-09-15T17:44:57.949307] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-15T17:44:57.949383] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-09-15T17:44:58.063036] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-04. [2025-09-15T17:44:58.319745] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:44:58.321150] [WARN ] [REMOTE ] CFND: No data returned for month 2025-04 [2025-09-15T17:44:58.340888] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:44:58.857891] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-09-15T17:44:59.657878] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-09-15T17:45:00.213152] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-15T17:45:00.457875] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-09-15T17:45:01.014871] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T17:45:01.257871] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-09-15T17:45:02.057858] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-05. [2025-09-15T17:45:02.274141] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-15T17:45:02.299236] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:45:02.299694] [WARN ] [REMOTE ] CFND: No data returned for month 2025-05 [2025-09-15T17:45:02.857865] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-09-15T17:45:02.954724] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T17:45:03.657879] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-09-15T17:45:04.356173] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-15T17:45:04.457890] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-09-15T17:45:05.257925] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-09-15T17:45:05.433051] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-15T17:45:05.438961] [INFO ] [REMOTE ] CFG: Full fetch complete (58291 records). [2025-09-15T17:45:05.439099] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-09-15T17:45:05.820058] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-09-15T17:45:05.820176] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-09-15T17:45:05.820970] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-09-15T17:45:05.821033] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-09-15T17:45:05.822500] [DEBUG] [LOCAL ] CFG: Trimmed 58291 records to 39585 (keeping 150 days of data) [2025-09-15T17:45:06.061699] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-06. [2025-09-15T17:45:06.065560] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-15T17:45:06.097791] [DEBUG] [LOCAL ] CFG: Primary data saved (39585 records). [2025-09-15T17:45:06.097960] [INFO ] [MAIN ] CFG: Full history saved. [2025-09-15T17:45:06.098314] [INFO ] [MAIN ] Update Progress: 430/2369 symbols completed. CFG took 19.6s. Estimated remaining: 3h 23m 8s. Rate: 9.5 symbols/min [2025-09-15T17:45:06.274734] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:45:06.278385] [DEBUG] [LOCAL ] CGV: Loaded 953 existing records from primary storage. [2025-09-15T17:45:06.278512] [INFO ] [MAIN ] CGV: Loaded 953 existing records. [2025-09-15T17:45:06.300942] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:45:06.351543] [WARN ] [REMOTE ] CFND: No data returned for month 2025-06 [2025-09-15T17:45:06.471234] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:45:06.471836] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-09-15T17:45:06.471941] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-09-15T17:45:06.472209] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-09-15T17:45:06.472304] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-09-15T17:45:06.638729] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T17:45:06.863345] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-09-15T17:45:07.051339] [INFO ] [REMOTE ] CGV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:45:07.657947] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-09-15T17:45:08.010272] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-15T17:45:08.345597] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T17:45:08.457887] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-09-15T17:45:09.257885] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-09-15T17:45:09.454827] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-15T17:45:09.653752] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-15T17:45:10.057872] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-09-15T17:45:10.541875] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-15T17:45:10.857884] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-09-15T17:45:11.657892] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-07. [2025-09-15T17:45:12.270783] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:45:12.271088] [WARN ] [REMOTE ] CFND: No data returned for month 2025-07 [2025-09-15T17:45:12.306849] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T17:45:12.457888] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-08. [2025-09-15T17:45:13.257915] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-09-15T17:45:13.325281] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-15T17:45:14.057918] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-09-15T17:45:14.212916] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-15T17:45:14.405548] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-15T17:45:14.857870] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-09-15T17:45:15.657890] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-09-15T17:45:16.014111] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-15T17:45:16.068070] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-15T17:45:16.457888] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-09-15T17:45:17.257866] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-09-15T17:45:17.666856] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-15T17:45:17.906274] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-15T17:45:18.057872] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-09. [2025-09-15T17:45:18.702104] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-15T17:45:18.703386] [INFO ] [REMOTE ] CFND: Full fetch complete (2219 records). [2025-09-15T17:45:18.703456] [DEBUG] [VALIDATOR ] CFND: Validating primary data. [2025-09-15T17:45:18.860823] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-09-15T17:45:18.880727] [WARN ] [VALIDATOR ] CFND: Validation failed - insufficient historical data. Have 27 unique days, need 150 days [2025-09-15T17:45:18.881625] [FATAL] [MAIN ] CFND: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:45:18.881720] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:45:18.881787] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-15T17:45:18.881857] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-15T17:45:18.881905] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-09-15T17:45:18.881966] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-09-15T17:45:18.882036] [INFO ] [MAIN ] Update Progress: 431/2369 symbols completed. CFND took 28.2s. Estimated remaining: 3h 23m 31s. Rate: 9.5 symbols/min [2025-09-15T17:45:19.051420] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:45:19.075487] [DEBUG] [LOCAL ] CHCT: Loaded 18123 existing records from primary storage. [2025-09-15T17:45:19.075617] [INFO ] [MAIN ] CHCT: Loaded 18123 existing records. [2025-09-15T17:45:19.256545] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:45:19.256837] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-09-15T17:45:19.256882] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-09-15T17:45:19.257408] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-09-15T17:45:19.257482] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-09-15T17:45:19.604129] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:45:19.657813] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-09-15T17:45:20.447263] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-15T17:45:20.457819] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-09-15T17:45:20.509040] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-15T17:45:21.257930] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-09-15T17:45:21.561470] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T17:45:21.613956] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-15T17:45:22.057878] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-09-15T17:45:22.857891] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-09-15T17:45:23.208118] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T17:45:23.213299] [INFO ] [REMOTE ] CGAU: Full fetch complete (45844 records). [2025-09-15T17:45:23.213393] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-09-15T17:45:23.314697] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-15T17:45:23.317873] [INFO ] [REMOTE ] CGV: Full fetch complete (1631 records). [2025-09-15T17:45:23.317968] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-09-15T17:45:23.657925] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-09-15T17:45:23.889357] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-09-15T17:45:23.899675] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-09-15T17:45:23.910453] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-09-15T17:45:23.932613] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-09-15T17:45:23.961032] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-09-15T17:45:23.961107] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-09-15T17:45:23.961203] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-09-15T17:45:23.961240] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-09-15T17:45:23.961593] [DEBUG] [LOCAL ] CGV: Trimmed 1631 records to 943 (keeping 150 days of data) [2025-09-15T17:45:23.968735] [DEBUG] [LOCAL ] CGV: Primary data saved (943 records). [2025-09-15T17:45:23.968954] [INFO ] [MAIN ] CGV: Full history saved. [2025-09-15T17:45:23.969110] [INFO ] [MAIN ] Update Progress: 432/2369 symbols completed. CGV took 17.9s. Estimated remaining: 3h 23m 19s. Rate: 9.5 symbols/min [2025-09-15T17:45:24.000356] [DEBUG] [LOCAL ] CGAU: Trimmed 45844 records to 31020 (keeping 150 days of data) [2025-09-15T17:45:24.228629] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:45:24.336958] [DEBUG] [LOCAL ] CHD: Loaded 39567 existing records from primary storage. [2025-09-15T17:45:24.337579] [INFO ] [MAIN ] CHD: Loaded 39567 existing records. [2025-09-15T17:45:24.463151] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-09-15T17:45:24.523113] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:45:24.524396] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-09-15T17:45:24.524712] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-09-15T17:45:24.526206] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-09-15T17:45:24.526763] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-09-15T17:45:24.559368] [DEBUG] [LOCAL ] CGAU: Primary data saved (31020 records). [2025-09-15T17:45:24.597822] [INFO ] [MAIN ] CGAU: Full history saved. [2025-09-15T17:45:24.619733] [INFO ] [MAIN ] Update Progress: 433/2369 symbols completed. CGAU took 27.1s. Estimated remaining: 3h 22m 47s. Rate: 9.5 symbols/min [2025-09-15T17:45:24.980927] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:45:25.064746] [INFO ] [REMOTE ] CHD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:45:25.068888] [DEBUG] [LOCAL ] CHE: Loaded 11232 existing records from primary storage. [2025-09-15T17:45:25.069174] [INFO ] [MAIN ] CHE: Loaded 11232 existing records. [2025-09-15T17:45:25.245593] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:45:25.245908] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-09-15T17:45:25.246169] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-09-15T17:45:25.256335] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-09-15T17:45:25.256750] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-09-15T17:45:25.256703] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T17:45:25.267691] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-09-15T17:45:25.325190] [INFO ] [REMOTE ] CFR: Full fetch complete (36435 records). [2025-09-15T17:45:25.352968] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-09-15T17:45:25.369684] [FATAL] [VALIDATOR ] CFR: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:45:25.390290] [FATAL] [MAIN ] CFR: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:45:25.419774] [WARN ] [MAIN ] CFR: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:45:25.421766] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-09-15T17:45:25.437530] [DEBUG] [LOCAL ] CFR: No primary data file found to delete. [2025-09-15T17:45:25.462607] [INFO ] [LOCAL ] CFR: Starting deletion of derivative data. [2025-09-15T17:45:25.505352] [DEBUG] [LOCAL ] CFR: Deleted derivative data file. [2025-09-15T17:45:25.522318] [INFO ] [MAIN ] Update Progress: 434/2369 symbols completed. CFR took 33.0s. Estimated remaining: 3h 22m 17s. Rate: 9.6 symbols/min [2025-09-15T17:45:25.734616] [INFO ] [REMOTE ] CHE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:45:25.828897] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:45:25.829985] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-15T17:45:25.871737] [DEBUG] [LOCAL ] CHGG: Loaded 35858 existing records from primary storage. [2025-09-15T17:45:25.871876] [INFO ] [MAIN ] CHGG: Loaded 35858 existing records. [2025-09-15T17:45:26.054519] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:45:26.054842] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-09-15T17:45:26.054910] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-09-15T17:45:26.055592] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-09-15T17:45:26.055661] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-09-15T17:45:26.066739] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-09-15T17:45:26.416736] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:45:26.857878] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-09-15T17:45:27.089149] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-15T17:45:27.140834] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T17:45:27.657887] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-09-15T17:45:28.097942] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T17:45:28.457936] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-09-15T17:45:28.522502] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T17:45:29.257921] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-09-15T17:45:30.025222] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-15T17:45:30.057853] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-09-15T17:45:30.262371] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-15T17:45:30.857929] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-09-15T17:45:31.599587] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-15T17:45:31.657819] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-09-15T17:45:32.083423] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-15T17:45:32.457863] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-09-15T17:45:33.257914] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-09-15T17:45:33.320527] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T17:45:34.057844] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-09-15T17:45:34.163389] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-15T17:45:34.466181] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T17:45:34.857885] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-09-15T17:45:34.953989] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T17:45:35.657901] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-09-15T17:45:36.231008] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-15T17:45:36.457933] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-09-15T17:45:37.257905] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-09-15T17:45:37.508290] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-15T17:45:37.560248] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-15T17:45:38.046159] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-15T17:45:38.057822] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-09-15T17:45:38.857924] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-09-15T17:45:39.097166] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-15T17:45:39.657907] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-09-15T17:45:39.927004] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-15T17:45:40.457878] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-09-15T17:45:41.207246] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-15T17:45:41.257827] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-09-15T17:45:41.368546] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-15T17:45:42.057875] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-09-15T17:45:42.857877] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-09-15T17:45:42.912814] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T17:45:43.072123] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T17:45:43.657883] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-09-15T17:45:43.789780] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-15T17:45:43.792757] [INFO ] [REMOTE ] CHCT: Full fetch complete (26420 records). [2025-09-15T17:45:43.792846] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-09-15T17:45:44.177098] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-09-15T17:45:44.177206] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-09-15T17:45:44.177664] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-09-15T17:45:44.177720] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-09-15T17:45:44.178677] [DEBUG] [LOCAL ] CHCT: Trimmed 26420 records to 17753 (keeping 150 days of data) [2025-09-15T17:45:44.296471] [DEBUG] [LOCAL ] CHCT: Primary data saved (17753 records). [2025-09-15T17:45:44.296620] [INFO ] [MAIN ] CHCT: Full history saved. [2025-09-15T17:45:44.296746] [INFO ] [MAIN ] Update Progress: 435/2369 symbols completed. CHCT took 25.4s. Estimated remaining: 3h 23m 6s. Rate: 9.5 symbols/min [2025-09-15T17:45:44.469925] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:45:44.466315] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-09-15T17:45:44.498468] [DEBUG] [LOCAL ] CHH: Loaded 23681 existing records from primary storage. [2025-09-15T17:45:44.498607] [INFO ] [MAIN ] CHH: Loaded 23681 existing records. [2025-09-15T17:45:44.679133] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:45:44.679417] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-09-15T17:45:44.679463] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-09-15T17:45:44.680027] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-09-15T17:45:44.680075] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-09-15T17:45:45.038833] [INFO ] [REMOTE ] CHH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:45:45.105669] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-15T17:45:45.257884] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-09-15T17:45:45.466894] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-15T17:45:46.057891] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-09-15T17:45:46.828803] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T17:45:46.836519] [INFO ] [REMOTE ] CHE: Full fetch complete (15389 records). [2025-09-15T17:45:46.843699] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-09-15T17:45:46.844119] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-15T17:45:46.862965] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-09-15T17:45:46.903727] [INFO ] [REMOTE ] CHGG: Full fetch complete (52248 records). [2025-09-15T17:45:46.919360] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-09-15T17:45:47.571955] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-09-15T17:45:47.577499] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-09-15T17:45:47.586117] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-09-15T17:45:47.586443] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-09-15T17:45:47.608080] [DEBUG] [LOCAL ] CHE: Trimmed 15389 records to 11150 (keeping 150 days of data) [2025-09-15T17:45:47.658915] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-09-15T17:45:47.658782] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-09-15T17:45:47.659080] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-09-15T17:45:47.660048] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-09-15T17:45:47.675077] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-09-15T17:45:47.680578] [DEBUG] [LOCAL ] CHGG: Trimmed 52248 records to 35278 (keeping 150 days of data) [2025-09-15T17:45:47.792883] [DEBUG] [LOCAL ] CHE: Primary data saved (11150 records). [2025-09-15T17:45:47.793532] [INFO ] [MAIN ] CHE: Full history saved. [2025-09-15T17:45:47.793880] [INFO ] [MAIN ] Update Progress: 436/2369 symbols completed. CHE took 23.2s. Estimated remaining: 3h 22m 48s. Rate: 9.5 symbols/min [2025-09-15T17:45:47.976612] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:45:47.997874] [DEBUG] [LOCAL ] CHMI: Loaded 15383 existing records from primary storage. [2025-09-15T17:45:47.999039] [INFO ] [MAIN ] CHMI: Loaded 15383 existing records. [2025-09-15T17:45:48.232800] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:45:48.254405] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-09-15T17:45:48.255458] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-09-15T17:45:48.259306] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-09-15T17:45:48.259690] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-09-15T17:45:48.690104] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:45:48.692550] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-15T17:45:48.691369] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-09-15T17:45:48.703660] [DEBUG] [LOCAL ] CHGG: Primary data saved (35278 records). [2025-09-15T17:45:48.703797] [INFO ] [MAIN ] CHGG: Full history saved. [2025-09-15T17:45:48.703893] [INFO ] [MAIN ] Update Progress: 437/2369 symbols completed. CHGG took 23.2s. Estimated remaining: 3h 22m 17s. Rate: 9.6 symbols/min [2025-09-15T17:45:49.106587] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-15T17:45:49.257925] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-09-15T17:45:49.425545] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-15T17:45:50.057902] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-09-15T17:45:50.487287] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-15T17:45:50.831165] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-15T17:45:50.857842] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-09-15T17:45:51.657884] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-09-15T17:45:52.250261] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-15T17:45:52.457903] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-09-15T17:45:52.681854] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-15T17:45:53.257886] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-09-15T17:45:54.057870] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-09-15T17:45:54.253948] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-15T17:45:54.287525] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-15T17:45:54.857889] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-09-15T17:45:54.999635] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-15T17:45:55.565380] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-15T17:45:55.657873] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-09-15T17:45:56.457871] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-09-15T17:45:56.630880] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-15T17:45:57.257925] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-09-15T17:45:57.656107] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-15T17:45:58.057884] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-09-15T17:45:58.858050] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-09-15T17:45:58.859072] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T17:45:58.865893] [INFO ] [REMOTE ] CHD: Full fetch complete (56347 records). [2025-09-15T17:45:58.865987] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-09-15T17:45:59.233092] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-15T17:45:59.383768] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-09-15T17:45:59.383906] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-09-15T17:45:59.385422] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-09-15T17:45:59.385533] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-09-15T17:45:59.387442] [DEBUG] [LOCAL ] CHD: Trimmed 56347 records to 38809 (keeping 150 days of data) [2025-09-15T17:45:59.678395] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-09-15T17:45:59.736349] [DEBUG] [LOCAL ] CHD: Primary data saved (38809 records). [2025-09-15T17:45:59.736569] [INFO ] [MAIN ] CHD: Full history saved. [2025-09-15T17:45:59.736733] [INFO ] [MAIN ] Update Progress: 438/2369 symbols completed. CHD took 35.8s. Estimated remaining: 3h 22m 32s. Rate: 9.5 symbols/min [2025-09-15T17:46:00.505464] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T17:46:00.513013] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-09-15T17:46:00.774295] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-15T17:46:00.776807] [INFO ] [REMOTE ] CHMI: Full fetch complete (23460 records). [2025-09-15T17:46:00.776879] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-09-15T17:46:00.777356] [FATAL] [VALIDATOR ] CHMI: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:46:00.777436] [FATAL] [MAIN ] CHMI: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:46:00.777473] [WARN ] [MAIN ] CHMI: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:46:00.777508] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-09-15T17:46:00.777566] [DEBUG] [LOCAL ] CHMI: No primary data file found to delete. [2025-09-15T17:46:00.777600] [INFO ] [LOCAL ] CHMI: Starting deletion of derivative data. [2025-09-15T17:46:00.777865] [DEBUG] [LOCAL ] CHMI: Deleted derivative data file. [2025-09-15T17:46:00.777943] [INFO ] [MAIN ] Update Progress: 439/2369 symbols completed. CHMI took 13.0s. Estimated remaining: 3h 22m 3s. Rate: 9.6 symbols/min [2025-09-15T17:46:01.830185] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T17:46:01.837324] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-09-15T17:46:03.103692] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T17:46:03.107153] [INFO ] [REMOTE ] CHH: Full fetch complete (35531 records). [2025-09-15T17:46:03.107243] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-09-15T17:46:03.495954] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-09-15T17:46:03.496102] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-09-15T17:46:03.496722] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-09-15T17:46:03.496793] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-09-15T17:46:03.497820] [DEBUG] [LOCAL ] CHH: Trimmed 35531 records to 23316 (keeping 150 days of data) [2025-09-15T17:46:03.650538] [DEBUG] [LOCAL ] CHH: Primary data saved (23316 records). [2025-09-15T17:46:03.650693] [INFO ] [MAIN ] CHH: Full history saved. [2025-09-15T17:46:03.650782] [INFO ] [MAIN ] Update Progress: 440/2369 symbols completed. CHH took 19.4s. Estimated remaining: 3h 21m 41s. Rate: 9.6 symbols/min [2025-09-15T17:46:04.291082] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:46:04.300552] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:46:04.377177] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:46:04.378685] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:46:04.382461] [DEBUG] [LOCAL ] CHN: Loaded 3676 existing records from primary storage. [2025-09-15T17:46:04.383260] [INFO ] [MAIN ] CHN: Loaded 3676 existing records. [2025-09-15T17:46:04.628604] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:46:04.629629] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-09-15T17:46:04.629866] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-09-15T17:46:04.629752] [DEBUG] [LOCAL ] CHT: Loaded 14550 existing records from primary storage. [2025-09-15T17:46:04.630231] [INFO ] [MAIN ] CHT: Loaded 14550 existing records. [2025-09-15T17:46:04.640978] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-09-15T17:46:04.678711] [DEBUG] [LOCAL ] CHWY: Loaded 40401 existing records from primary storage. [2025-09-15T17:46:04.698831] [INFO ] [MAIN ] CHWY: Loaded 40401 existing records. [2025-09-15T17:46:04.698482] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-09-15T17:46:04.901756] [DEBUG] [LOCAL ] CHPT: Loaded 37016 existing records from primary storage. [2025-09-15T17:46:04.991291] [INFO ] [MAIN ] CHPT: Loaded 37016 existing records. [2025-09-15T17:46:05.086329] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:46:05.286334] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-09-15T17:46:05.334787] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:46:05.363139] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-09-15T17:46:05.428508] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-09-15T17:46:05.433926] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-09-15T17:46:05.485396] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-09-15T17:46:05.498166] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-09-15T17:46:05.661375] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:46:05.674521] [INFO ] [REMOTE ] CHN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:46:05.674616] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-09-15T17:46:05.708773] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-09-15T17:46:05.712541] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-09-15T17:46:05.708306] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-09-15T17:46:05.735700] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-09-15T17:46:05.770510] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-09-15T17:46:05.855267] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-09-15T17:46:06.533720] [INFO ] [REMOTE ] CHT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:46:06.571636] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-09-15T17:46:06.677267] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:46:06.693993] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-09-15T17:46:06.744679] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-15T17:46:06.764523] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:46:06.766967] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-09-15T17:46:06.766748] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-09-15T17:46:07.114280] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-15T17:46:07.115897] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-09-15T17:46:07.668049] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-15T17:46:07.671987] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-09-15T17:46:07.709602] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-15T17:46:07.711483] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-09-15T17:46:08.098999] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-15T17:46:08.457881] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-09-15T17:46:08.713867] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-15T17:46:08.755426] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-15T17:46:08.830251] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-15T17:46:08.932798] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-15T17:46:09.257902] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-09-15T17:46:10.057836] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-09-15T17:46:10.121134] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-15T17:46:10.504110] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-15T17:46:10.857888] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-09-15T17:46:11.657873] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-09-15T17:46:11.725216] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-15T17:46:12.457918] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-09-15T17:46:13.257935] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-09-15T17:46:13.493670] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-15T17:46:13.779936] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-15T17:46:13.821632] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-15T17:46:13.822992] [INFO ] [REMOTE ] CHN: Full fetch complete (5412 records). [2025-09-15T17:46:13.823069] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-09-15T17:46:13.823513] [FATAL] [VALIDATOR ] CHN: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:46:13.823970] [FATAL] [MAIN ] CHN: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:46:13.824183] [WARN ] [MAIN ] CHN: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:46:13.824244] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-09-15T17:46:13.824345] [DEBUG] [LOCAL ] CHN: No primary data file found to delete. [2025-09-15T17:46:13.824389] [INFO ] [LOCAL ] CHN: Starting deletion of derivative data. [2025-09-15T17:46:13.824881] [DEBUG] [LOCAL ] CHN: Deleted derivative data file. [2025-09-15T17:46:13.825037] [INFO ] [MAIN ] Update Progress: 441/2369 symbols completed. CHN took 10.2s. Estimated remaining: 3h 21m 52s. Rate: 9.6 symbols/min [2025-09-15T17:46:14.003713] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:46:14.040998] [DEBUG] [LOCAL ] CI: Loaded 37661 existing records from primary storage. [2025-09-15T17:46:14.041169] [INFO ] [MAIN ] CI: Loaded 37661 existing records. [2025-09-15T17:46:14.063015] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-09-15T17:46:14.224364] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:46:14.224628] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-09-15T17:46:14.224698] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-09-15T17:46:14.225722] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-09-15T17:46:14.225780] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-09-15T17:46:14.593157] [INFO ] [REMOTE ] CI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:46:14.857915] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-09-15T17:46:15.128325] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-15T17:46:15.657883] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-09-15T17:46:16.457842] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-09-15T17:46:16.484610] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-15T17:46:17.062540] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T17:46:17.089490] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-15T17:46:17.257853] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-09-15T17:46:18.002582] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-15T17:46:18.057842] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-09-15T17:46:18.857901] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-09-15T17:46:18.970728] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-15T17:46:18.973187] [INFO ] [REMOTE ] CHT: Full fetch complete (21472 records). [2025-09-15T17:46:18.973275] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-09-15T17:46:19.332919] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-09-15T17:46:19.333000] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-09-15T17:46:19.333449] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-09-15T17:46:19.333489] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-09-15T17:46:19.334107] [DEBUG] [LOCAL ] CHT: Trimmed 21472 records to 14218 (keeping 150 days of data) [2025-09-15T17:46:19.421287] [DEBUG] [LOCAL ] CHT: Primary data saved (14218 records). [2025-09-15T17:46:19.421430] [INFO ] [MAIN ] CHT: Full history saved. [2025-09-15T17:46:19.421514] [INFO ] [MAIN ] Update Progress: 442/2369 symbols completed. CHT took 15.8s. Estimated remaining: 3h 21m 43s. Rate: 9.6 symbols/min [2025-09-15T17:46:19.599534] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:46:19.612556] [DEBUG] [LOCAL ] CIA: Loaded 12924 existing records from primary storage. [2025-09-15T17:46:19.612685] [INFO ] [MAIN ] CIA: Loaded 12924 existing records. [2025-09-15T17:46:19.662966] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-09-15T17:46:19.800679] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:46:19.800919] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-09-15T17:46:19.800968] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-09-15T17:46:19.801352] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-09-15T17:46:19.801401] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-09-15T17:46:20.157499] [INFO ] [REMOTE ] CIA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:46:20.457915] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-09-15T17:46:21.052623] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-15T17:46:21.257881] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-09-15T17:46:21.371530] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-15T17:46:22.057885] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-09-15T17:46:22.350697] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-15T17:46:22.386418] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-15T17:46:22.857873] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-09-15T17:46:23.657885] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-09-15T17:46:24.217441] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-15T17:46:24.457858] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-09-15T17:46:24.532443] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T17:46:25.041515] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-15T17:46:25.257898] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-09-15T17:46:25.524274] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-15T17:46:26.057914] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-09-15T17:46:26.183116] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-15T17:46:26.857876] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-09-15T17:46:27.575584] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-15T17:46:27.657900] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-09-15T17:46:28.089376] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-15T17:46:28.457913] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-09-15T17:46:29.260533] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-09-15T17:46:29.266998] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T17:46:29.934064] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T17:46:30.057873] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-09-15T17:46:30.857902] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-09-15T17:46:31.657907] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-09-15T17:46:31.776912] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-15T17:46:32.023590] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-09-15T17:46:32.068662] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-15T17:46:32.457900] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-09-15T17:46:33.257883] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-09-15T17:46:33.553702] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-15T17:46:34.065839] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-09-15T17:46:34.071240] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T17:46:34.341891] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-15T17:46:34.857880] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-09-15T17:46:35.657881] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-09-15T17:46:35.782897] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-15T17:46:35.969029] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-15T17:46:36.457901] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-09-15T17:46:37.257834] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-09-15T17:46:37.370758] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-15T17:46:37.853207] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T17:46:37.873028] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T17:46:37.874867] [INFO ] [REMOTE ] CIA: Full fetch complete (18219 records). [2025-09-15T17:46:37.874936] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-09-15T17:46:38.059216] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-09-15T17:46:38.249963] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-09-15T17:46:38.250046] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-09-15T17:46:38.250509] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-09-15T17:46:38.250558] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-09-15T17:46:38.251152] [DEBUG] [LOCAL ] CIA: Trimmed 18219 records to 12731 (keeping 150 days of data) [2025-09-15T17:46:38.322032] [DEBUG] [LOCAL ] CIA: Primary data saved (12731 records). [2025-09-15T17:46:38.322179] [INFO ] [MAIN ] CIA: Full history saved. [2025-09-15T17:46:38.322262] [INFO ] [MAIN ] Update Progress: 443/2369 symbols completed. CIA took 18.9s. Estimated remaining: 3h 22m 32s. Rate: 9.5 symbols/min [2025-09-15T17:46:38.488797] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:46:38.510373] [DEBUG] [LOCAL ] CIB: Loaded 22339 existing records from primary storage. [2025-09-15T17:46:38.510508] [INFO ] [MAIN ] CIB: Loaded 22339 existing records. [2025-09-15T17:46:38.683751] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:46:38.684005] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-09-15T17:46:38.684051] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-09-15T17:46:38.684678] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-09-15T17:46:38.684731] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-09-15T17:46:38.866608] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-09-15T17:46:39.042310] [INFO ] [REMOTE ] CIB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:46:39.387137] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-15T17:46:39.391491] [INFO ] [REMOTE ] CHPT: Full fetch complete (54741 records). [2025-09-15T17:46:39.391588] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-09-15T17:46:39.664603] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-09-15T17:46:39.764266] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-09-15T17:46:39.764350] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-09-15T17:46:39.765060] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-09-15T17:46:39.765108] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-09-15T17:46:39.766248] [DEBUG] [LOCAL ] CHPT: Trimmed 54741 records to 36128 (keeping 150 days of data) [2025-09-15T17:46:39.981058] [DEBUG] [LOCAL ] CHPT: Primary data saved (36128 records). [2025-09-15T17:46:39.981203] [INFO ] [MAIN ] CHPT: Full history saved. [2025-09-15T17:46:39.981678] [INFO ] [MAIN ] Update Progress: 444/2369 symbols completed. CHPT took 36.3s. Estimated remaining: 3h 22m 5s. Rate: 9.5 symbols/min [2025-09-15T17:46:40.157593] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:46:40.157850] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-09-15T17:46:40.157891] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-09-15T17:46:40.158056] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-09-15T17:46:40.158100] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-15T17:46:40.158147] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-15T17:46:40.158182] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-09-15T17:46:40.474006] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-09-15T17:46:40.513083] [INFO ] [REMOTE ] CICB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:46:40.813909] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-15T17:46:40.820277] [INFO ] [REMOTE ] CHWY: Full fetch complete (58297 records). [2025-09-15T17:46:40.820457] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-09-15T17:46:41.207070] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-09-15T17:46:41.207206] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-09-15T17:46:41.208177] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-09-15T17:46:41.208239] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-09-15T17:46:41.209738] [DEBUG] [LOCAL ] CHWY: Trimmed 58297 records to 39622 (keeping 150 days of data) [2025-09-15T17:46:41.261870] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-09-15T17:46:41.333778] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-15T17:46:41.342908] [INFO ] [REMOTE ] CI: Full fetch complete (54290 records). [2025-09-15T17:46:41.344295] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-09-15T17:46:41.867286] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-15T17:46:41.883301] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-09-15T17:46:41.884292] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-09-15T17:46:41.885378] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-09-15T17:46:41.886346] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-09-15T17:46:41.905524] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-15T17:46:41.914783] [DEBUG] [LOCAL ] CI: Trimmed 54290 records to 36930 (keeping 150 days of data) [2025-09-15T17:46:42.053945] [DEBUG] [LOCAL ] CHWY: Primary data saved (39622 records). [2025-09-15T17:46:42.055294] [INFO ] [MAIN ] CHWY: Full history saved. [2025-09-15T17:46:42.055850] [INFO ] [MAIN ] Update Progress: 445/2369 symbols completed. CHWY took 38.4s. Estimated remaining: 3h 21m 41s. Rate: 9.5 symbols/min [2025-09-15T17:46:42.066481] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-09-15T17:46:42.244684] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:46:42.383597] [DEBUG] [LOCAL ] CIEN: Loaded 39027 existing records from primary storage. [2025-09-15T17:46:42.386042] [DEBUG] [LOCAL ] CI: Primary data saved (36930 records). [2025-09-15T17:46:42.386158] [INFO ] [MAIN ] CIEN: Loaded 39027 existing records. [2025-09-15T17:46:42.417321] [INFO ] [MAIN ] CI: Full history saved. [2025-09-15T17:46:42.449588] [INFO ] [MAIN ] Update Progress: 446/2369 symbols completed. CI took 28.6s. Estimated remaining: 3h 21m 9s. Rate: 9.6 symbols/min [2025-09-15T17:46:42.556511] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-15T17:46:42.674106] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:46:42.714416] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-09-15T17:46:42.727913] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-09-15T17:46:42.744898] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-09-15T17:46:42.746510] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:46:42.746670] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-09-15T17:46:42.853259] [DEBUG] [LOCAL ] CIF: Loaded 2998 existing records from primary storage. [2025-09-15T17:46:42.853428] [INFO ] [MAIN ] CIF: Loaded 2998 existing records. [2025-09-15T17:46:42.869465] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-09-15T17:46:43.306600] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:46:43.310817] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-09-15T17:46:43.310896] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-09-15T17:46:43.310541] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:46:43.311265] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-09-15T17:46:43.311327] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-09-15T17:46:43.670336] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-09-15T17:46:43.674860] [INFO ] [REMOTE ] CIF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:46:43.893243] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-15T17:46:44.457892] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-09-15T17:46:45.226179] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T17:46:45.257822] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-09-15T17:46:46.024997] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T17:46:46.057821] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-09-15T17:46:46.857854] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-09-15T17:46:47.220552] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-15T17:46:47.234993] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-15T17:46:47.332917] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-15T17:46:47.657890] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-09-15T17:46:48.039383] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-15T17:46:48.457914] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-09-15T17:46:48.727039] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-15T17:46:49.257913] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-09-15T17:46:49.743897] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-15T17:46:50.057886] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-09-15T17:46:50.333207] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-15T17:46:50.857862] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-09-15T17:46:51.181420] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-15T17:46:51.657919] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-09-15T17:46:52.457983] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-09-15T17:46:53.074349] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T17:46:53.076690] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-15T17:46:53.077595] [INFO ] [REMOTE ] CICB: Full fetch complete (1455 records). [2025-09-15T17:46:53.088249] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-09-15T17:46:53.272168] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 147 unique days, need 150 days [2025-09-15T17:46:53.266862] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-09-15T17:46:53.272426] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:46:53.273260] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:46:53.273315] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-15T17:46:53.273366] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-15T17:46:53.273409] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-09-15T17:46:53.273452] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-09-15T17:46:53.273519] [INFO ] [MAIN ] Update Progress: 447/2369 symbols completed. CICB took 13.3s. Estimated remaining: 3h 21m 22s. Rate: 9.5 symbols/min [2025-09-15T17:46:53.510231] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:46:53.550618] [DEBUG] [LOCAL ] CIG: Loaded 33103 existing records from primary storage. [2025-09-15T17:46:53.550847] [INFO ] [MAIN ] CIG: Loaded 33103 existing records. [2025-09-15T17:46:53.741083] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:46:53.741525] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-09-15T17:46:53.741598] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-09-15T17:46:53.742687] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-09-15T17:46:53.742769] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-09-15T17:46:54.063147] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-09-15T17:46:54.122425] [INFO ] [REMOTE ] CIG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:46:54.857834] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-09-15T17:46:54.930230] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-15T17:46:54.949092] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-15T17:46:55.657894] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-09-15T17:46:56.394450] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-15T17:46:56.457875] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-09-15T17:46:57.140092] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-15T17:46:57.257812] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-09-15T17:46:57.704258] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-15T17:46:58.057886] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-09-15T17:46:58.472070] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-15T17:46:58.857867] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-09-15T17:46:59.154369] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-15T17:46:59.657870] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-09-15T17:47:00.288170] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T17:47:00.457888] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-09-15T17:47:01.109959] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-15T17:47:01.260163] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-09-15T17:47:01.265751] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T17:47:02.057914] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-09-15T17:47:02.076516] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-15T17:47:02.857891] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-09-15T17:47:03.161996] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-15T17:47:03.657878] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-09-15T17:47:04.110867] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-15T17:47:04.148830] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T17:47:04.457890] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-09-15T17:47:05.257945] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-09-15T17:47:05.568847] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-15T17:47:06.057867] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-09-15T17:47:06.217873] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-15T17:47:06.221937] [INFO ] [REMOTE ] CIB: Full fetch complete (34130 records). [2025-09-15T17:47:06.222026] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-09-15T17:47:06.602320] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-09-15T17:47:06.602408] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-09-15T17:47:06.603004] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-09-15T17:47:06.603084] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-09-15T17:47:06.604065] [DEBUG] [LOCAL ] CIB: Trimmed 34130 records to 21773 (keeping 150 days of data) [2025-09-15T17:47:06.735821] [DEBUG] [LOCAL ] CIB: Primary data saved (21773 records). [2025-09-15T17:47:06.735948] [INFO ] [MAIN ] CIB: Full history saved. [2025-09-15T17:47:06.736036] [INFO ] [MAIN ] Update Progress: 448/2369 symbols completed. CIB took 28.4s. Estimated remaining: 3h 21m 47s. Rate: 9.5 symbols/min [2025-09-15T17:47:06.862932] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-09-15T17:47:06.908332] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:47:06.923594] [DEBUG] [LOCAL ] CII: Loaded 10502 existing records from primary storage. [2025-09-15T17:47:06.923776] [INFO ] [MAIN ] CII: Loaded 10502 existing records. [2025-09-15T17:47:07.102707] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:47:07.102957] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-09-15T17:47:07.103005] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-09-15T17:47:07.103460] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-09-15T17:47:07.103536] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-09-15T17:47:07.393638] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-15T17:47:07.470386] [INFO ] [REMOTE ] CII: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:47:07.594885] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-15T17:47:07.657856] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-09-15T17:47:08.457908] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-09-15T17:47:09.019869] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-15T17:47:09.257887] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-09-15T17:47:09.860243] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-15T17:47:09.866291] [INFO ] [REMOTE ] CIEN: Full fetch complete (56648 records). [2025-09-15T17:47:09.866433] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-09-15T17:47:10.059613] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-09-15T17:47:10.277321] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-09-15T17:47:10.277445] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-09-15T17:47:10.278534] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-09-15T17:47:10.278588] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-09-15T17:47:10.280435] [DEBUG] [LOCAL ] CIEN: Trimmed 56648 records to 38272 (keeping 150 days of data) [2025-09-15T17:47:10.398755] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-15T17:47:10.407484] [INFO ] [REMOTE ] CIG: Full fetch complete (46846 records). [2025-09-15T17:47:10.408204] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-09-15T17:47:10.855307] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-15T17:47:10.858738] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-09-15T17:47:10.982708] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-09-15T17:47:10.988370] [DEBUG] [LOCAL ] CIEN: Primary data saved (38272 records). [2025-09-15T17:47:10.988757] [INFO ] [MAIN ] CIEN: Full history saved. [2025-09-15T17:47:10.988668] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-09-15T17:47:10.990174] [INFO ] [MAIN ] Update Progress: 449/2369 symbols completed. CIEN took 28.9s. Estimated remaining: 3h 21m 32s. Rate: 9.5 symbols/min [2025-09-15T17:47:10.991420] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-09-15T17:47:10.991700] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-09-15T17:47:11.095718] [DEBUG] [LOCAL ] CIG: Trimmed 46846 records to 32541 (keeping 150 days of data) [2025-09-15T17:47:11.167490] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:47:11.304246] [DEBUG] [LOCAL ] CIM: Loaded 27047 existing records from primary storage. [2025-09-15T17:47:11.306759] [INFO ] [MAIN ] CIM: Loaded 27047 existing records. [2025-09-15T17:47:11.544689] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:47:11.548123] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-09-15T17:47:11.554534] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-09-15T17:47:11.562757] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-09-15T17:47:11.571370] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-09-15T17:47:11.596899] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-15T17:47:11.660037] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-09-15T17:47:11.680129] [DEBUG] [LOCAL ] CIG: Primary data saved (32541 records). [2025-09-15T17:47:11.692778] [INFO ] [MAIN ] CIG: Full history saved. [2025-09-15T17:47:11.703966] [INFO ] [MAIN ] Update Progress: 450/2369 symbols completed. CIG took 18.4s. Estimated remaining: 3h 21m 1s. Rate: 9.5 symbols/min [2025-09-15T17:47:12.124314] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:47:12.138929] [INFO ] [REMOTE ] CIM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:47:12.145869] [DEBUG] [LOCAL ] CIMN: Loaded 2000 existing records from primary storage. [2025-09-15T17:47:12.146073] [INFO ] [MAIN ] CIMN: Loaded 2000 existing records. [2025-09-15T17:47:12.338321] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:47:12.338713] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-09-15T17:47:12.338770] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-09-15T17:47:12.339127] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-09-15T17:47:12.339189] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-09-15T17:47:12.460700] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-09-15T17:47:12.678201] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-15T17:47:12.741526] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:47:13.257935] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-09-15T17:47:13.285700] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-15T17:47:13.843946] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-15T17:47:14.057906] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-09-15T17:47:14.857909] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-09-15T17:47:15.160157] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-15T17:47:15.657889] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-09-15T17:47:16.146506] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-15T17:47:16.147490] [INFO ] [REMOTE ] CIF: Full fetch complete (5109 records). [2025-09-15T17:47:16.147560] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-09-15T17:47:16.477410] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-09-15T17:47:16.508382] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-09-15T17:47:16.508599] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-09-15T17:47:16.508853] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-09-15T17:47:16.509015] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-09-15T17:47:16.509579] [DEBUG] [LOCAL ] CIF: Trimmed 5109 records to 2943 (keeping 150 days of data) [2025-09-15T17:47:16.545740] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T17:47:16.557542] [DEBUG] [LOCAL ] CIF: Primary data saved (2943 records). [2025-09-15T17:47:16.557617] [INFO ] [MAIN ] CIF: Full history saved. [2025-09-15T17:47:16.557714] [INFO ] [MAIN ] Update Progress: 451/2369 symbols completed. CIF took 34.1s. Estimated remaining: 3h 20m 49s. Rate: 9.6 symbols/min [2025-09-15T17:47:16.728552] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:47:16.732055] [DEBUG] [LOCAL ] CIMO: Loaded 2054 existing records from primary storage. [2025-09-15T17:47:16.732126] [INFO ] [MAIN ] CIMO: Loaded 2054 existing records. [2025-09-15T17:47:16.903912] [WARN ] [MAIN ] CIMO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:47:16.904153] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-09-15T17:47:16.904204] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-15T17:47:16.904421] [DEBUG] [LOCAL ] CIMO: Deleted primary data file. [2025-09-15T17:47:16.904494] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-09-15T17:47:17.247668] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:47:17.257826] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-09-15T17:47:17.419823] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-15T17:47:17.828847] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-15T17:47:18.057885] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-09-15T17:47:18.685935] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-15T17:47:18.857893] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-09-15T17:47:19.657920] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-09-15T17:47:19.887749] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-15T17:47:20.015553] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-15T17:47:20.457915] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-09-15T17:47:21.025579] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-15T17:47:21.257868] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-09-15T17:47:21.579851] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-15T17:47:22.057874] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-09-15T17:47:22.461526] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-15T17:47:22.857923] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-09-15T17:47:23.376742] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-15T17:47:23.657886] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-09-15T17:47:24.457891] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-09-15T17:47:24.782339] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-15T17:47:25.262980] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-09-15T17:47:25.277428] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-15T17:47:25.594307] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-15T17:47:26.057917] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-09-15T17:47:26.857873] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-09-15T17:47:27.233746] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-15T17:47:27.538868] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-15T17:47:27.657881] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-09-15T17:47:28.457885] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-09-15T17:47:28.556430] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-15T17:47:28.934831] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-15T17:47:29.257860] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-09-15T17:47:29.909115] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-15T17:47:30.057880] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-09-15T17:47:30.857892] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-09-15T17:47:30.989148] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-15T17:47:31.328265] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-15T17:47:31.329356] [INFO ] [REMOTE ] CIMO: Full fetch complete (3150 records). [2025-09-15T17:47:31.329424] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-09-15T17:47:31.678349] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-09-15T17:47:31.687201] [DEBUG] [VALIDATOR ] CIMO: All expected trading days are present. [2025-09-15T17:47:31.687262] [DEBUG] [VALIDATOR ] CIMO: Primary data validation passed. [2025-09-15T17:47:31.687383] [INFO ] [MAIN ] CIMO: Fetched primary data is valid. [2025-09-15T17:47:31.687433] [DEBUG] [LOCAL ] CIMO: Saving primary data. [2025-09-15T17:47:31.687866] [DEBUG] [LOCAL ] CIMO: Trimmed 3150 records to 2027 (keeping 150 days of data) [2025-09-15T17:47:31.701260] [DEBUG] [LOCAL ] CIMO: Primary data saved (2027 records). [2025-09-15T17:47:31.701353] [INFO ] [MAIN ] CIMO: Full history saved. [2025-09-15T17:47:31.701430] [INFO ] [MAIN ] Update Progress: 452/2369 symbols completed. CIMO took 15.1s. Estimated remaining: 3h 21m 20s. Rate: 9.5 symbols/min [2025-09-15T17:47:31.879663] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:47:31.898441] [DEBUG] [LOCAL ] CINT: Loaded 13273 existing records from primary storage. [2025-09-15T17:47:31.898585] [INFO ] [MAIN ] CINT: Loaded 13273 existing records. [2025-09-15T17:47:32.080079] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:47:32.080329] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-09-15T17:47:32.080375] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-09-15T17:47:32.080911] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-09-15T17:47:32.080962] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-09-15T17:47:32.190834] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-15T17:47:32.438313] [INFO ] [REMOTE ] CINT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:47:32.457816] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-09-15T17:47:33.257901] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-09-15T17:47:33.558680] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-15T17:47:33.771910] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-15T17:47:34.057875] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-09-15T17:47:34.857867] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-09-15T17:47:34.905835] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-15T17:47:35.657901] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-09-15T17:47:35.723088] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-15T17:47:35.725357] [INFO ] [REMOTE ] CII: Full fetch complete (16921 records). [2025-09-15T17:47:35.725436] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-09-15T17:47:36.089288] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-09-15T17:47:36.089369] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-09-15T17:47:36.089744] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-09-15T17:47:36.089788] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-09-15T17:47:36.090414] [DEBUG] [LOCAL ] CII: Trimmed 16921 records to 10090 (keeping 150 days of data) [2025-09-15T17:47:36.158885] [DEBUG] [LOCAL ] CII: Primary data saved (10090 records). [2025-09-15T17:47:36.159046] [INFO ] [MAIN ] CII: Full history saved. [2025-09-15T17:47:36.159168] [INFO ] [MAIN ] Update Progress: 453/2369 symbols completed. CII took 29.4s. Estimated remaining: 3h 21m 6s. Rate: 9.5 symbols/min [2025-09-15T17:47:36.333859] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:47:36.349424] [DEBUG] [LOCAL ] CIO: Loaded 14685 existing records from primary storage. [2025-09-15T17:47:36.349594] [INFO ] [MAIN ] CIO: Loaded 14685 existing records. [2025-09-15T17:47:36.460635] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-09-15T17:47:36.539236] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:47:36.539487] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-09-15T17:47:36.539535] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-09-15T17:47:36.540003] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-09-15T17:47:36.540051] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-09-15T17:47:36.922101] [INFO ] [REMOTE ] CIO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:47:36.944962] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T17:47:37.165922] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-15T17:47:37.257872] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-09-15T17:47:38.057902] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-09-15T17:47:38.309234] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-15T17:47:38.857909] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-09-15T17:47:39.402248] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-15T17:47:39.492551] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T17:47:39.496886] [INFO ] [REMOTE ] CIM: Full fetch complete (40718 records). [2025-09-15T17:47:39.496998] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-09-15T17:47:39.668561] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-09-15T17:47:39.873370] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-09-15T17:47:39.873446] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-09-15T17:47:39.874065] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-09-15T17:47:39.874109] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-09-15T17:47:39.875989] [DEBUG] [LOCAL ] CIM: Trimmed 40718 records to 26357 (keeping 150 days of data) [2025-09-15T17:47:40.042924] [DEBUG] [LOCAL ] CIM: Primary data saved (26357 records). [2025-09-15T17:47:40.043059] [INFO ] [MAIN ] CIM: Full history saved. [2025-09-15T17:47:40.043183] [INFO ] [MAIN ] Update Progress: 454/2369 symbols completed. CIM took 29.1s. Estimated remaining: 3h 20m 50s. Rate: 9.5 symbols/min [2025-09-15T17:47:40.218362] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:47:40.239481] [DEBUG] [LOCAL ] CION: Loaded 20633 existing records from primary storage. [2025-09-15T17:47:40.239607] [INFO ] [MAIN ] CION: Loaded 20633 existing records. [2025-09-15T17:47:40.414444] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:47:40.414706] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-09-15T17:47:40.414760] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-09-15T17:47:40.415315] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-09-15T17:47:40.415363] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-09-15T17:47:40.469100] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-09-15T17:47:40.770526] [INFO ] [REMOTE ] CION: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:47:40.782033] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T17:47:40.967122] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-15T17:47:41.257848] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-09-15T17:47:41.702109] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-15T17:47:41.702929] [INFO ] [REMOTE ] CIMN: Full fetch complete (2866 records). [2025-09-15T17:47:41.702995] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-09-15T17:47:42.054687] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-09-15T17:47:42.054773] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-09-15T17:47:42.054872] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-09-15T17:47:42.054908] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-09-15T17:47:42.055251] [DEBUG] [LOCAL ] CIMN: Trimmed 2866 records to 1932 (keeping 150 days of data) [2025-09-15T17:47:42.062020] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-09-15T17:47:42.068691] [DEBUG] [LOCAL ] CIMN: Primary data saved (1932 records). [2025-09-15T17:47:42.068751] [INFO ] [MAIN ] CIMN: Full history saved. [2025-09-15T17:47:42.068835] [INFO ] [MAIN ] Update Progress: 455/2369 symbols completed. CIMN took 30.4s. Estimated remaining: 3h 20m 26s. Rate: 9.5 symbols/min [2025-09-15T17:47:42.239730] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:47:42.286859] [DEBUG] [LOCAL ] CIVI: Loaded 39579 existing records from primary storage. [2025-09-15T17:47:42.287003] [INFO ] [MAIN ] CIVI: Loaded 39579 existing records. [2025-09-15T17:47:42.499918] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:47:42.500165] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-09-15T17:47:42.500211] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-09-15T17:47:42.501090] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-09-15T17:47:42.501146] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-09-15T17:47:42.851444] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:47:42.857816] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-09-15T17:47:43.085052] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-15T17:47:43.657877] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-09-15T17:47:44.271007] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T17:47:44.457923] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-09-15T17:47:44.682289] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-15T17:47:45.257889] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-09-15T17:47:45.290489] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-15T17:47:46.057932] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-09-15T17:47:46.124409] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-15T17:47:46.857919] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-09-15T17:47:46.903851] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-15T17:47:47.658050] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-09-15T17:47:47.773978] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-15T17:47:48.457883] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-09-15T17:47:49.257928] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-09-15T17:47:49.348499] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T17:47:49.711826] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-15T17:47:50.057869] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-09-15T17:47:50.583455] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-15T17:47:50.695447] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-15T17:47:50.857866] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-09-15T17:47:51.657892] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-09-15T17:47:51.918290] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T17:47:51.921138] [INFO ] [REMOTE ] CIO: Full fetch complete (21210 records). [2025-09-15T17:47:51.921209] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-09-15T17:47:52.298059] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-09-15T17:47:52.298253] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-09-15T17:47:52.304064] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-09-15T17:47:52.307525] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-09-15T17:47:52.310685] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-15T17:47:52.314576] [DEBUG] [LOCAL ] CIO: Trimmed 21210 records to 14449 (keeping 150 days of data) [2025-09-15T17:47:52.407281] [DEBUG] [LOCAL ] CIO: Primary data saved (14449 records). [2025-09-15T17:47:52.407428] [INFO ] [MAIN ] CIO: Full history saved. [2025-09-15T17:47:52.407532] [INFO ] [MAIN ] Update Progress: 456/2369 symbols completed. CIO took 16.2s. Estimated remaining: 3h 20m 36s. Rate: 9.5 symbols/min [2025-09-15T17:47:52.462938] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-09-15T17:47:52.585998] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:47:52.632475] [DEBUG] [LOCAL ] CL: Loaded 40389 existing records from primary storage. [2025-09-15T17:47:52.632620] [INFO ] [MAIN ] CL: Loaded 40389 existing records. [2025-09-15T17:47:52.814765] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:47:52.814996] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-09-15T17:47:52.815041] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-09-15T17:47:52.815907] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-09-15T17:47:52.815955] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-09-15T17:47:53.172897] [INFO ] [REMOTE ] CL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:47:53.257839] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-09-15T17:47:53.916677] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T17:47:54.057875] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-09-15T17:47:54.682956] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-15T17:47:54.857863] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-09-15T17:47:55.657887] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-09-15T17:47:55.738313] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-15T17:47:56.268191] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-15T17:47:56.457902] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-09-15T17:47:57.246413] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-15T17:47:57.257811] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-09-15T17:47:57.567802] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T17:47:58.057873] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-09-15T17:47:58.638251] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-15T17:47:58.857851] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-09-15T17:47:59.196869] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-15T17:47:59.657869] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-09-15T17:48:00.333151] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T17:48:00.457820] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-09-15T17:48:00.802501] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-15T17:48:01.257913] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-09-15T17:48:01.832759] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T17:48:02.057876] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-09-15T17:48:02.316971] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T17:48:02.857877] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-09-15T17:48:03.657886] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-09-15T17:48:03.886811] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-15T17:48:04.167337] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T17:48:04.457910] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-09-15T17:48:04.549991] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-15T17:48:05.265282] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-09-15T17:48:05.268313] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T17:48:05.271878] [INFO ] [REMOTE ] CION: Full fetch complete (31447 records). [2025-09-15T17:48:05.271965] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-09-15T17:48:05.644690] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-09-15T17:48:05.644783] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-09-15T17:48:05.645296] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-09-15T17:48:05.645337] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-09-15T17:48:05.646084] [DEBUG] [LOCAL ] CION: Trimmed 31447 records to 20264 (keeping 150 days of data) [2025-09-15T17:48:05.771530] [DEBUG] [LOCAL ] CION: Primary data saved (20264 records). [2025-09-15T17:48:05.771677] [INFO ] [MAIN ] CION: Full history saved. [2025-09-15T17:48:05.771758] [INFO ] [MAIN ] Update Progress: 457/2369 symbols completed. CION took 25.7s. Estimated remaining: 3h 20m 60s. Rate: 9.5 symbols/min [2025-09-15T17:48:05.939945] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:48:05.964326] [DEBUG] [LOCAL ] CLB: Loaded 24690 existing records from primary storage. [2025-09-15T17:48:05.964629] [INFO ] [MAIN ] CLB: Loaded 24690 existing records. [2025-09-15T17:48:06.062288] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-09-15T17:48:06.140494] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:48:06.140758] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-09-15T17:48:06.140805] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-09-15T17:48:06.141516] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-09-15T17:48:06.141567] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-09-15T17:48:06.487820] [INFO ] [REMOTE ] CLB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:48:06.857855] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-09-15T17:48:06.968747] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-15T17:48:07.043988] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T17:48:07.050185] [INFO ] [REMOTE ] CINT: Full fetch complete (19747 records). [2025-09-15T17:48:07.050427] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-09-15T17:48:07.446888] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-09-15T17:48:07.446979] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-09-15T17:48:07.447509] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-09-15T17:48:07.447551] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-09-15T17:48:07.448219] [DEBUG] [LOCAL ] CINT: Trimmed 19747 records to 13303 (keeping 150 days of data) [2025-09-15T17:48:07.525131] [DEBUG] [LOCAL ] CINT: Primary data saved (13303 records). [2025-09-15T17:48:07.525282] [INFO ] [MAIN ] CINT: Full history saved. [2025-09-15T17:48:07.525367] [INFO ] [MAIN ] Update Progress: 458/2369 symbols completed. CINT took 35.8s. Estimated remaining: 3h 20m 34s. Rate: 9.5 symbols/min [2025-09-15T17:48:07.664561] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-09-15T17:48:07.695767] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:48:07.704982] [DEBUG] [LOCAL ] CLCO: Loaded 8144 existing records from primary storage. [2025-09-15T17:48:07.705096] [INFO ] [MAIN ] CLCO: Loaded 8144 existing records. [2025-09-15T17:48:07.885160] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:48:07.885456] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-09-15T17:48:07.885505] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-09-15T17:48:07.885860] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-09-15T17:48:07.885911] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-09-15T17:48:08.243346] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:48:08.457834] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-09-15T17:48:08.526330] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-15T17:48:08.779263] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-15T17:48:09.257933] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-09-15T17:48:10.031031] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T17:48:10.039746] [INFO ] [REMOTE ] CL: Full fetch complete (58319 records). [2025-09-15T17:48:10.039993] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-09-15T17:48:10.066708] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-09-15T17:48:10.429470] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-09-15T17:48:10.429564] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-09-15T17:48:10.430359] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-09-15T17:48:10.430419] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-09-15T17:48:10.431685] [DEBUG] [LOCAL ] CL: Trimmed 58319 records to 39609 (keeping 150 days of data) [2025-09-15T17:48:10.679699] [DEBUG] [LOCAL ] CL: Primary data saved (39609 records). [2025-09-15T17:48:10.679845] [INFO ] [MAIN ] CL: Full history saved. [2025-09-15T17:48:10.680428] [INFO ] [MAIN ] Update Progress: 459/2369 symbols completed. CL took 18.3s. Estimated remaining: 3h 20m 15s. Rate: 9.5 symbols/min [2025-09-15T17:48:10.856821] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:48:10.857834] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-09-15T17:48:10.876361] [DEBUG] [LOCAL ] CLDT: Loaded 18061 existing records from primary storage. [2025-09-15T17:48:10.876504] [INFO ] [MAIN ] CLDT: Loaded 18061 existing records. [2025-09-15T17:48:11.068125] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:48:11.068671] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-09-15T17:48:11.068738] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-09-15T17:48:11.074470] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-09-15T17:48:11.083591] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-09-15T17:48:11.114432] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-15T17:48:11.230322] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-15T17:48:11.495360] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:48:11.657858] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-09-15T17:48:12.062659] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-15T17:48:12.457927] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-09-15T17:48:12.574631] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-15T17:48:13.257886] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-09-15T17:48:13.690511] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T17:48:13.700293] [INFO ] [REMOTE ] CIVI: Full fetch complete (57093 records). [2025-09-15T17:48:13.700602] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-09-15T17:48:14.060550] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-09-15T17:48:14.124495] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-09-15T17:48:14.124674] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-09-15T17:48:14.125709] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-09-15T17:48:14.125787] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-09-15T17:48:14.127727] [DEBUG] [LOCAL ] CIVI: Trimmed 57093 records to 38791 (keeping 150 days of data) [2025-09-15T17:48:14.273580] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-15T17:48:14.433900] [DEBUG] [LOCAL ] CIVI: Primary data saved (38791 records). [2025-09-15T17:48:14.434152] [INFO ] [MAIN ] CIVI: Full history saved. [2025-09-15T17:48:14.434795] [INFO ] [MAIN ] Update Progress: 460/2369 symbols completed. CIVI took 32.4s. Estimated remaining: 3h 19m 58s. Rate: 9.5 symbols/min [2025-09-15T17:48:14.630690] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:48:14.679667] [DEBUG] [LOCAL ] CLF: Loaded 40482 existing records from primary storage. [2025-09-15T17:48:14.679889] [INFO ] [MAIN ] CLF: Loaded 40482 existing records. [2025-09-15T17:48:14.867700] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-09-15T17:48:14.876341] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:48:14.876683] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-09-15T17:48:14.876753] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-09-15T17:48:14.877801] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-09-15T17:48:14.877857] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-09-15T17:48:15.266836] [INFO ] [REMOTE ] CLF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:48:15.276325] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T17:48:15.657974] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-09-15T17:48:16.258878] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-15T17:48:16.457974] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-09-15T17:48:16.823140] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-15T17:48:17.257848] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-09-15T17:48:17.287694] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-15T17:48:18.057882] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-09-15T17:48:18.857894] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-09-15T17:48:19.225489] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-15T17:48:19.276720] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-15T17:48:19.577958] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-15T17:48:19.657961] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-09-15T17:48:20.457950] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-09-15T17:48:20.890326] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T17:48:21.257918] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-09-15T17:48:22.057895] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-09-15T17:48:22.292890] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-15T17:48:22.489264] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-15T17:48:22.857971] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-09-15T17:48:23.495728] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T17:48:23.657932] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-09-15T17:48:24.457841] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-09-15T17:48:24.609337] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-15T17:48:24.999586] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-15T17:48:25.257847] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-09-15T17:48:25.347818] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-15T17:48:26.057871] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-09-15T17:48:26.857928] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-09-15T17:48:27.069775] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-15T17:48:27.074110] [INFO ] [REMOTE ] CLB: Full fetch complete (35814 records). [2025-09-15T17:48:27.074286] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-09-15T17:48:27.467491] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-09-15T17:48:27.467693] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-09-15T17:48:27.468523] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-09-15T17:48:27.479413] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-09-15T17:48:27.498949] [DEBUG] [LOCAL ] CLB: Trimmed 35814 records to 24105 (keeping 150 days of data) [2025-09-15T17:48:27.500752] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-15T17:48:27.659403] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-09-15T17:48:27.665109] [DEBUG] [LOCAL ] CLB: Primary data saved (24105 records). [2025-09-15T17:48:27.665406] [INFO ] [MAIN ] CLB: Full history saved. [2025-09-15T17:48:27.665507] [INFO ] [MAIN ] Update Progress: 461/2369 symbols completed. CLB took 21.9s. Estimated remaining: 3h 20m 21s. Rate: 9.5 symbols/min [2025-09-15T17:48:27.837892] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:48:27.857725] [DEBUG] [LOCAL ] CLH: Loaded 20164 existing records from primary storage. [2025-09-15T17:48:27.857861] [INFO ] [MAIN ] CLH: Loaded 20164 existing records. [2025-09-15T17:48:28.049334] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:48:28.057558] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-09-15T17:48:28.057666] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-09-15T17:48:28.058408] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T17:48:28.062561] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-09-15T17:48:28.063101] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-09-15T17:48:28.429166] [INFO ] [REMOTE ] CLH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:48:28.457827] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-09-15T17:48:28.748459] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-15T17:48:28.751391] [INFO ] [REMOTE ] CLDT: Full fetch complete (28557 records). [2025-09-15T17:48:28.751500] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-09-15T17:48:29.153332] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-09-15T17:48:29.153415] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-09-15T17:48:29.153951] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-09-15T17:48:29.154001] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-09-15T17:48:29.154750] [DEBUG] [LOCAL ] CLDT: Trimmed 28557 records to 17486 (keeping 150 days of data) [2025-09-15T17:48:29.258721] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-09-15T17:48:29.261103] [DEBUG] [LOCAL ] CLDT: Primary data saved (17486 records). [2025-09-15T17:48:29.261185] [INFO ] [MAIN ] CLDT: Full history saved. [2025-09-15T17:48:29.261263] [INFO ] [MAIN ] Update Progress: 462/2369 symbols completed. CLDT took 18.6s. Estimated remaining: 3h 19m 55s. Rate: 9.5 symbols/min [2025-09-15T17:48:29.437877] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:48:29.448323] [DEBUG] [LOCAL ] CLPR: Loaded 7910 existing records from primary storage. [2025-09-15T17:48:29.448512] [INFO ] [MAIN ] CLPR: Loaded 7910 existing records. [2025-09-15T17:48:29.646690] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:48:29.647118] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-09-15T17:48:29.647270] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-09-15T17:48:29.647760] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-09-15T17:48:29.647858] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-09-15T17:48:29.961839] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-15T17:48:30.055755] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:48:30.057849] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-09-15T17:48:30.807033] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-15T17:48:30.857932] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-09-15T17:48:31.440269] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-15T17:48:31.460069] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-15T17:48:31.657880] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-09-15T17:48:32.280405] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-15T17:48:32.457900] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-09-15T17:48:33.257869] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-09-15T17:48:33.709682] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-15T17:48:34.057871] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-09-15T17:48:34.639592] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T17:48:34.857877] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-09-15T17:48:34.977840] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-15T17:48:35.657922] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-09-15T17:48:36.074898] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-15T17:48:36.457926] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-09-15T17:48:37.257895] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-09-15T17:48:37.290171] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-15T17:48:37.919841] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-15T17:48:37.995463] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-15T17:48:38.057825] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-09-15T17:48:38.857851] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-09-15T17:48:39.613584] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-15T17:48:39.657824] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-09-15T17:48:39.791799] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-15T17:48:40.457877] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-09-15T17:48:40.469680] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-15T17:48:41.257880] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-09-15T17:48:41.720843] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-15T17:48:41.771817] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-15T17:48:42.057869] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-09-15T17:48:42.731505] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-15T17:48:42.732941] [INFO ] [REMOTE ] CLPR: Full fetch complete (12576 records). [2025-09-15T17:48:42.733015] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-09-15T17:48:42.862966] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-09-15T17:48:43.104577] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-09-15T17:48:43.104692] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-09-15T17:48:43.105057] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-09-15T17:48:43.105099] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-09-15T17:48:43.105720] [DEBUG] [LOCAL ] CLPR: Trimmed 12576 records to 7760 (keeping 150 days of data) [2025-09-15T17:48:43.152262] [DEBUG] [LOCAL ] CLPR: Primary data saved (7760 records). [2025-09-15T17:48:43.152400] [INFO ] [MAIN ] CLPR: Full history saved. [2025-09-15T17:48:43.152508] [INFO ] [MAIN ] Update Progress: 463/2369 symbols completed. CLPR took 13.9s. Estimated remaining: 3h 20m 20s. Rate: 9.5 symbols/min [2025-09-15T17:48:43.323490] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:48:43.365289] [DEBUG] [LOCAL ] CLS: Loaded 40398 existing records from primary storage. [2025-09-15T17:48:43.365431] [INFO ] [MAIN ] CLS: Loaded 40398 existing records. [2025-09-15T17:48:43.541592] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:48:43.541867] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-09-15T17:48:43.541932] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-09-15T17:48:43.543001] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-09-15T17:48:43.543066] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-09-15T17:48:43.662945] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-09-15T17:48:43.909894] [INFO ] [REMOTE ] CLS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:48:44.450721] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-15T17:48:44.457805] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-09-15T17:48:44.964776] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-15T17:48:44.970716] [INFO ] [REMOTE ] CLF: Full fetch complete (58422 records). [2025-09-15T17:48:44.970870] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-09-15T17:48:45.077728] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T17:48:45.119564] [INFO ] [REMOTE ] CLCO: Full fetch complete (15593 records). [2025-09-15T17:48:45.138852] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-09-15T17:48:45.259933] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-09-15T17:48:45.681424] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-09-15T17:48:45.692661] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-09-15T17:48:45.709629] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-09-15T17:48:45.736795] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-09-15T17:48:45.771632] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-09-15T17:48:45.771842] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-09-15T17:48:45.772178] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-09-15T17:48:45.772318] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-09-15T17:48:45.773690] [DEBUG] [LOCAL ] CLCO: Trimmed 15593 records to 7925 (keeping 150 days of data) [2025-09-15T17:48:45.773500] [DEBUG] [LOCAL ] CLF: Trimmed 58422 records to 39702 (keeping 150 days of data) [2025-09-15T17:48:45.913477] [DEBUG] [LOCAL ] CLCO: Primary data saved (7925 records). [2025-09-15T17:48:45.922891] [INFO ] [MAIN ] CLCO: Full history saved. [2025-09-15T17:48:45.923410] [INFO ] [MAIN ] Update Progress: 464/2369 symbols completed. CLCO took 38.4s. Estimated remaining: 3h 19m 59s. Rate: 9.5 symbols/min [2025-09-15T17:48:46.060917] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-09-15T17:48:46.181755] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:48:46.270031] [DEBUG] [LOCAL ] CLVT: Loaded 39160 existing records from primary storage. [2025-09-15T17:48:46.270849] [INFO ] [MAIN ] CLVT: Loaded 39160 existing records. [2025-09-15T17:48:46.444967] [DEBUG] [LOCAL ] CLF: Primary data saved (39702 records). [2025-09-15T17:48:46.464995] [INFO ] [MAIN ] CLF: Full history saved. [2025-09-15T17:48:46.465154] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:48:46.466063] [INFO ] [MAIN ] Update Progress: 465/2369 symbols completed. CLF took 32.0s. Estimated remaining: 3h 19m 29s. Rate: 9.5 symbols/min [2025-09-15T17:48:46.466264] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-09-15T17:48:46.466598] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-09-15T17:48:46.504815] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-09-15T17:48:46.524500] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-09-15T17:48:46.752794] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:48:46.810769] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-15T17:48:46.890781] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-09-15T17:48:46.969196] [DEBUG] [LOCAL ] CLW: Loaded 15967 existing records from primary storage. [2025-09-15T17:48:46.975163] [INFO ] [MAIN ] CLW: Loaded 15967 existing records. [2025-09-15T17:48:47.160083] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:48:47.231011] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:48:47.231261] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-09-15T17:48:47.231311] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-09-15T17:48:47.231844] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-09-15T17:48:47.231906] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-09-15T17:48:47.597398] [INFO ] [REMOTE ] CLW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:48:47.657898] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-09-15T17:48:48.201068] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-15T17:48:48.463889] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-09-15T17:48:48.482156] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-09-15T17:48:48.536164] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-15T17:48:49.257891] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-09-15T17:48:50.057872] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-09-15T17:48:50.162855] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T17:48:50.857882] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-09-15T17:48:51.271830] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T17:48:51.446602] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-15T17:48:51.657872] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-09-15T17:48:52.457895] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-09-15T17:48:52.493394] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T17:48:52.813127] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-15T17:48:52.816135] [INFO ] [REMOTE ] CLH: Full fetch complete (31708 records). [2025-09-15T17:48:52.816216] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-09-15T17:48:53.187415] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-09-15T17:48:53.187494] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-09-15T17:48:53.188002] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-09-15T17:48:53.188061] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-09-15T17:48:53.188869] [DEBUG] [LOCAL ] CLH: Trimmed 31708 records to 19570 (keeping 150 days of data) [2025-09-15T17:48:53.276403] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-09-15T17:48:53.310920] [DEBUG] [LOCAL ] CLH: Primary data saved (19570 records). [2025-09-15T17:48:53.311037] [INFO ] [MAIN ] CLH: Full history saved. [2025-09-15T17:48:53.311130] [INFO ] [MAIN ] Update Progress: 466/2369 symbols completed. CLH took 25.6s. Estimated remaining: 3h 19m 25s. Rate: 9.5 symbols/min [2025-09-15T17:48:53.480243] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:48:53.529082] [DEBUG] [LOCAL ] CLX: Loaded 39046 existing records from primary storage. [2025-09-15T17:48:53.529262] [INFO ] [MAIN ] CLX: Loaded 39046 existing records. [2025-09-15T17:48:53.727723] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:48:53.728042] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-09-15T17:48:53.728103] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-09-15T17:48:53.729180] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-09-15T17:48:53.729245] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-09-15T17:48:54.063091] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-09-15T17:48:54.088924] [INFO ] [REMOTE ] CLX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:48:54.429209] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-15T17:48:54.617360] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-15T17:48:54.857877] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-09-15T17:48:55.657877] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-09-15T17:48:55.787810] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-15T17:48:56.002632] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-15T17:48:56.457914] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-09-15T17:48:57.257863] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-09-15T17:48:57.587733] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-15T17:48:58.029475] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-15T17:48:58.057903] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-09-15T17:48:58.825354] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T17:48:58.857904] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-09-15T17:48:59.657970] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-09-15T17:49:00.068237] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-15T17:49:00.430785] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-15T17:49:00.457835] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-09-15T17:49:00.651501] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T17:49:01.257932] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-09-15T17:49:02.039783] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-15T17:49:02.057835] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-09-15T17:49:02.857877] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-09-15T17:49:03.566972] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-15T17:49:03.657826] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-09-15T17:49:03.747705] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-15T17:49:03.883496] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-15T17:49:04.457874] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-09-15T17:49:05.257900] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-09-15T17:49:05.950035] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-15T17:49:05.951549] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-15T17:49:06.057903] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-09-15T17:49:06.105752] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-15T17:49:06.111368] [INFO ] [REMOTE ] CLVT: Full fetch complete (56681 records). [2025-09-15T17:49:06.111473] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-09-15T17:49:06.500724] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-09-15T17:49:06.500838] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-09-15T17:49:06.501665] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-09-15T17:49:06.501729] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-09-15T17:49:06.503054] [DEBUG] [LOCAL ] CLVT: Trimmed 56681 records to 38400 (keeping 150 days of data) [2025-09-15T17:49:06.732344] [DEBUG] [LOCAL ] CLVT: Primary data saved (38400 records). [2025-09-15T17:49:06.732534] [INFO ] [MAIN ] CLVT: Full history saved. [2025-09-15T17:49:06.733784] [INFO ] [MAIN ] Update Progress: 467/2369 symbols completed. CLVT took 20.8s. Estimated remaining: 3h 19m 48s. Rate: 9.5 symbols/min [2025-09-15T17:49:06.862980] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-09-15T17:49:06.912677] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:49:06.955187] [DEBUG] [LOCAL ] CM: Loaded 36406 existing records from primary storage. [2025-09-15T17:49:06.955380] [INFO ] [MAIN ] CM: Loaded 36406 existing records. [2025-09-15T17:49:07.149582] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:49:07.149900] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-09-15T17:49:07.149984] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-09-15T17:49:07.151019] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-09-15T17:49:07.151083] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-09-15T17:49:07.517840] [INFO ] [REMOTE ] CM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:49:07.657868] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-09-15T17:49:07.729888] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-15T17:49:08.295657] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-15T17:49:08.301843] [INFO ] [REMOTE ] CLS: Full fetch complete (58323 records). [2025-09-15T17:49:08.301979] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-09-15T17:49:08.462957] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-09-15T17:49:08.695066] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-09-15T17:49:08.695177] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-09-15T17:49:08.695905] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-09-15T17:49:08.695951] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-09-15T17:49:08.697224] [DEBUG] [LOCAL ] CLS: Trimmed 58323 records to 39616 (keeping 150 days of data) [2025-09-15T17:49:08.952836] [DEBUG] [LOCAL ] CLS: Primary data saved (39616 records). [2025-09-15T17:49:08.952997] [INFO ] [MAIN ] CLS: Full history saved. [2025-09-15T17:49:08.953485] [INFO ] [MAIN ] Update Progress: 468/2369 symbols completed. CLS took 25.8s. Estimated remaining: 3h 19m 25s. Rate: 9.5 symbols/min [2025-09-15T17:49:09.132936] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:49:09.176955] [DEBUG] [LOCAL ] CMA: Loaded 37599 existing records from primary storage. [2025-09-15T17:49:09.177120] [INFO ] [MAIN ] CMA: Loaded 37599 existing records. [2025-09-15T17:49:09.262268] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-09-15T17:49:09.368221] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:49:09.368543] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-09-15T17:49:09.368696] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-09-15T17:49:09.369631] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-09-15T17:49:09.390761] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-09-15T17:49:09.459933] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-15T17:49:09.770868] [INFO ] [REMOTE ] CMA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:49:10.057877] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-09-15T17:49:10.168767] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-15T17:49:10.171503] [INFO ] [REMOTE ] CLW: Full fetch complete (24644 records). [2025-09-15T17:49:10.171577] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-09-15T17:49:10.536740] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-09-15T17:49:10.536821] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-09-15T17:49:10.537252] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-09-15T17:49:10.537291] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-09-15T17:49:10.537923] [DEBUG] [LOCAL ] CLW: Trimmed 24644 records to 15618 (keeping 150 days of data) [2025-09-15T17:49:10.634820] [DEBUG] [LOCAL ] CLW: Primary data saved (15618 records). [2025-09-15T17:49:10.635073] [INFO ] [MAIN ] CLW: Full history saved. [2025-09-15T17:49:10.635233] [INFO ] [MAIN ] Update Progress: 469/2369 symbols completed. CLW took 24.2s. Estimated remaining: 3h 19m 0s. Rate: 9.5 symbols/min [2025-09-15T17:49:10.806288] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:49:10.844101] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-15T17:49:10.861087] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-09-15T17:49:10.861435] [DEBUG] [LOCAL ] CMBT: Loaded 16797 existing records from primary storage. [2025-09-15T17:49:10.862446] [INFO ] [MAIN ] CMBT: Loaded 16797 existing records. [2025-09-15T17:49:11.045183] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:49:11.045513] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-09-15T17:49:11.045566] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-09-15T17:49:11.046027] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-09-15T17:49:11.046086] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-09-15T17:49:11.430195] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:49:11.657835] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-09-15T17:49:11.685908] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-15T17:49:12.457857] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-09-15T17:49:12.621911] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T17:49:12.678036] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-15T17:49:13.257873] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-09-15T17:49:14.019395] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T17:49:14.057828] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-09-15T17:49:14.373462] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-15T17:49:14.857905] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-09-15T17:49:15.657921] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-09-15T17:49:15.731404] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T17:49:16.360131] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-15T17:49:16.457867] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-09-15T17:49:16.733206] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-15T17:49:17.257916] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-09-15T17:49:18.057923] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-09-15T17:49:18.235797] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-15T17:49:18.342891] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-15T17:49:18.857903] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-09-15T17:49:19.570780] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-15T17:49:19.657939] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-09-15T17:49:20.463966] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-09-15T17:49:20.476737] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-15T17:49:21.257885] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-09-15T17:49:21.446025] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-15T17:49:21.641190] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-15T17:49:22.057912] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-09-15T17:49:22.809670] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T17:49:22.857821] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-09-15T17:49:22.944542] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-15T17:49:23.657869] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-09-15T17:49:24.308073] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-15T17:49:24.457922] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-09-15T17:49:24.945582] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-15T17:49:25.257884] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-09-15T17:49:25.661239] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-15T17:49:26.057950] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-09-15T17:49:26.857896] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-09-15T17:49:26.906154] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-15T17:49:27.217756] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-15T17:49:27.657915] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-09-15T17:49:27.989939] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-15T17:49:28.457876] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-09-15T17:49:29.120839] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T17:49:29.257889] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-09-15T17:49:30.036257] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T17:49:30.057813] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-09-15T17:49:30.423145] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-15T17:49:30.857883] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-09-15T17:49:31.506736] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-15T17:49:31.511803] [INFO ] [REMOTE ] CM: Full fetch complete (52284 records). [2025-09-15T17:49:31.511952] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-09-15T17:49:31.512843] [FATAL] [VALIDATOR ] CM: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:49:31.512927] [FATAL] [MAIN ] CM: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:49:31.512965] [WARN ] [MAIN ] CM: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:49:31.513004] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-09-15T17:49:31.513075] [DEBUG] [LOCAL ] CM: No primary data file found to delete. [2025-09-15T17:49:31.513116] [INFO ] [LOCAL ] CM: Starting deletion of derivative data. [2025-09-15T17:49:31.513460] [DEBUG] [LOCAL ] CM: Deleted derivative data file. [2025-09-15T17:49:31.513879] [INFO ] [MAIN ] Update Progress: 470/2369 symbols completed. CM took 24.8s. Estimated remaining: 3h 19m 53s. Rate: 9.5 symbols/min [2025-09-15T17:49:31.664184] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-09-15T17:49:31.692219] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:49:31.733493] [DEBUG] [LOCAL ] CMC: Loaded 33573 existing records from primary storage. [2025-09-15T17:49:31.733667] [INFO ] [MAIN ] CMC: Loaded 33573 existing records. [2025-09-15T17:49:31.915940] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:49:31.916216] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-09-15T17:49:31.916267] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-09-15T17:49:31.917175] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-09-15T17:49:31.917233] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-09-15T17:49:32.272134] [INFO ] [REMOTE ] CMC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:49:32.457893] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-09-15T17:49:32.631451] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-15T17:49:32.637322] [INFO ] [REMOTE ] CMBT: Full fetch complete (21765 records). [2025-09-15T17:49:32.637433] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-09-15T17:49:33.002569] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-09-15T17:49:33.002666] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-09-15T17:49:33.003087] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-09-15T17:49:33.003145] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-09-15T17:49:33.003822] [DEBUG] [LOCAL ] CMBT: Trimmed 21765 records to 16946 (keeping 150 days of data) [2025-09-15T17:49:33.104777] [DEBUG] [LOCAL ] CMBT: Primary data saved (16946 records). [2025-09-15T17:49:33.104930] [INFO ] [MAIN ] CMBT: Full history saved. [2025-09-15T17:49:33.105041] [INFO ] [MAIN ] Update Progress: 471/2369 symbols completed. CMBT took 22.5s. Estimated remaining: 3h 19m 27s. Rate: 9.5 symbols/min [2025-09-15T17:49:33.262757] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-09-15T17:49:33.290025] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:49:33.308779] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T17:49:33.317233] [DEBUG] [LOCAL ] CMCM: Loaded 3310 existing records from primary storage. [2025-09-15T17:49:33.317478] [INFO ] [MAIN ] CMCM: Loaded 3310 existing records. [2025-09-15T17:49:33.362301] [INFO ] [REMOTE ] CMA: Full fetch complete (54817 records). [2025-09-15T17:49:33.390109] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-09-15T17:49:33.646047] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:49:33.701280] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-09-15T17:49:33.717315] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-09-15T17:49:33.783545] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-09-15T17:49:33.794435] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-09-15T17:49:34.060911] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-09-15T17:49:34.070548] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-09-15T17:49:34.079635] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-09-15T17:49:34.096043] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-09-15T17:49:34.208816] [DEBUG] [LOCAL ] CMA: Trimmed 54817 records to 36840 (keeping 150 days of data) [2025-09-15T17:49:34.336355] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:49:34.373053] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-09-15T17:49:34.408596] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-15T17:49:34.431470] [INFO ] [REMOTE ] CLX: Full fetch complete (55672 records). [2025-09-15T17:49:34.431637] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-09-15T17:49:34.811754] [DEBUG] [LOCAL ] CMA: Primary data saved (36840 records). [2025-09-15T17:49:34.836061] [INFO ] [MAIN ] CMA: Full history saved. [2025-09-15T17:49:34.836874] [INFO ] [MAIN ] Update Progress: 472/2369 symbols completed. CMA took 25.9s. Estimated remaining: 3h 19m 3s. Rate: 9.5 symbols/min [2025-09-15T17:49:35.058070] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-09-15T17:49:35.058183] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-09-15T17:49:35.059471] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-09-15T17:49:35.085632] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-09-15T17:49:35.137738] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:49:35.138047] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-09-15T17:49:35.138177] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-09-15T17:49:35.138711] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-09-15T17:49:35.138875] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-15T17:49:35.142820] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-15T17:49:35.145450] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T17:49:35.145875] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-09-15T17:49:35.153927] [DEBUG] [LOCAL ] CLX: Trimmed 55672 records to 38387 (keeping 150 days of data) [2025-09-15T17:49:35.154701] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-09-15T17:49:35.444081] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-15T17:49:35.711909] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-09-15T17:49:35.780050] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-15T17:49:35.843358] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:49:35.871212] [DEBUG] [LOCAL ] CLX: Primary data saved (38387 records). [2025-09-15T17:49:35.871405] [INFO ] [MAIN ] CLX: Full history saved. [2025-09-15T17:49:35.873898] [INFO ] [MAIN ] Update Progress: 473/2369 symbols completed. CLX took 42.6s. Estimated remaining: 3h 18m 35s. Rate: 9.5 symbols/min [2025-09-15T17:49:36.064704] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:49:36.112626] [DEBUG] [LOCAL ] CMG: Loaded 40465 existing records from primary storage. [2025-09-15T17:49:36.112786] [INFO ] [MAIN ] CMG: Loaded 40465 existing records. [2025-09-15T17:49:36.289303] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:49:36.289595] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-09-15T17:49:36.289665] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-09-15T17:49:36.290574] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-09-15T17:49:36.290625] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-09-15T17:49:36.461447] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-09-15T17:49:36.648020] [INFO ] [REMOTE ] CMG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:49:37.257914] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-09-15T17:49:37.297485] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-15T17:49:37.338051] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-15T17:49:38.057880] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-02. [2025-09-15T17:49:38.262507] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:49:38.262855] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-02 [2025-09-15T17:49:38.857869] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-09-15T17:49:39.489178] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-15T17:49:39.657911] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-09-15T17:49:40.410840] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T17:49:40.457904] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-09-15T17:49:41.233003] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T17:49:41.257844] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-09-15T17:49:41.597462] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-15T17:49:42.057878] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-09-15T17:49:42.499051] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-15T17:49:42.854981] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-15T17:49:42.865513] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-09-15T17:49:43.657888] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-03. [2025-09-15T17:49:43.844864] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:49:43.845215] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-03 [2025-09-15T17:49:43.996340] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-15T17:49:44.457881] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-09-15T17:49:45.257886] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-09-15T17:49:45.694661] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-15T17:49:46.057894] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-04. [2025-09-15T17:49:46.221041] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-15T17:49:46.248914] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:49:46.249213] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-04 [2025-09-15T17:49:46.857878] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-05. [2025-09-15T17:49:47.657901] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-09-15T17:49:47.990298] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-15T17:49:48.014122] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-15T17:49:48.457911] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-09-15T17:49:49.096745] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-15T17:49:49.257889] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-09-15T17:49:50.057881] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-09-15T17:49:50.853030] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-15T17:49:50.855003] [INFO ] [REMOTE ] CMCM: Full fetch complete (5315 records). [2025-09-15T17:49:50.855079] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-09-15T17:49:50.877397] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-09-15T17:49:51.131466] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-15T17:49:51.362543] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-09-15T17:49:51.362721] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-09-15T17:49:51.363012] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-09-15T17:49:51.363110] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-09-15T17:49:51.363840] [DEBUG] [LOCAL ] CMCM: Trimmed 5315 records to 3391 (keeping 150 days of data) [2025-09-15T17:49:51.390595] [DEBUG] [LOCAL ] CMCM: Primary data saved (3391 records). [2025-09-15T17:49:51.390814] [INFO ] [MAIN ] CMCM: Full history saved. [2025-09-15T17:49:51.390939] [INFO ] [MAIN ] Update Progress: 474/2369 symbols completed. CMCM took 18.3s. Estimated remaining: 3h 19m 6s. Rate: 9.5 symbols/min [2025-09-15T17:49:51.663422] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-06. [2025-09-15T17:49:51.669022] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:49:51.719485] [DEBUG] [LOCAL ] CMI: Loaded 30752 existing records from primary storage. [2025-09-15T17:49:51.719724] [INFO ] [MAIN ] CMI: Loaded 30752 existing records. [2025-09-15T17:49:51.980075] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:49:51.980382] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-09-15T17:49:51.980433] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-09-15T17:49:51.981230] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-09-15T17:49:51.981284] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-09-15T17:49:52.360939] [INFO ] [REMOTE ] CMI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:49:52.457870] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-09-15T17:49:52.560955] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-15T17:49:52.841286] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-15T17:49:53.257864] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-09-15T17:49:53.760299] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-15T17:49:54.057874] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-09-15T17:49:54.398501] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-15T17:49:54.857873] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-09-15T17:49:55.657955] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-07. [2025-09-15T17:49:56.031932] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-15T17:49:56.203085] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T17:49:56.208401] [INFO ] [REMOTE ] CMC: Full fetch complete (49791 records). [2025-09-15T17:49:56.208548] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-09-15T17:49:56.414046] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-15T17:49:56.461039] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-09-15T17:49:56.604929] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-09-15T17:49:56.605012] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-09-15T17:49:56.605630] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-09-15T17:49:56.605691] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-09-15T17:49:56.606719] [DEBUG] [LOCAL ] CMC: Trimmed 49791 records to 32872 (keeping 150 days of data) [2025-09-15T17:49:56.816727] [DEBUG] [LOCAL ] CMC: Primary data saved (32872 records). [2025-09-15T17:49:56.816878] [INFO ] [MAIN ] CMC: Full history saved. [2025-09-15T17:49:56.817845] [INFO ] [MAIN ] Update Progress: 475/2369 symbols completed. CMC took 25.3s. Estimated remaining: 3h 18m 56s. Rate: 9.5 symbols/min [2025-09-15T17:49:56.984884] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:49:57.014255] [DEBUG] [LOCAL ] CMP: Loaded 28011 existing records from primary storage. [2025-09-15T17:49:57.014400] [INFO ] [MAIN ] CMP: Loaded 28011 existing records. [2025-09-15T17:49:57.197172] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:49:57.197407] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-09-15T17:49:57.197453] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-09-15T17:49:57.198133] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-09-15T17:49:57.198204] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-09-15T17:49:57.263401] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-08. [2025-09-15T17:49:57.567396] [INFO ] [REMOTE ] CMP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:49:58.057911] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-09-15T17:49:58.178055] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-15T17:49:58.852246] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-15T17:49:58.863042] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-09. [2025-09-15T17:49:59.657859] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-09-15T17:49:59.717331] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-15T17:49:59.841330] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T17:49:59.843272] [INFO ] [REMOTE ] CMDB: Full fetch complete (10179 records). [2025-09-15T17:49:59.843376] [DEBUG] [VALIDATOR ] CMDB: Validating primary data. [2025-09-15T17:49:59.843786] [FATAL] [VALIDATOR ] CMDB: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:49:59.843861] [FATAL] [MAIN ] CMDB: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:49:59.843908] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:49:59.843948] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-15T17:49:59.844004] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-15T17:49:59.844039] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-09-15T17:49:59.844093] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-09-15T17:49:59.844149] [INFO ] [MAIN ] Update Progress: 476/2369 symbols completed. CMDB took 25.0s. Estimated remaining: 3h 18m 37s. Rate: 9.5 symbols/min [2025-09-15T17:50:00.015297] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:50:00.047089] [DEBUG] [LOCAL ] CMRE: Loaded 26592 existing records from primary storage. [2025-09-15T17:50:00.047237] [INFO ] [MAIN ] CMRE: Loaded 26592 existing records. [2025-09-15T17:50:00.228143] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:50:00.228402] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-09-15T17:50:00.228448] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-09-15T17:50:00.229192] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-09-15T17:50:00.229243] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-09-15T17:50:00.468688] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-09-15T17:50:00.597103] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:50:01.257962] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-09-15T17:50:01.921727] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-15T17:50:01.930954] [INFO ] [REMOTE ] CMG: Full fetch complete (58398 records). [2025-09-15T17:50:01.931174] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-09-15T17:50:02.063090] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-09-15T17:50:02.348910] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-09-15T17:50:02.349037] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-09-15T17:50:02.349840] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-09-15T17:50:02.349897] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-09-15T17:50:02.351265] [DEBUG] [LOCAL ] CMG: Trimmed 58398 records to 39687 (keeping 150 days of data) [2025-09-15T17:50:02.594226] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-15T17:50:02.635236] [DEBUG] [LOCAL ] CMG: Primary data saved (39687 records). [2025-09-15T17:50:02.635406] [INFO ] [MAIN ] CMG: Full history saved. [2025-09-15T17:50:02.636634] [INFO ] [MAIN ] Update Progress: 477/2369 symbols completed. CMG took 26.8s. Estimated remaining: 3h 18m 17s. Rate: 9.5 symbols/min [2025-09-15T17:50:02.857890] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-09-15T17:50:02.945401] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T17:50:03.568405] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-15T17:50:03.657908] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-09-15T17:50:04.056508] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-15T17:50:04.457902] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-09-15T17:50:04.953485] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-15T17:50:05.257888] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-09-15T17:50:05.782249] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-15T17:50:06.057895] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-09-15T17:50:06.769107] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-15T17:50:06.857906] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-09-15T17:50:07.324120] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-15T17:50:07.657994] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-09-15T17:50:08.212724] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T17:50:08.457936] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-09-15T17:50:08.846959] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T17:50:09.257876] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-09-15T17:50:09.404239] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-15T17:50:10.057925] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-09-15T17:50:10.549216] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-15T17:50:10.857921] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-09-15T17:50:11.628772] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T17:50:11.657953] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-09-15T17:50:11.803956] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T17:50:12.457939] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-09-15T17:50:12.676024] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-15T17:50:13.257913] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-09-15T17:50:13.733806] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T17:50:14.057921] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-09-15T17:50:14.566899] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-15T17:50:14.571036] [INFO ] [REMOTE ] CMP: Full fetch complete (40429 records). [2025-09-15T17:50:14.571175] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-09-15T17:50:14.863039] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-09-15T17:50:14.963488] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-09-15T17:50:14.963571] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-09-15T17:50:14.964189] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-09-15T17:50:14.964236] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-09-15T17:50:14.965224] [DEBUG] [LOCAL ] CMP: Trimmed 40429 records to 27389 (keeping 150 days of data) [2025-09-15T17:50:15.129241] [DEBUG] [LOCAL ] CMP: Primary data saved (27389 records). [2025-09-15T17:50:15.129438] [INFO ] [MAIN ] CMP: Full history saved. [2025-09-15T17:50:15.129543] [INFO ] [MAIN ] Update Progress: 478/2369 symbols completed. CMP took 18.3s. Estimated remaining: 3h 18m 35s. Rate: 9.5 symbols/min [2025-09-15T17:50:15.138767] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-15T17:50:15.142422] [INFO ] [REMOTE ] CMRE: Full fetch complete (38876 records). [2025-09-15T17:50:15.142507] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-09-15T17:50:15.526018] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-09-15T17:50:15.526136] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-09-15T17:50:15.527195] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-09-15T17:50:15.527402] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-09-15T17:50:15.528756] [DEBUG] [LOCAL ] CMRE: Trimmed 38876 records to 26054 (keeping 150 days of data) [2025-09-15T17:50:15.682314] [DEBUG] [LOCAL ] CMRE: Primary data saved (26054 records). [2025-09-15T17:50:15.682465] [INFO ] [MAIN ] CMRE: Full history saved. [2025-09-15T17:50:15.682554] [INFO ] [MAIN ] Update Progress: 479/2369 symbols completed. CMRE took 15.8s. Estimated remaining: 3h 18m 6s. Rate: 9.5 symbols/min [2025-09-15T17:50:16.291586] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T17:50:16.299741] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-09-15T17:50:17.883673] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-15T17:50:17.893144] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-09-15T17:50:19.156362] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T17:50:19.165155] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-09-15T17:50:20.298850] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-15T17:50:20.303508] [INFO ] [REMOTE ] CMI: Full fetch complete (45436 records). [2025-09-15T17:50:20.303596] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-09-15T17:50:20.685683] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-09-15T17:50:20.685767] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-09-15T17:50:20.686434] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-09-15T17:50:20.686483] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-09-15T17:50:20.687466] [DEBUG] [LOCAL ] CMI: Trimmed 45436 records to 30182 (keeping 150 days of data) [2025-09-15T17:50:20.878945] [DEBUG] [LOCAL ] CMI: Primary data saved (30182 records). [2025-09-15T17:50:20.879082] [INFO ] [MAIN ] CMI: Full history saved. [2025-09-15T17:50:20.879380] [INFO ] [MAIN ] Update Progress: 480/2369 symbols completed. CMI took 29.5s. Estimated remaining: 3h 17m 55s. Rate: 9.5 symbols/min [2025-09-15T17:50:21.485443] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:50:21.582122] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:50:21.585532] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:50:21.586773] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:50:21.591890] [DEBUG] [LOCAL ] CMSA: Loaded 2560 existing records from primary storage. [2025-09-15T17:50:21.592043] [INFO ] [MAIN ] CMSA: Loaded 2560 existing records. [2025-09-15T17:50:21.659540] [DEBUG] [LOCAL ] CMSC: Loaded 3570 existing records from primary storage. [2025-09-15T17:50:21.702404] [INFO ] [MAIN ] CMSC: Loaded 3570 existing records. [2025-09-15T17:50:21.694127] [DEBUG] [LOCAL ] CMSD: Loaded 5819 existing records from primary storage. [2025-09-15T17:50:21.723737] [INFO ] [MAIN ] CMSD: Loaded 5819 existing records. [2025-09-15T17:50:21.950117] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:50:22.006553] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-09-15T17:50:22.057085] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-09-15T17:50:22.097584] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-09-15T17:50:22.108690] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:50:22.108910] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-09-15T17:50:22.126223] [DEBUG] [LOCAL ] CMS: Loaded 39684 existing records from primary storage. [2025-09-15T17:50:22.140822] [INFO ] [MAIN ] CMS: Loaded 39684 existing records. [2025-09-15T17:50:22.243692] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:50:22.293366] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-09-15T17:50:22.293305] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-09-15T17:50:22.304960] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-09-15T17:50:22.349715] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-09-15T17:50:22.363153] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-09-15T17:50:22.373533] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-09-15T17:50:22.410846] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-09-15T17:50:22.416422] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-09-15T17:50:22.706321] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:50:22.810500] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-09-15T17:50:22.849127] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-09-15T17:50:22.913838] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-09-15T17:50:22.997479] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-09-15T17:50:23.292419] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:50:23.327025] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-09-15T17:50:23.432250] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:50:23.462905] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-09-15T17:50:23.523563] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:50:23.539614] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-09-15T17:50:23.777823] [INFO ] [REMOTE ] CMS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:50:23.778194] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-09-15T17:50:24.100034] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-15T17:50:24.101310] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-09-15T17:50:24.112595] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-15T17:50:24.113949] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-09-15T17:50:24.347612] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-15T17:50:24.349455] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-09-15T17:50:24.434551] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-15T17:50:24.435860] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-09-15T17:50:24.544419] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-15T17:50:24.553464] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-09-15T17:50:24.806743] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-15T17:50:24.983662] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-15T17:50:25.130631] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T17:50:25.257915] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-09-15T17:50:25.283816] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-15T17:50:25.850774] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-15T17:50:26.057885] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-09-15T17:50:26.670417] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-15T17:50:26.857876] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-09-15T17:50:27.278785] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-15T17:50:27.657932] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-09-15T17:50:28.365114] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-15T17:50:28.457886] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-09-15T17:50:28.879810] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-15T17:50:29.257885] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-09-15T17:50:29.971593] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-15T17:50:30.057884] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-09-15T17:50:30.622500] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-15T17:50:30.857872] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-09-15T17:50:31.657896] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-09-15T17:50:32.046892] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-15T17:50:32.431349] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-15T17:50:32.457872] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-09-15T17:50:33.257877] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-09-15T17:50:33.672382] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-15T17:50:34.057872] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-09-15T17:50:34.270447] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-15T17:50:34.547908] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-15T17:50:34.857923] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-09-15T17:50:35.534005] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-15T17:50:35.535336] [INFO ] [REMOTE ] CMSD: Full fetch complete (8717 records). [2025-09-15T17:50:35.535407] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-09-15T17:50:35.673928] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-09-15T17:50:35.900285] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-09-15T17:50:35.900365] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-09-15T17:50:35.900602] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-09-15T17:50:35.900663] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-09-15T17:50:35.901090] [DEBUG] [LOCAL ] CMSD: Trimmed 8717 records to 5630 (keeping 150 days of data) [2025-09-15T17:50:35.935382] [DEBUG] [LOCAL ] CMSD: Primary data saved (5630 records). [2025-09-15T17:50:35.935479] [INFO ] [MAIN ] CMSD: Full history saved. [2025-09-15T17:50:35.935561] [INFO ] [MAIN ] Update Progress: 481/2369 symbols completed. CMSD took 15.1s. Estimated remaining: 3h 18m 23s. Rate: 9.5 symbols/min [2025-09-15T17:50:36.101767] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:50:36.128579] [DEBUG] [LOCAL ] CMTG: Loaded 27084 existing records from primary storage. [2025-09-15T17:50:36.128762] [INFO ] [MAIN ] CMTG: Loaded 27084 existing records. [2025-09-15T17:50:36.310328] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:50:36.310673] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-09-15T17:50:36.310723] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-09-15T17:50:36.311421] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-09-15T17:50:36.311470] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-09-15T17:50:36.415210] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-15T17:50:36.465678] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-09-15T17:50:36.665292] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:50:37.257877] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-09-15T17:50:38.057880] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-09-15T17:50:38.242230] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-15T17:50:38.346917] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-15T17:50:38.621323] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-15T17:50:38.857875] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-09-15T17:50:39.657894] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-09-15T17:50:40.132535] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-15T17:50:40.133476] [INFO ] [REMOTE ] CMSA: Full fetch complete (3533 records). [2025-09-15T17:50:40.133545] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-09-15T17:50:40.461853] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-09-15T17:50:40.500579] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-09-15T17:50:40.500664] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-09-15T17:50:40.500802] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-09-15T17:50:40.500841] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-09-15T17:50:40.501221] [DEBUG] [LOCAL ] CMSA: Trimmed 3533 records to 2500 (keeping 150 days of data) [2025-09-15T17:50:40.517601] [DEBUG] [LOCAL ] CMSA: Primary data saved (2500 records). [2025-09-15T17:50:40.517711] [INFO ] [MAIN ] CMSA: Full history saved. [2025-09-15T17:50:40.517797] [INFO ] [MAIN ] Update Progress: 482/2369 symbols completed. CMSA took 19.6s. Estimated remaining: 3h 18m 10s. Rate: 9.5 symbols/min [2025-09-15T17:50:40.723475] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:50:40.726039] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-15T17:50:40.742187] [DEBUG] [LOCAL ] CMU: Loaded 4747 existing records from primary storage. [2025-09-15T17:50:40.742283] [INFO ] [MAIN ] CMU: Loaded 4747 existing records. [2025-09-15T17:50:40.923324] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:50:40.923581] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-09-15T17:50:40.923637] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-09-15T17:50:40.923952] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-09-15T17:50:40.924001] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-09-15T17:50:41.057967] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-15T17:50:41.262937] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-09-15T17:50:41.297881] [INFO ] [REMOTE ] CMU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:50:41.918727] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-15T17:50:41.919997] [INFO ] [REMOTE ] CMSC: Full fetch complete (5354 records). [2025-09-15T17:50:41.920068] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-09-15T17:50:42.063089] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-09-15T17:50:42.275602] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-09-15T17:50:42.275707] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-09-15T17:50:42.275889] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-09-15T17:50:42.275930] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-09-15T17:50:42.276338] [DEBUG] [LOCAL ] CMSC: Trimmed 5354 records to 3425 (keeping 150 days of data) [2025-09-15T17:50:42.297280] [DEBUG] [LOCAL ] CMSC: Primary data saved (3425 records). [2025-09-15T17:50:42.297361] [INFO ] [MAIN ] CMSC: Full history saved. [2025-09-15T17:50:42.297443] [INFO ] [MAIN ] Update Progress: 483/2369 symbols completed. CMSC took 21.4s. Estimated remaining: 3h 17m 46s. Rate: 9.5 symbols/min [2025-09-15T17:50:42.468398] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:50:42.491229] [DEBUG] [LOCAL ] CNA: Loaded 24776 existing records from primary storage. [2025-09-15T17:50:42.491438] [INFO ] [MAIN ] CNA: Loaded 24776 existing records. [2025-09-15T17:50:42.663288] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:50:42.663557] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-09-15T17:50:42.663604] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-09-15T17:50:42.664732] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-09-15T17:50:42.664787] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-09-15T17:50:42.867166] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-09-15T17:50:43.014226] [INFO ] [REMOTE ] CNA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:50:43.571829] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-15T17:50:43.595045] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-15T17:50:43.657955] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-09-15T17:50:44.457886] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-09-15T17:50:44.927803] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-15T17:50:45.257911] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-09-15T17:50:45.484168] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-15T17:50:46.057892] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-09-15T17:50:46.744338] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T17:50:46.857871] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-09-15T17:50:47.576828] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T17:50:47.657905] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-09-15T17:50:47.849350] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T17:50:48.457891] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-09-15T17:50:49.257944] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-09-15T17:50:49.337320] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-15T17:50:49.344202] [INFO ] [REMOTE ] CMS: Full fetch complete (57290 records). [2025-09-15T17:50:49.344488] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-09-15T17:50:49.765337] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-09-15T17:50:49.765489] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-09-15T17:50:49.766897] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-09-15T17:50:49.766976] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-09-15T17:50:49.768941] [DEBUG] [LOCAL ] CMS: Trimmed 57290 records to 38924 (keeping 150 days of data) [2025-09-15T17:50:49.903318] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-15T17:50:49.951119] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-15T17:50:50.059830] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-09-15T17:50:50.098280] [DEBUG] [LOCAL ] CMS: Primary data saved (38924 records). [2025-09-15T17:50:50.098829] [INFO ] [MAIN ] CMS: Full history saved. [2025-09-15T17:50:50.098952] [INFO ] [MAIN ] Update Progress: 484/2369 symbols completed. CMS took 29.2s. Estimated remaining: 3h 17m 46s. Rate: 9.5 symbols/min [2025-09-15T17:50:50.276702] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:50:50.322120] [DEBUG] [LOCAL ] CNC: Loaded 40524 existing records from primary storage. [2025-09-15T17:50:50.322330] [INFO ] [MAIN ] CNC: Loaded 40524 existing records. [2025-09-15T17:50:50.513222] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:50:50.513584] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-09-15T17:50:50.513661] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-09-15T17:50:50.514810] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-09-15T17:50:50.514876] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-09-15T17:50:50.862989] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-09-15T17:50:50.921325] [INFO ] [REMOTE ] CNC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:50:51.115483] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-15T17:50:51.657895] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-09-15T17:50:51.995557] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-15T17:50:52.258961] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T17:50:52.457880] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-09-15T17:50:53.257965] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-09-15T17:50:53.350951] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-15T17:50:54.057884] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-09-15T17:50:54.271587] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-15T17:50:54.857865] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-09-15T17:50:54.871867] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T17:50:54.875758] [INFO ] [REMOTE ] CMTG: Full fetch complete (41448 records). [2025-09-15T17:50:54.875873] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-09-15T17:50:55.267735] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-09-15T17:50:55.267831] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-09-15T17:50:55.268398] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-09-15T17:50:55.268440] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-09-15T17:50:55.269536] [DEBUG] [LOCAL ] CMTG: Trimmed 41448 records to 26381 (keeping 150 days of data) [2025-09-15T17:50:55.422653] [DEBUG] [LOCAL ] CMTG: Primary data saved (26381 records). [2025-09-15T17:50:55.422803] [INFO ] [MAIN ] CMTG: Full history saved. [2025-09-15T17:50:55.422939] [INFO ] [MAIN ] Update Progress: 485/2369 symbols completed. CMTG took 19.5s. Estimated remaining: 3h 17m 36s. Rate: 9.5 symbols/min [2025-09-15T17:50:55.601246] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:50:55.611842] [DEBUG] [LOCAL ] CNF: Loaded 8737 existing records from primary storage. [2025-09-15T17:50:55.611979] [INFO ] [MAIN ] CNF: Loaded 8737 existing records. [2025-09-15T17:50:55.661318] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-09-15T17:50:55.802693] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:50:55.803041] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-09-15T17:50:55.803176] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-09-15T17:50:55.803689] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-09-15T17:50:55.803761] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-09-15T17:50:55.923838] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T17:50:56.182937] [INFO ] [REMOTE ] CNF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:50:56.457882] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-09-15T17:50:56.539446] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-15T17:50:57.257930] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-09-15T17:50:57.684090] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-15T17:50:57.757394] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-15T17:50:58.057914] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-09-15T17:50:58.857921] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-09-15T17:50:59.431249] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T17:50:59.478729] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-15T17:50:59.657909] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-09-15T17:51:00.457875] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-09-15T17:51:00.934095] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T17:51:01.110124] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-15T17:51:01.257890] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-09-15T17:51:02.057900] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-09-15T17:51:02.869173] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-09-15T17:51:02.893570] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-15T17:51:02.914674] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-15T17:51:03.565882] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T17:51:03.567148] [INFO ] [REMOTE ] CMU: Full fetch complete (7588 records). [2025-09-15T17:51:03.567230] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-09-15T17:51:03.663034] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-09-15T17:51:03.995351] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-09-15T17:51:03.995431] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-09-15T17:51:03.995662] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-09-15T17:51:03.995712] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-09-15T17:51:03.996127] [DEBUG] [LOCAL ] CMU: Trimmed 7588 records to 4387 (keeping 150 days of data) [2025-09-15T17:51:04.022465] [DEBUG] [LOCAL ] CMU: Primary data saved (4387 records). [2025-09-15T17:51:04.022577] [INFO ] [MAIN ] CMU: Full history saved. [2025-09-15T17:51:04.022675] [INFO ] [MAIN ] Update Progress: 486/2369 symbols completed. CMU took 23.5s. Estimated remaining: 3h 17m 39s. Rate: 9.5 symbols/min [2025-09-15T17:51:04.217260] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:51:04.259494] [DEBUG] [LOCAL ] CNH: Loaded 40307 existing records from primary storage. [2025-09-15T17:51:04.259666] [INFO ] [MAIN ] CNH: Loaded 40307 existing records. [2025-09-15T17:51:04.446762] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:51:04.447040] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-09-15T17:51:04.447091] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-09-15T17:51:04.447970] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-09-15T17:51:04.448021] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-09-15T17:51:04.463026] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-09-15T17:51:04.824666] [INFO ] [REMOTE ] CNH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:51:05.259153] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-09-15T17:51:05.264656] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-15T17:51:06.007375] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-15T17:51:06.057895] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-09-15T17:51:06.634818] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-15T17:51:06.857887] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-09-15T17:51:06.906251] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T17:51:07.638515] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-15T17:51:07.657848] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-09-15T17:51:08.313405] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T17:51:08.457877] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-09-15T17:51:09.257905] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-09-15T17:51:09.668391] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-15T17:51:09.671985] [INFO ] [REMOTE ] CNA: Full fetch complete (35911 records). [2025-09-15T17:51:09.672065] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-09-15T17:51:09.967471] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-15T17:51:10.053565] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-09-15T17:51:10.053657] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-09-15T17:51:10.054167] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-09-15T17:51:10.054208] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-09-15T17:51:10.055074] [DEBUG] [LOCAL ] CNA: Trimmed 35911 records to 24485 (keeping 150 days of data) [2025-09-15T17:51:10.111238] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-09-15T17:51:10.212195] [DEBUG] [LOCAL ] CNA: Primary data saved (24485 records). [2025-09-15T17:51:10.212353] [INFO ] [MAIN ] CNA: Full history saved. [2025-09-15T17:51:10.212447] [INFO ] [MAIN ] Update Progress: 487/2369 symbols completed. CNA took 27.9s. Estimated remaining: 3h 17m 32s. Rate: 9.5 symbols/min [2025-09-15T17:51:10.383594] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:51:10.424000] [DEBUG] [LOCAL ] CNI: Loaded 38895 existing records from primary storage. [2025-09-15T17:51:10.424171] [INFO ] [MAIN ] CNI: Loaded 38895 existing records. [2025-09-15T17:51:10.599954] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:51:10.600215] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-09-15T17:51:10.600261] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-09-15T17:51:10.601135] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-09-15T17:51:10.601185] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-09-15T17:51:10.861583] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-09-15T17:51:10.972575] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-15T17:51:10.999085] [INFO ] [REMOTE ] CNI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:51:11.657882] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-09-15T17:51:12.457874] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-09-15T17:51:12.526744] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-15T17:51:12.528882] [INFO ] [REMOTE ] CNF: Full fetch complete (10836 records). [2025-09-15T17:51:12.528958] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-09-15T17:51:12.918658] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-09-15T17:51:12.918862] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-09-15T17:51:12.919175] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-09-15T17:51:12.919232] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-09-15T17:51:12.919994] [DEBUG] [LOCAL ] CNF: Trimmed 10836 records to 8697 (keeping 150 days of data) [2025-09-15T17:51:12.982987] [DEBUG] [LOCAL ] CNF: Primary data saved (8697 records). [2025-09-15T17:51:12.998976] [INFO ] [MAIN ] CNF: Full history saved. [2025-09-15T17:51:12.999120] [INFO ] [MAIN ] Update Progress: 488/2369 symbols completed. CNF took 17.6s. Estimated remaining: 3h 17m 12s. Rate: 9.5 symbols/min [2025-09-15T17:51:13.085096] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-15T17:51:13.197167] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:51:13.236516] [DEBUG] [LOCAL ] CNK: Loaded 39750 existing records from primary storage. [2025-09-15T17:51:13.236681] [INFO ] [MAIN ] CNK: Loaded 39750 existing records. [2025-09-15T17:51:13.268268] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-09-15T17:51:13.425479] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:51:13.425770] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-09-15T17:51:13.425818] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-09-15T17:51:13.426845] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-09-15T17:51:13.426899] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-09-15T17:51:13.781431] [INFO ] [REMOTE ] CNK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:51:14.057917] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-09-15T17:51:14.403318] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-15T17:51:14.809279] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-15T17:51:14.857881] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-09-15T17:51:15.555063] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-15T17:51:15.657856] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-09-15T17:51:16.319368] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T17:51:16.457983] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-09-15T17:51:17.257897] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-09-15T17:51:17.330304] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T17:51:18.057925] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-09-15T17:51:18.197127] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-15T17:51:18.715210] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T17:51:18.857937] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-09-15T17:51:19.664841] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-09-15T17:51:19.667609] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-15T17:51:20.404813] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T17:51:20.457823] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-09-15T17:51:20.962747] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-15T17:51:21.257879] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-09-15T17:51:21.885636] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T17:51:22.057866] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-09-15T17:51:22.857916] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-09-15T17:51:23.029820] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T17:51:23.657880] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-09-15T17:51:23.827541] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-15T17:51:24.126392] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-15T17:51:24.457914] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-09-15T17:51:25.245155] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-15T17:51:25.257811] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-09-15T17:51:26.001497] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-15T17:51:26.057889] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-09-15T17:51:26.857898] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-09-15T17:51:27.003934] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-15T17:51:27.657842] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-09-15T17:51:27.688981] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-15T17:51:28.219232] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-15T17:51:28.225260] [INFO ] [REMOTE ] CNI: Full fetch complete (56127 records). [2025-09-15T17:51:28.225407] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-09-15T17:51:28.463060] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-09-15T17:51:28.627752] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-09-15T17:51:28.627871] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-09-15T17:51:28.628884] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-09-15T17:51:28.628952] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-09-15T17:51:28.630575] [DEBUG] [LOCAL ] CNI: Trimmed 56127 records to 38141 (keeping 150 days of data) [2025-09-15T17:51:28.891054] [DEBUG] [LOCAL ] CNI: Primary data saved (38141 records). [2025-09-15T17:51:28.891221] [INFO ] [MAIN ] CNI: Full history saved. [2025-09-15T17:51:28.891887] [INFO ] [MAIN ] Update Progress: 489/2369 symbols completed. CNI took 18.7s. Estimated remaining: 3h 17m 43s. Rate: 9.5 symbols/min [2025-09-15T17:51:29.065967] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:51:29.105681] [DEBUG] [LOCAL ] CNM: Loaded 38006 existing records from primary storage. [2025-09-15T17:51:29.105814] [INFO ] [MAIN ] CNM: Loaded 38006 existing records. [2025-09-15T17:51:29.260875] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-09-15T17:51:29.281338] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:51:29.282625] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-09-15T17:51:29.282759] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-09-15T17:51:29.283592] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-09-15T17:51:29.283773] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-09-15T17:51:29.597739] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-15T17:51:29.686260] [INFO ] [REMOTE ] CNM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:51:30.057902] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-09-15T17:51:30.676759] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-15T17:51:30.724177] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-15T17:51:30.857847] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-09-15T17:51:31.439214] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-15T17:51:31.657896] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-09-15T17:51:32.382743] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T17:51:32.457865] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-09-15T17:51:33.257948] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-09-15T17:51:33.924575] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-15T17:51:33.981714] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-15T17:51:33.988463] [INFO ] [REMOTE ] CNK: Full fetch complete (57449 records). [2025-09-15T17:51:33.988606] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-09-15T17:51:34.063074] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-09-15T17:51:34.397682] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-09-15T17:51:34.397815] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-09-15T17:51:34.398797] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-09-15T17:51:34.398856] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-09-15T17:51:34.400525] [DEBUG] [LOCAL ] CNK: Trimmed 57449 records to 38995 (keeping 150 days of data) [2025-09-15T17:51:34.670265] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T17:51:34.686570] [INFO ] [REMOTE ] CNH: Full fetch complete (58242 records). [2025-09-15T17:51:34.688415] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-09-15T17:51:34.875493] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-09-15T17:51:34.969329] [DEBUG] [LOCAL ] CNK: Primary data saved (38995 records). [2025-09-15T17:51:34.999070] [INFO ] [MAIN ] CNK: Full history saved. [2025-09-15T17:51:35.003433] [INFO ] [MAIN ] Update Progress: 490/2369 symbols completed. CNK took 22.0s. Estimated remaining: 3h 17m 36s. Rate: 9.5 symbols/min [2025-09-15T17:51:35.256810] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-09-15T17:51:35.257665] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-09-15T17:51:35.274508] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-09-15T17:51:35.277281] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-09-15T17:51:35.277198] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:51:35.279197] [DEBUG] [LOCAL ] CNH: Trimmed 58242 records to 39528 (keeping 150 days of data) [2025-09-15T17:51:35.393181] [DEBUG] [LOCAL ] CNMD: Loaded 23985 existing records from primary storage. [2025-09-15T17:51:35.393827] [INFO ] [MAIN ] CNMD: Loaded 23985 existing records. [2025-09-15T17:51:35.594608] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:51:35.600826] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-09-15T17:51:35.601674] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-09-15T17:51:35.606450] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-09-15T17:51:35.607054] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-09-15T17:51:36.081947] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:51:36.083953] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-09-15T17:51:36.109201] [DEBUG] [LOCAL ] CNH: Primary data saved (39528 records). [2025-09-15T17:51:36.109382] [INFO ] [MAIN ] CNH: Full history saved. [2025-09-15T17:51:36.110094] [INFO ] [MAIN ] Update Progress: 491/2369 symbols completed. CNH took 32.1s. Estimated remaining: 3h 17m 9s. Rate: 9.5 symbols/min [2025-09-15T17:51:36.231821] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-15T17:51:36.291573] [INFO ] [REMOTE ] CNC: Full fetch complete (58394 records). [2025-09-15T17:51:36.309181] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-09-15T17:51:36.309084] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:51:36.625553] [DEBUG] [LOCAL ] CNNE: Loaded 26922 existing records from primary storage. [2025-09-15T17:51:36.652184] [INFO ] [MAIN ] CNNE: Loaded 26922 existing records. [2025-09-15T17:51:36.816793] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-09-15T17:51:36.822668] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-09-15T17:51:36.833746] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-09-15T17:51:36.838998] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-09-15T17:51:36.895740] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:51:36.896280] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-09-15T17:51:36.896433] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-09-15T17:51:36.896961] [DEBUG] [LOCAL ] CNC: Trimmed 58394 records to 39748 (keeping 150 days of data) [2025-09-15T17:51:36.897343] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-09-15T17:51:36.897582] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-09-15T17:51:37.087844] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-15T17:51:37.133789] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-09-15T17:51:37.411775] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:51:37.413219] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-09-15T17:51:37.546054] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-15T17:51:37.583341] [DEBUG] [LOCAL ] CNC: Primary data saved (39748 records). [2025-09-15T17:51:37.583510] [INFO ] [MAIN ] CNC: Full history saved. [2025-09-15T17:51:37.584542] [INFO ] [MAIN ] Update Progress: 492/2369 symbols completed. CNC took 47.5s. Estimated remaining: 3h 16m 45s. Rate: 9.5 symbols/min [2025-09-15T17:51:37.752392] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:51:37.790491] [DEBUG] [LOCAL ] CNO: Loaded 30210 existing records from primary storage. [2025-09-15T17:51:37.790657] [INFO ] [MAIN ] CNO: Loaded 30210 existing records. [2025-09-15T17:51:37.969050] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:51:37.969289] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-09-15T17:51:37.969336] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-09-15T17:51:37.970139] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-09-15T17:51:37.970193] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-09-15T17:51:38.067441] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-09-15T17:51:38.335847] [INFO ] [REMOTE ] CNO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:51:38.535967] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T17:51:38.575889] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T17:51:38.857880] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-09-15T17:51:39.520117] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-15T17:51:39.657875] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-09-15T17:51:40.457926] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-09-15T17:51:40.498480] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T17:51:41.163811] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-15T17:51:41.257882] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-09-15T17:51:41.582293] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-15T17:51:42.057878] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-09-15T17:51:42.633703] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T17:51:42.857884] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-09-15T17:51:43.394983] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-15T17:51:43.657861] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-09-15T17:51:43.801087] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-15T17:51:44.457909] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-09-15T17:51:45.257841] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-09-15T17:51:45.286509] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-15T17:51:45.492435] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-15T17:51:46.057874] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-09-15T17:51:46.719918] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-15T17:51:46.857847] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-09-15T17:51:47.459321] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-15T17:51:47.657863] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-09-15T17:51:48.286305] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-15T17:51:48.457877] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-09-15T17:51:49.265793] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-09-15T17:51:49.269391] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-15T17:51:49.805294] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T17:51:50.057869] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-09-15T17:51:50.707398] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T17:51:50.857864] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-09-15T17:51:51.355113] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-15T17:51:51.657860] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-09-15T17:51:52.236618] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-15T17:51:52.457881] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-09-15T17:51:53.136904] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T17:51:53.257934] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-09-15T17:51:53.548326] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-15T17:51:54.057935] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-09-15T17:51:54.312459] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-15T17:51:54.857895] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-09-15T17:51:55.336977] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-15T17:51:55.343462] [INFO ] [REMOTE ] CNMD: Full fetch complete (35831 records). [2025-09-15T17:51:55.343777] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-09-15T17:51:55.668585] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-09-15T17:51:55.963471] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-09-15T17:51:55.963661] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-09-15T17:51:55.965069] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-09-15T17:51:55.965162] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-09-15T17:51:55.966804] [DEBUG] [LOCAL ] CNMD: Trimmed 35831 records to 23436 (keeping 150 days of data) [2025-09-15T17:51:56.193669] [DEBUG] [LOCAL ] CNMD: Primary data saved (23436 records). [2025-09-15T17:51:56.193858] [INFO ] [MAIN ] CNMD: Full history saved. [2025-09-15T17:51:56.193982] [INFO ] [MAIN ] Update Progress: 493/2369 symbols completed. CNMD took 21.2s. Estimated remaining: 3h 17m 25s. Rate: 9.5 symbols/min [2025-09-15T17:51:56.413627] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:51:56.459345] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-09-15T17:51:56.466552] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T17:51:56.527103] [DEBUG] [LOCAL ] CNP: Loaded 40238 existing records from primary storage. [2025-09-15T17:51:56.527260] [INFO ] [MAIN ] CNP: Loaded 40238 existing records. [2025-09-15T17:51:56.707782] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:51:56.708015] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-09-15T17:51:56.708061] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-09-15T17:51:56.708936] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-09-15T17:51:56.708987] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-09-15T17:51:57.062713] [INFO ] [REMOTE ] CNP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:51:57.257923] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-09-15T17:51:57.428875] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-15T17:51:57.434946] [INFO ] [REMOTE ] CNM: Full fetch complete (55099 records). [2025-09-15T17:51:57.435103] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-09-15T17:51:57.822327] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-09-15T17:51:57.822434] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-09-15T17:51:57.823296] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-09-15T17:51:57.823368] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-09-15T17:51:57.832217] [DEBUG] [LOCAL ] CNM: Trimmed 55099 records to 37287 (keeping 150 days of data) [2025-09-15T17:51:57.846606] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-15T17:51:58.057940] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-09-15T17:51:58.077081] [DEBUG] [LOCAL ] CNM: Primary data saved (37287 records). [2025-09-15T17:51:58.077226] [INFO ] [MAIN ] CNM: Full history saved. [2025-09-15T17:51:58.077797] [INFO ] [MAIN ] Update Progress: 494/2369 symbols completed. CNM took 29.2s. Estimated remaining: 3h 17m 2s. Rate: 9.5 symbols/min [2025-09-15T17:51:58.249122] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:51:58.294251] [DEBUG] [LOCAL ] CNQ: Loaded 40333 existing records from primary storage. [2025-09-15T17:51:58.294404] [INFO ] [MAIN ] CNQ: Loaded 40333 existing records. [2025-09-15T17:51:58.478771] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:51:58.479057] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-09-15T17:51:58.479104] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-09-15T17:51:58.480277] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-09-15T17:51:58.480329] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-09-15T17:51:58.833148] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:51:58.850405] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-15T17:51:58.857047] [INFO ] [REMOTE ] CNNE: Full fetch complete (39735 records). [2025-09-15T17:51:58.857229] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-09-15T17:51:58.863079] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-09-15T17:51:59.243638] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-09-15T17:51:59.243734] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-09-15T17:51:59.244296] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-09-15T17:51:59.244336] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-09-15T17:51:59.245278] [DEBUG] [LOCAL ] CNNE: Trimmed 39735 records to 26310 (keeping 150 days of data) [2025-09-15T17:51:59.407589] [DEBUG] [LOCAL ] CNNE: Primary data saved (26310 records). [2025-09-15T17:51:59.407749] [INFO ] [MAIN ] CNNE: Full history saved. [2025-09-15T17:51:59.407836] [INFO ] [MAIN ] Update Progress: 495/2369 symbols completed. CNNE took 23.3s. Estimated remaining: 3h 16m 37s. Rate: 9.5 symbols/min [2025-09-15T17:51:59.579987] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:51:59.626219] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-15T17:51:59.660318] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-09-15T17:51:59.660889] [DEBUG] [LOCAL ] CNR: Loaded 32616 existing records from primary storage. [2025-09-15T17:51:59.661986] [INFO ] [MAIN ] CNR: Loaded 32616 existing records. [2025-09-15T17:51:59.846436] [WARN ] [MAIN ] CNR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:51:59.846723] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-09-15T17:51:59.846871] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-15T17:51:59.847693] [DEBUG] [LOCAL ] CNR: Deleted primary data file. [2025-09-15T17:51:59.847746] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-09-15T17:52:00.192895] [INFO ] [REMOTE ] CNR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:52:00.457883] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-09-15T17:52:01.055012] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-15T17:52:01.257935] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-09-15T17:52:01.567542] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-15T17:52:01.886190] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-15T17:52:02.057868] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-09-15T17:52:02.630328] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-15T17:52:02.857900] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-09-15T17:52:03.657873] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-09-15T17:52:03.749288] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T17:52:04.457896] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-09-15T17:52:04.841639] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-15T17:52:05.257930] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-09-15T17:52:05.661101] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-15T17:52:05.738829] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T17:52:06.057883] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-09-15T17:52:06.787790] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-15T17:52:06.857912] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-09-15T17:52:07.657878] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-09-15T17:52:07.865304] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-15T17:52:08.090523] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T17:52:08.457915] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-09-15T17:52:09.257938] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-09-15T17:52:09.399009] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-15T17:52:09.937619] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T17:52:09.942620] [INFO ] [REMOTE ] CNO: Full fetch complete (45785 records). [2025-09-15T17:52:09.942817] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-09-15T17:52:10.063062] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-09-15T17:52:10.321958] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-09-15T17:52:10.322041] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-09-15T17:52:10.322692] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-09-15T17:52:10.322735] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-09-15T17:52:10.323686] [DEBUG] [LOCAL ] CNO: Trimmed 45785 records to 29693 (keeping 150 days of data) [2025-09-15T17:52:10.545551] [DEBUG] [LOCAL ] CNO: Primary data saved (29693 records). [2025-09-15T17:52:10.545770] [INFO ] [MAIN ] CNO: Full history saved. [2025-09-15T17:52:10.545897] [INFO ] [MAIN ] Update Progress: 496/2369 symbols completed. CNO took 33.0s. Estimated remaining: 3h 16m 49s. Rate: 9.5 symbols/min [2025-09-15T17:52:10.628563] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-15T17:52:10.735051] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:52:10.752302] [DEBUG] [LOCAL ] CNS: Loaded 14962 existing records from primary storage. [2025-09-15T17:52:10.752439] [INFO ] [MAIN ] CNS: Loaded 14962 existing records. [2025-09-15T17:52:10.863027] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-09-15T17:52:10.927632] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:52:10.927905] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-09-15T17:52:10.927977] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-09-15T17:52:10.928431] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-09-15T17:52:10.928480] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-09-15T17:52:11.286453] [INFO ] [REMOTE ] CNS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:52:11.657850] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-09-15T17:52:11.825399] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-15T17:52:12.457918] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-09-15T17:52:12.867870] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-15T17:52:12.971872] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T17:52:13.257989] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-09-15T17:52:14.019696] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-15T17:52:14.057836] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-09-15T17:52:14.348166] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-15T17:52:14.857891] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-09-15T17:52:15.657939] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-09-15T17:52:15.819963] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-15T17:52:16.439143] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-15T17:52:16.457826] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-09-15T17:52:17.024873] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-15T17:52:17.257912] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-09-15T17:52:17.925847] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-15T17:52:18.057864] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-09-15T17:52:18.266763] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-15T17:52:18.857870] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-09-15T17:52:19.533567] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T17:52:19.538397] [INFO ] [REMOTE ] CNR: Full fetch complete (48410 records). [2025-09-15T17:52:19.538500] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-09-15T17:52:19.662939] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-09-15T17:52:19.934435] [DEBUG] [VALIDATOR ] CNR: All expected trading days are present. [2025-09-15T17:52:19.934532] [DEBUG] [VALIDATOR ] CNR: Primary data validation passed. [2025-09-15T17:52:19.935230] [INFO ] [MAIN ] CNR: Fetched primary data is valid. [2025-09-15T17:52:19.935280] [DEBUG] [LOCAL ] CNR: Saving primary data. [2025-09-15T17:52:19.936489] [DEBUG] [LOCAL ] CNR: Trimmed 48410 records to 32097 (keeping 150 days of data) [2025-09-15T17:52:20.139623] [DEBUG] [LOCAL ] CNR: Primary data saved (32097 records). [2025-09-15T17:52:20.139781] [INFO ] [MAIN ] CNR: Full history saved. [2025-09-15T17:52:20.140499] [INFO ] [MAIN ] Update Progress: 497/2369 symbols completed. CNR took 20.7s. Estimated remaining: 3h 16m 55s. Rate: 9.5 symbols/min [2025-09-15T17:52:20.313218] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:52:20.351775] [DEBUG] [LOCAL ] CNX: Loaded 38562 existing records from primary storage. [2025-09-15T17:52:20.351942] [INFO ] [MAIN ] CNX: Loaded 38562 existing records. [2025-09-15T17:52:20.462949] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-09-15T17:52:20.529554] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:52:20.529771] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-09-15T17:52:20.529825] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-09-15T17:52:20.530674] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-09-15T17:52:20.530725] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-09-15T17:52:20.887426] [INFO ] [REMOTE ] CNX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:52:20.928824] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-15T17:52:21.257928] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-09-15T17:52:21.285924] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-15T17:52:21.291930] [INFO ] [REMOTE ] CNP: Full fetch complete (58110 records). [2025-09-15T17:52:21.292039] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-09-15T17:52:21.687468] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-15T17:52:21.687748] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-09-15T17:52:21.693083] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-09-15T17:52:21.693866] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-09-15T17:52:21.693950] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-09-15T17:52:21.695448] [DEBUG] [LOCAL ] CNP: Trimmed 58110 records to 39456 (keeping 150 days of data) [2025-09-15T17:52:21.945899] [DEBUG] [LOCAL ] CNP: Primary data saved (39456 records). [2025-09-15T17:52:21.946061] [INFO ] [MAIN ] CNP: Full history saved. [2025-09-15T17:52:21.946588] [INFO ] [MAIN ] Update Progress: 498/2369 symbols completed. CNP took 25.8s. Estimated remaining: 3h 16m 32s. Rate: 9.5 symbols/min [2025-09-15T17:52:22.062969] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-09-15T17:52:22.122758] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:52:22.152999] [DEBUG] [LOCAL ] CODI: Loaded 31566 existing records from primary storage. [2025-09-15T17:52:22.153143] [INFO ] [MAIN ] CODI: Loaded 31566 existing records. [2025-09-15T17:52:22.328571] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:52:22.328856] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-09-15T17:52:22.328906] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-09-15T17:52:22.329584] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-09-15T17:52:22.329633] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-09-15T17:52:22.681293] [INFO ] [REMOTE ] CODI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:52:22.857907] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-09-15T17:52:22.905137] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T17:52:23.614619] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-15T17:52:23.621312] [INFO ] [REMOTE ] CNQ: Full fetch complete (58257 records). [2025-09-15T17:52:23.621461] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-09-15T17:52:23.662993] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-09-15T17:52:24.008921] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-09-15T17:52:24.009031] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-09-15T17:52:24.009762] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-09-15T17:52:24.009839] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-09-15T17:52:24.022904] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-15T17:52:24.028239] [DEBUG] [LOCAL ] CNQ: Trimmed 58257 records to 39551 (keeping 150 days of data) [2025-09-15T17:52:24.277172] [DEBUG] [LOCAL ] CNQ: Primary data saved (39551 records). [2025-09-15T17:52:24.277328] [INFO ] [MAIN ] CNQ: Full history saved. [2025-09-15T17:52:24.278449] [INFO ] [MAIN ] Update Progress: 499/2369 symbols completed. CNQ took 26.2s. Estimated remaining: 3h 16m 11s. Rate: 9.5 symbols/min [2025-09-15T17:52:24.448043] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:52:24.457893] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-09-15T17:52:24.487395] [DEBUG] [LOCAL ] COF: Loaded 40371 existing records from primary storage. [2025-09-15T17:52:24.487529] [INFO ] [MAIN ] COF: Loaded 40371 existing records. [2025-09-15T17:52:24.661877] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:52:24.662080] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-09-15T17:52:24.662124] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-09-15T17:52:24.663024] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-09-15T17:52:24.663074] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-09-15T17:52:25.013998] [INFO ] [REMOTE ] COF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:52:25.257832] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-09-15T17:52:25.376200] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-15T17:52:25.614609] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T17:52:26.057925] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-09-15T17:52:26.812440] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-15T17:52:26.857834] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-09-15T17:52:27.657858] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-09-15T17:52:27.733930] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-15T17:52:28.323893] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-15T17:52:28.359818] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-15T17:52:28.457874] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-09-15T17:52:29.257960] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-09-15T17:52:29.792484] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T17:52:30.057888] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-09-15T17:52:30.477676] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T17:52:30.857886] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-09-15T17:52:31.657856] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-09-15T17:52:31.915944] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-15T17:52:31.991138] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-15T17:52:32.457933] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-09-15T17:52:33.257916] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-09-15T17:52:33.333219] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-15T17:52:34.057905] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-09-15T17:52:34.149147] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-15T17:52:34.514533] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-15T17:52:34.857943] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-09-15T17:52:35.473197] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T17:52:35.510318] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-15T17:52:35.657879] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-09-15T17:52:36.457887] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-09-15T17:52:37.257868] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-09-15T17:52:37.423237] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-15T17:52:38.066117] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-09-15T17:52:38.091680] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T17:52:38.857862] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-09-15T17:52:39.108597] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-15T17:52:39.657859] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-09-15T17:52:39.696917] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-15T17:52:39.854058] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-15T17:52:39.856926] [INFO ] [REMOTE ] CNS: Full fetch complete (22795 records). [2025-09-15T17:52:39.857011] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-09-15T17:52:40.240098] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-09-15T17:52:40.240178] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-09-15T17:52:40.240609] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-09-15T17:52:40.240673] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-09-15T17:52:40.241284] [DEBUG] [LOCAL ] CNS: Trimmed 22795 records to 14550 (keeping 150 days of data) [2025-09-15T17:52:40.336826] [DEBUG] [LOCAL ] CNS: Primary data saved (14550 records). [2025-09-15T17:52:40.336979] [INFO ] [MAIN ] CNS: Full history saved. [2025-09-15T17:52:40.337069] [INFO ] [MAIN ] Update Progress: 500/2369 symbols completed. CNS took 29.8s. Estimated remaining: 3h 16m 41s. Rate: 9.5 symbols/min [2025-09-15T17:52:40.463041] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-09-15T17:52:40.516225] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:52:40.558596] [DEBUG] [LOCAL ] COHR: Loaded 40158 existing records from primary storage. [2025-09-15T17:52:40.558783] [INFO ] [MAIN ] COHR: Loaded 40158 existing records. [2025-09-15T17:52:40.750903] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:52:40.751364] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-09-15T17:52:40.751431] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-09-15T17:52:40.752834] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-09-15T17:52:40.752905] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-09-15T17:52:41.141238] [INFO ] [REMOTE ] COHR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:52:41.257889] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-09-15T17:52:41.274567] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-15T17:52:41.280563] [INFO ] [REMOTE ] CNX: Full fetch complete (55969 records). [2025-09-15T17:52:41.280696] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-09-15T17:52:41.666324] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-09-15T17:52:41.666407] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-09-15T17:52:41.667102] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-09-15T17:52:41.667147] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-09-15T17:52:41.668319] [DEBUG] [LOCAL ] CNX: Trimmed 55969 records to 37796 (keeping 150 days of data) [2025-09-15T17:52:41.893364] [DEBUG] [LOCAL ] CNX: Primary data saved (37796 records). [2025-09-15T17:52:41.893516] [INFO ] [MAIN ] CNX: Full history saved. [2025-09-15T17:52:41.894087] [INFO ] [MAIN ] Update Progress: 501/2369 symbols completed. CNX took 21.8s. Estimated remaining: 3h 16m 17s. Rate: 9.5 symbols/min [2025-09-15T17:52:42.067729] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-09-15T17:52:42.070037] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:52:42.113040] [DEBUG] [LOCAL ] COLD: Loaded 39316 existing records from primary storage. [2025-09-15T17:52:42.113198] [INFO ] [MAIN ] COLD: Loaded 39316 existing records. [2025-09-15T17:52:42.320126] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:52:42.320589] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-09-15T17:52:42.320715] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-09-15T17:52:42.321622] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-09-15T17:52:42.321715] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-09-15T17:52:42.717305] [INFO ] [REMOTE ] COLD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:52:42.720436] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-15T17:52:42.857824] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-09-15T17:52:43.147016] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-15T17:52:43.184526] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-15T17:52:43.657869] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-09-15T17:52:44.093164] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T17:52:44.457895] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-09-15T17:52:45.257883] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-09-15T17:52:45.538880] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-15T17:52:45.986175] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-15T17:52:46.057841] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-09-15T17:52:46.612529] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T17:52:46.857860] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-09-15T17:52:47.613918] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-15T17:52:47.620702] [INFO ] [REMOTE ] COF: Full fetch complete (58262 records). [2025-09-15T17:52:47.620910] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-09-15T17:52:47.663134] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-09-15T17:52:48.156496] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-09-15T17:52:48.156669] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-09-15T17:52:48.158277] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-09-15T17:52:48.158372] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-09-15T17:52:48.160397] [DEBUG] [LOCAL ] COF: Trimmed 58262 records to 39597 (keeping 150 days of data) [2025-09-15T17:52:48.488249] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-09-15T17:52:48.568966] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-15T17:52:48.624841] [DEBUG] [LOCAL ] COF: Primary data saved (39597 records). [2025-09-15T17:52:48.625024] [INFO ] [MAIN ] COF: Full history saved. [2025-09-15T17:52:48.625818] [INFO ] [MAIN ] Update Progress: 502/2369 symbols completed. COF took 24.3s. Estimated remaining: 3h 16m 12s. Rate: 9.5 symbols/min [2025-09-15T17:52:48.836809] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:52:48.880901] [DEBUG] [LOCAL ] COMP: Loaded 40161 existing records from primary storage. [2025-09-15T17:52:48.881086] [INFO ] [MAIN ] COMP: Loaded 40161 existing records. [2025-09-15T17:52:49.066015] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:52:49.066264] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-09-15T17:52:49.066309] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-09-15T17:52:49.067090] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-09-15T17:52:49.067141] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-09-15T17:52:49.273334] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-09-15T17:52:49.420383] [INFO ] [REMOTE ] COMP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:52:49.829108] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-15T17:52:50.031670] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-15T17:52:50.057814] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-09-15T17:52:50.735694] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T17:52:50.857882] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-09-15T17:52:51.234201] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-15T17:52:51.238602] [INFO ] [REMOTE ] CODI: Full fetch complete (41394 records). [2025-09-15T17:52:51.238758] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-09-15T17:52:51.629146] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-09-15T17:52:51.629236] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-09-15T17:52:51.629823] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-09-15T17:52:51.629867] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-09-15T17:52:51.630781] [DEBUG] [LOCAL ] CODI: Trimmed 41394 records to 31124 (keeping 150 days of data) [2025-09-15T17:52:51.678328] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-09-15T17:52:51.821137] [DEBUG] [LOCAL ] CODI: Primary data saved (31124 records). [2025-09-15T17:52:51.821303] [INFO ] [MAIN ] CODI: Full history saved. [2025-09-15T17:52:51.821408] [INFO ] [MAIN ] Update Progress: 503/2369 symbols completed. CODI took 29.9s. Estimated remaining: 3h 15m 54s. Rate: 9.5 symbols/min [2025-09-15T17:52:51.995831] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:52:52.024011] [DEBUG] [LOCAL ] CON: Loaded 28932 existing records from primary storage. [2025-09-15T17:52:52.024214] [INFO ] [MAIN ] CON: Loaded 28932 existing records. [2025-09-15T17:52:52.207002] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:52:52.207419] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-09-15T17:52:52.207482] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-09-15T17:52:52.208156] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-09-15T17:52:52.208213] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-09-15T17:52:52.418998] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T17:52:52.469595] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-09-15T17:52:52.624863] [INFO ] [REMOTE ] CON: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:52:53.257841] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-09-15T17:52:53.784915] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-15T17:52:54.057865] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-09-15T17:52:54.158520] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T17:52:54.635664] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-15T17:52:54.857873] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-09-15T17:52:55.643680] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T17:52:55.657821] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-09-15T17:52:56.457931] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-09-15T17:52:56.645251] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-15T17:52:57.188933] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-15T17:52:57.257910] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-09-15T17:52:57.600072] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-15T17:52:58.057943] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-09-15T17:52:58.857980] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-09-15T17:52:59.407101] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-15T17:52:59.473002] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-15T17:52:59.657869] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-09-15T17:53:00.457846] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-09-15T17:53:00.519191] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-15T17:53:01.031730] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-15T17:53:01.257940] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-09-15T17:53:02.057862] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-09-15T17:53:02.138267] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T17:53:02.509608] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-15T17:53:02.857883] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-09-15T17:53:03.657917] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-09-15T17:53:03.936482] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-15T17:53:03.942538] [INFO ] [REMOTE ] COHR: Full fetch complete (58033 records). [2025-09-15T17:53:03.942746] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-09-15T17:53:04.355595] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-09-15T17:53:04.357671] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-09-15T17:53:04.359004] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-09-15T17:53:04.359616] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-09-15T17:53:04.359537] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T17:53:04.366065] [INFO ] [REMOTE ] COLD: Full fetch complete (56339 records). [2025-09-15T17:53:04.366214] [DEBUG] [LOCAL ] COHR: Trimmed 58033 records to 39393 (keeping 150 days of data) [2025-09-15T17:53:04.366333] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-09-15T17:53:04.461471] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-09-15T17:53:04.975087] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-09-15T17:53:04.975428] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-09-15T17:53:04.977385] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-09-15T17:53:04.977777] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-09-15T17:53:04.981566] [DEBUG] [LOCAL ] COLD: Trimmed 56339 records to 38617 (keeping 150 days of data) [2025-09-15T17:53:05.126303] [DEBUG] [LOCAL ] COHR: Primary data saved (39393 records). [2025-09-15T17:53:05.126754] [INFO ] [MAIN ] COHR: Full history saved. [2025-09-15T17:53:05.128451] [INFO ] [MAIN ] Update Progress: 504/2369 symbols completed. COHR took 24.8s. Estimated remaining: 3h 16m 14s. Rate: 9.5 symbols/min [2025-09-15T17:53:05.419635] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:53:05.423818] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T17:53:05.437926] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-09-15T17:53:05.458052] [DEBUG] [LOCAL ] COOK: Loaded 18711 existing records from primary storage. [2025-09-15T17:53:05.458673] [INFO ] [MAIN ] COOK: Loaded 18711 existing records. [2025-09-15T17:53:05.657537] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:53:05.658967] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-09-15T17:53:05.659605] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-09-15T17:53:05.661196] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-09-15T17:53:05.661793] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-09-15T17:53:05.891590] [DEBUG] [LOCAL ] COLD: Primary data saved (38617 records). [2025-09-15T17:53:05.924695] [INFO ] [MAIN ] COLD: Full history saved. [2025-09-15T17:53:05.941700] [INFO ] [MAIN ] Update Progress: 505/2369 symbols completed. COLD took 24.0s. Estimated remaining: 3h 15m 47s. Rate: 9.5 symbols/min [2025-09-15T17:53:06.146955] [INFO ] [REMOTE ] COOK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:53:06.162794] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-09-15T17:53:06.209475] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:53:06.237506] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-15T17:53:06.283794] [DEBUG] [LOCAL ] COP: Loaded 40467 existing records from primary storage. [2025-09-15T17:53:06.283962] [INFO ] [MAIN ] COP: Loaded 40467 existing records. [2025-09-15T17:53:06.468000] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:53:06.468328] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-09-15T17:53:06.468384] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-09-15T17:53:06.469529] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-09-15T17:53:06.469605] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-09-15T17:53:06.827370] [INFO ] [REMOTE ] COP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:53:06.858891] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-09-15T17:53:06.863367] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-15T17:53:07.071062] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-15T17:53:07.657873] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-09-15T17:53:08.024180] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-15T17:53:08.457891] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-09-15T17:53:08.665922] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-15T17:53:09.257936] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-09-15T17:53:09.530450] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-15T17:53:09.535631] [INFO ] [REMOTE ] CON: Full fetch complete (42104 records). [2025-09-15T17:53:09.535733] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-09-15T17:53:09.910468] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-09-15T17:53:09.910584] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-09-15T17:53:09.911173] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-09-15T17:53:09.911217] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-09-15T17:53:09.912189] [DEBUG] [LOCAL ] CON: Trimmed 42104 records to 28443 (keeping 150 days of data) [2025-09-15T17:53:10.066711] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-09-15T17:53:10.093092] [DEBUG] [LOCAL ] CON: Primary data saved (28443 records). [2025-09-15T17:53:10.093210] [INFO ] [MAIN ] CON: Full history saved. [2025-09-15T17:53:10.093498] [INFO ] [MAIN ] Update Progress: 506/2369 symbols completed. CON took 18.3s. Estimated remaining: 3h 15m 33s. Rate: 9.5 symbols/min [2025-09-15T17:53:10.265617] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:53:10.300325] [DEBUG] [LOCAL ] COR: Loaded 34959 existing records from primary storage. [2025-09-15T17:53:10.300492] [INFO ] [MAIN ] COR: Loaded 34959 existing records. [2025-09-15T17:53:10.482341] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:53:10.482669] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-09-15T17:53:10.482722] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-09-15T17:53:10.483455] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-09-15T17:53:10.483505] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-09-15T17:53:10.842213] [INFO ] [REMOTE ] COR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:53:10.867749] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-09-15T17:53:10.873560] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-15T17:53:11.140995] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T17:53:11.657896] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-09-15T17:53:12.437468] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-15T17:53:12.457815] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-09-15T17:53:12.799759] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-15T17:53:13.257875] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-09-15T17:53:14.057886] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-09-15T17:53:14.515915] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-15T17:53:14.832793] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T17:53:14.857815] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-09-15T17:53:15.529478] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-15T17:53:15.657870] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-09-15T17:53:16.457985] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-09-15T17:53:16.672165] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-15T17:53:17.263145] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-09-15T17:53:17.277855] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T17:53:17.870282] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T17:53:18.057994] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-09-15T17:53:18.719286] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-15T17:53:18.857816] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-09-15T17:53:19.108298] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-15T17:53:19.657929] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-09-15T17:53:20.457885] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-09-15T17:53:20.529439] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-15T17:53:21.006436] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T17:53:21.257926] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-09-15T17:53:22.057914] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-09-15T17:53:22.126245] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-15T17:53:22.133480] [INFO ] [REMOTE ] COMP: Full fetch complete (58015 records). [2025-09-15T17:53:22.133599] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-09-15T17:53:22.513716] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-09-15T17:53:22.513799] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-09-15T17:53:22.514637] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-09-15T17:53:22.514929] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-09-15T17:53:22.516364] [DEBUG] [LOCAL ] COMP: Trimmed 58015 records to 39382 (keeping 150 days of data) [2025-09-15T17:53:22.747044] [DEBUG] [LOCAL ] COMP: Primary data saved (39382 records). [2025-09-15T17:53:22.747266] [INFO ] [MAIN ] COMP: Full history saved. [2025-09-15T17:53:22.748315] [INFO ] [MAIN ] Update Progress: 507/2369 symbols completed. COMP took 34.1s. Estimated remaining: 3h 15m 50s. Rate: 9.5 symbols/min [2025-09-15T17:53:22.858883] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-09-15T17:53:22.920750] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:53:22.986662] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-15T17:53:22.987430] [DEBUG] [LOCAL ] COTY: Loaded 40116 existing records from primary storage. [2025-09-15T17:53:22.998102] [INFO ] [MAIN ] COTY: Loaded 40116 existing records. [2025-09-15T17:53:23.188578] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:53:23.188923] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-09-15T17:53:23.188974] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-09-15T17:53:23.189772] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-09-15T17:53:23.189832] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-09-15T17:53:23.557417] [INFO ] [REMOTE ] COTY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:53:23.657901] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-09-15T17:53:23.781058] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-15T17:53:23.823803] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-15T17:53:24.457934] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-09-15T17:53:24.935594] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T17:53:25.257887] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-09-15T17:53:26.057893] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-09-15T17:53:26.219759] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-15T17:53:26.289513] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-15T17:53:26.292841] [INFO ] [REMOTE ] COOK: Full fetch complete (25126 records). [2025-09-15T17:53:26.292924] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-09-15T17:53:26.665416] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-09-15T17:53:26.665501] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-09-15T17:53:26.666018] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-09-15T17:53:26.666069] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-09-15T17:53:26.667084] [DEBUG] [LOCAL ] COOK: Trimmed 25126 records to 18462 (keeping 150 days of data) [2025-09-15T17:53:26.776874] [DEBUG] [LOCAL ] COOK: Primary data saved (18462 records). [2025-09-15T17:53:26.777030] [INFO ] [MAIN ] COOK: Full history saved. [2025-09-15T17:53:26.777130] [INFO ] [MAIN ] Update Progress: 508/2369 symbols completed. COOK took 21.6s. Estimated remaining: 3h 15m 35s. Rate: 9.5 symbols/min [2025-09-15T17:53:26.866620] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-09-15T17:53:26.946631] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:53:26.984172] [DEBUG] [LOCAL ] COUR: Loaded 36989 existing records from primary storage. [2025-09-15T17:53:26.984311] [INFO ] [MAIN ] COUR: Loaded 36989 existing records. [2025-09-15T17:53:27.164370] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:53:27.164664] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-09-15T17:53:27.164712] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-09-15T17:53:27.165312] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-09-15T17:53:27.165357] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-09-15T17:53:27.511210] [INFO ] [REMOTE ] COUR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:53:27.657814] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-09-15T17:53:28.114747] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-15T17:53:28.169762] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-15T17:53:28.457892] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-09-15T17:53:29.257839] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-09-15T17:53:29.293378] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-15T17:53:29.885276] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-15T17:53:30.057881] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-09-15T17:53:30.857879] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-09-15T17:53:30.956220] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-15T17:53:31.657866] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-09-15T17:53:31.722491] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-15T17:53:31.728734] [INFO ] [REMOTE ] COP: Full fetch complete (58407 records). [2025-09-15T17:53:31.728908] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-09-15T17:53:31.773819] [DEBUG] [REMOTE ] COR: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-09-15T17:53:31.807226] [WARN ] [REMOTE ] COR: No data returned for month 2025-08 [2025-09-15T17:53:32.112635] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-09-15T17:53:32.112761] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-09-15T17:53:32.113472] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-09-15T17:53:32.113514] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-09-15T17:53:32.114756] [DEBUG] [LOCAL ] COP: Trimmed 58407 records to 39687 (keeping 150 days of data) [2025-09-15T17:53:32.393529] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-15T17:53:32.410866] [DEBUG] [LOCAL ] COP: Primary data saved (39687 records). [2025-09-15T17:53:32.410974] [INFO ] [MAIN ] COP: Full history saved. [2025-09-15T17:53:32.411068] [INFO ] [MAIN ] Update Progress: 509/2369 symbols completed. COP took 26.5s. Estimated remaining: 3h 15m 27s. Rate: 9.5 symbols/min [2025-09-15T17:53:32.467631] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-09-15T17:53:32.586342] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:53:32.625785] [DEBUG] [LOCAL ] CP: Loaded 40048 existing records from primary storage. [2025-09-15T17:53:32.625928] [INFO ] [MAIN ] CP: Loaded 40048 existing records. [2025-09-15T17:53:32.837215] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:53:32.837452] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-09-15T17:53:32.837505] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-09-15T17:53:32.838325] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-09-15T17:53:32.838373] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-09-15T17:53:33.187503] [INFO ] [REMOTE ] CP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:53:33.257815] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-09-15T17:53:33.900084] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T17:53:33.905408] [INFO ] [REMOTE ] COR: Full fetch complete (44707 records). [2025-09-15T17:53:33.905531] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-09-15T17:53:34.062407] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-09-15T17:53:34.095304] [WARN ] [VALIDATOR ] COR: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-15T17:53:34.095818] [FATAL] [MAIN ] COR: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:53:34.095876] [WARN ] [MAIN ] COR: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:53:34.095921] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-09-15T17:53:34.095987] [DEBUG] [LOCAL ] COR: No primary data file found to delete. [2025-09-15T17:53:34.096033] [INFO ] [LOCAL ] COR: Starting deletion of derivative data. [2025-09-15T17:53:34.096351] [DEBUG] [LOCAL ] COR: Deleted derivative data file. [2025-09-15T17:53:34.096607] [INFO ] [MAIN ] Update Progress: 510/2369 symbols completed. COR took 24.0s. Estimated remaining: 3h 15m 4s. Rate: 9.5 symbols/min [2025-09-15T17:53:34.267248] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:53:34.297379] [DEBUG] [LOCAL ] CPA: Loaded 21487 existing records from primary storage. [2025-09-15T17:53:34.297542] [INFO ] [MAIN ] CPA: Loaded 21487 existing records. [2025-09-15T17:53:34.478268] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:53:34.478571] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-09-15T17:53:34.478631] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-09-15T17:53:34.479193] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-09-15T17:53:34.479243] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-09-15T17:53:34.830082] [INFO ] [REMOTE ] CPA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:53:34.857891] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-09-15T17:53:34.858751] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T17:53:35.540201] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T17:53:35.657842] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-09-15T17:53:36.108942] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-15T17:53:36.457890] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-09-15T17:53:37.139781] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T17:53:37.257840] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-09-15T17:53:37.706227] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-15T17:53:38.057869] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-09-15T17:53:38.706071] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T17:53:38.857879] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-09-15T17:53:39.441533] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T17:53:39.657864] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-09-15T17:53:40.457960] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-09-15T17:53:40.508187] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T17:53:41.096435] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-15T17:53:41.257879] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-09-15T17:53:42.057877] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-09-15T17:53:42.134618] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-15T17:53:42.296007] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-15T17:53:42.857872] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-09-15T17:53:43.657843] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-09-15T17:53:43.767766] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-15T17:53:44.135949] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-15T17:53:44.457875] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-09-15T17:53:45.257838] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-09-15T17:53:45.306100] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-15T17:53:45.436325] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-15T17:53:46.057867] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-09-15T17:53:46.858836] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-09-15T17:53:46.862356] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T17:53:46.869275] [INFO ] [REMOTE ] COTY: Full fetch complete (57942 records). [2025-09-15T17:53:46.869366] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-09-15T17:53:47.253306] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-09-15T17:53:47.253428] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-09-15T17:53:47.254164] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-09-15T17:53:47.254219] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-09-15T17:53:47.255563] [DEBUG] [LOCAL ] COTY: Trimmed 57942 records to 39335 (keeping 150 days of data) [2025-09-15T17:53:47.282652] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-15T17:53:47.513212] [DEBUG] [LOCAL ] COTY: Primary data saved (39335 records). [2025-09-15T17:53:47.513360] [INFO ] [MAIN ] COTY: Full history saved. [2025-09-15T17:53:47.514074] [INFO ] [MAIN ] Update Progress: 511/2369 symbols completed. COTY took 24.8s. Estimated remaining: 3h 15m 23s. Rate: 9.5 symbols/min [2025-09-15T17:53:47.683514] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-09-15T17:53:47.686032] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:53:47.686972] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-09-15T17:53:47.687017] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-09-15T17:53:47.687129] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-09-15T17:53:47.687168] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-15T17:53:47.687208] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-15T17:53:47.687241] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-09-15T17:53:48.081121] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:53:48.099403] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-15T17:53:48.457886] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-09-15T17:53:48.978327] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-15T17:53:49.257840] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-09-15T17:53:49.557295] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T17:53:50.057867] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-09-15T17:53:50.857889] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-09-15T17:53:51.011239] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-15T17:53:51.280070] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-15T17:53:51.440847] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-15T17:53:51.657901] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-09-15T17:53:52.457895] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-09-15T17:53:52.647324] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T17:53:52.650885] [INFO ] [REMOTE ] CPA: Full fetch complete (31861 records). [2025-09-15T17:53:52.650982] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-09-15T17:53:53.026077] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-09-15T17:53:53.026164] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-09-15T17:53:53.026830] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-09-15T17:53:53.026893] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-09-15T17:53:53.027725] [DEBUG] [LOCAL ] CPA: Trimmed 31861 records to 21144 (keeping 150 days of data) [2025-09-15T17:53:53.169980] [DEBUG] [LOCAL ] CPA: Primary data saved (21144 records). [2025-09-15T17:53:53.170114] [INFO ] [MAIN ] CPA: Full history saved. [2025-09-15T17:53:53.170195] [INFO ] [MAIN ] Update Progress: 512/2369 symbols completed. CPA took 19.1s. Estimated remaining: 3h 15m 14s. Rate: 9.5 symbols/min [2025-09-15T17:53:53.263489] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-09-15T17:53:53.350019] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:53:53.372343] [DEBUG] [LOCAL ] CPAY: Loaded 22765 existing records from primary storage. [2025-09-15T17:53:53.372501] [INFO ] [MAIN ] CPAY: Loaded 22765 existing records. [2025-09-15T17:53:53.549868] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:53:53.550165] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-09-15T17:53:53.550213] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-09-15T17:53:53.550821] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-09-15T17:53:53.550885] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-09-15T17:53:53.669303] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-15T17:53:53.915414] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:53:54.057891] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-09-15T17:53:54.199088] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-15T17:53:54.857886] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-09-15T17:53:55.255087] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-15T17:53:55.657912] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-09-15T17:53:55.942241] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-15T17:53:56.457905] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-09-15T17:53:56.479497] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-15T17:53:56.485488] [INFO ] [REMOTE ] COUR: Full fetch complete (53081 records). [2025-09-15T17:53:56.485664] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-09-15T17:53:56.874930] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-09-15T17:53:56.875036] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-09-15T17:53:56.875881] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-09-15T17:53:56.875929] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-09-15T17:53:56.877411] [DEBUG] [LOCAL ] COUR: Trimmed 53081 records to 36333 (keeping 150 days of data) [2025-09-15T17:53:57.115038] [DEBUG] [LOCAL ] COUR: Primary data saved (36333 records). [2025-09-15T17:53:57.115246] [INFO ] [MAIN ] COUR: Full history saved. [2025-09-15T17:53:57.116570] [INFO ] [MAIN ] Update Progress: 513/2369 symbols completed. COUR took 30.3s. Estimated remaining: 3h 14m 60s. Rate: 9.5 symbols/min [2025-09-15T17:53:57.261400] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-09-15T17:53:57.293906] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:53:57.309780] [DEBUG] [LOCAL ] CPF: Loaded 11023 existing records from primary storage. [2025-09-15T17:53:57.309974] [INFO ] [MAIN ] CPF: Loaded 11023 existing records. [2025-09-15T17:53:57.490552] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:53:57.490947] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-09-15T17:53:57.491029] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-09-15T17:53:57.491430] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-09-15T17:53:57.491477] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-09-15T17:53:57.856837] [INFO ] [REMOTE ] CPF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:53:58.057901] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-09-15T17:53:58.115625] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-15T17:53:58.543111] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T17:53:58.857930] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-09-15T17:53:59.155980] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-15T17:53:59.166284] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-15T17:53:59.657942] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-09-15T17:54:00.385100] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-15T17:54:00.457875] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-09-15T17:54:01.257910] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-09-15T17:54:01.503138] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-15T17:54:01.746366] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-15T17:54:02.057902] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-09-15T17:54:02.857937] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-09-15T17:54:03.400969] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T17:54:03.657905] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-09-15T17:54:04.208382] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T17:54:04.457880] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-09-15T17:54:04.891206] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-15T17:54:05.036259] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T17:54:05.257904] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-09-15T17:54:05.583403] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-15T17:54:06.057908] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-09-15T17:54:06.857884] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-09-15T17:54:07.253598] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-15T17:54:07.259853] [INFO ] [REMOTE ] CP: Full fetch complete (57910 records). [2025-09-15T17:54:07.260005] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-09-15T17:54:07.644091] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-09-15T17:54:07.644200] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-09-15T17:54:07.645294] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-09-15T17:54:07.645367] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-09-15T17:54:07.646763] [DEBUG] [LOCAL ] CP: Trimmed 57910 records to 39276 (keeping 150 days of data) [2025-09-15T17:54:07.714043] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-09-15T17:54:07.905882] [DEBUG] [LOCAL ] CP: Primary data saved (39276 records). [2025-09-15T17:54:07.906027] [INFO ] [MAIN ] CP: Full history saved. [2025-09-15T17:54:07.907503] [INFO ] [MAIN ] Update Progress: 514/2369 symbols completed. CP took 35.5s. Estimated remaining: 3h 15m 9s. Rate: 9.5 symbols/min [2025-09-15T17:54:08.104474] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-15T17:54:08.106695] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:54:08.126441] [DEBUG] [LOCAL ] CPK: Loaded 9467 existing records from primary storage. [2025-09-15T17:54:08.126578] [INFO ] [MAIN ] CPK: Loaded 9467 existing records. [2025-09-15T17:54:08.302636] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:54:08.302889] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-09-15T17:54:08.302936] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-09-15T17:54:08.303292] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-09-15T17:54:08.303339] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-09-15T17:54:08.461406] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-09-15T17:54:08.666848] [INFO ] [REMOTE ] CPK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:54:08.676969] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-15T17:54:09.257849] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-09-15T17:54:09.717496] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-15T17:54:09.747393] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-15T17:54:09.748248] [INFO ] [REMOTE ] CPAC: Full fetch complete (1257 records). [2025-09-15T17:54:09.748319] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-09-15T17:54:09.932907] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-15T17:54:09.933122] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:54:09.933172] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:54:09.933217] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-15T17:54:09.933294] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-15T17:54:09.933333] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-09-15T17:54:09.933373] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-09-15T17:54:09.933432] [INFO ] [MAIN ] Update Progress: 515/2369 symbols completed. CPAC took 22.4s. Estimated remaining: 3h 14m 48s. Rate: 9.5 symbols/min [2025-09-15T17:54:10.073232] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-09-15T17:54:10.105505] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:54:10.151250] [DEBUG] [LOCAL ] CPNG: Loaded 40425 existing records from primary storage. [2025-09-15T17:54:10.151404] [INFO ] [MAIN ] CPNG: Loaded 40425 existing records. [2025-09-15T17:54:10.324994] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:54:10.325262] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-09-15T17:54:10.325307] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-09-15T17:54:10.326141] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-09-15T17:54:10.326192] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-09-15T17:54:10.691530] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:54:10.857844] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-09-15T17:54:11.124487] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-15T17:54:11.619132] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-15T17:54:11.657858] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-09-15T17:54:12.433159] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-15T17:54:12.457813] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-09-15T17:54:13.257896] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-09-15T17:54:13.507423] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-15T17:54:13.912484] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-15T17:54:14.057919] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-09-15T17:54:14.777467] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-15T17:54:14.857852] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-09-15T17:54:15.657915] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-09-15T17:54:16.275161] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-15T17:54:16.457909] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-09-15T17:54:17.257944] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-09-15T17:54:17.320041] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T17:54:17.512320] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-15T17:54:17.838334] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-15T17:54:17.841106] [INFO ] [REMOTE ] CPF: Full fetch complete (16916 records). [2025-09-15T17:54:17.841201] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-09-15T17:54:18.067301] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-09-15T17:54:18.222559] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-09-15T17:54:18.222635] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-09-15T17:54:18.223007] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-09-15T17:54:18.223046] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-09-15T17:54:18.223565] [DEBUG] [LOCAL ] CPF: Trimmed 16916 records to 10798 (keeping 150 days of data) [2025-09-15T17:54:18.291243] [DEBUG] [LOCAL ] CPF: Primary data saved (10798 records). [2025-09-15T17:54:18.291365] [INFO ] [MAIN ] CPF: Full history saved. [2025-09-15T17:54:18.291447] [INFO ] [MAIN ] Update Progress: 516/2369 symbols completed. CPF took 21.2s. Estimated remaining: 3h 14m 49s. Rate: 9.5 symbols/min [2025-09-15T17:54:18.458064] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:54:18.504275] [DEBUG] [LOCAL ] CPRI: Loaded 39506 existing records from primary storage. [2025-09-15T17:54:18.504458] [INFO ] [MAIN ] CPRI: Loaded 39506 existing records. [2025-09-15T17:54:18.681201] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:54:18.681465] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-09-15T17:54:18.681514] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-09-15T17:54:18.682350] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-09-15T17:54:18.682401] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-09-15T17:54:18.864547] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-09-15T17:54:19.035721] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:54:19.657881] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-09-15T17:54:20.066621] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-15T17:54:20.334061] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T17:54:20.337459] [INFO ] [REMOTE ] CPAY: Full fetch complete (33934 records). [2025-09-15T17:54:20.337544] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-09-15T17:54:20.463040] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-09-15T17:54:20.702802] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-09-15T17:54:20.702880] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-09-15T17:54:20.703388] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-09-15T17:54:20.703427] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-09-15T17:54:20.704220] [DEBUG] [LOCAL ] CPAY: Trimmed 33934 records to 22320 (keeping 150 days of data) [2025-09-15T17:54:20.838867] [DEBUG] [LOCAL ] CPAY: Primary data saved (22320 records). [2025-09-15T17:54:20.838997] [INFO ] [MAIN ] CPAY: Full history saved. [2025-09-15T17:54:20.839078] [INFO ] [MAIN ] Update Progress: 517/2369 symbols completed. CPAY took 27.7s. Estimated remaining: 3h 14m 29s. Rate: 9.5 symbols/min [2025-09-15T17:54:21.259170] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-09-15T17:54:21.262593] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T17:54:21.861122] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-15T17:54:22.057934] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-09-15T17:54:22.378221] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-15T17:54:22.857862] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-09-15T17:54:23.657903] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-09-15T17:54:23.722789] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-15T17:54:24.324936] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-15T17:54:24.457881] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-09-15T17:54:25.065034] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-15T17:54:25.257864] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-09-15T17:54:25.823052] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T17:54:26.057911] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-09-15T17:54:26.857870] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-09-15T17:54:27.317775] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-15T17:54:27.440444] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-15T17:54:27.575332] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T17:54:27.657934] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-09-15T17:54:28.458466] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-09-15T17:54:28.459872] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-15T17:54:28.461691] [INFO ] [REMOTE ] CPK: Full fetch complete (14013 records). [2025-09-15T17:54:28.461766] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-09-15T17:54:28.829302] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-09-15T17:54:28.829391] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-09-15T17:54:28.829743] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-09-15T17:54:28.829803] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-09-15T17:54:28.830358] [DEBUG] [LOCAL ] CPK: Trimmed 14013 records to 9139 (keeping 150 days of data) [2025-09-15T17:54:28.887700] [DEBUG] [LOCAL ] CPK: Primary data saved (9139 records). [2025-09-15T17:54:28.887828] [INFO ] [MAIN ] CPK: Full history saved. [2025-09-15T17:54:28.887927] [INFO ] [MAIN ] Update Progress: 518/2369 symbols completed. CPK took 21.0s. Estimated remaining: 3h 14m 29s. Rate: 9.5 symbols/min [2025-09-15T17:54:29.257926] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-09-15T17:54:30.910279] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-15T17:54:30.922739] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-09-15T17:54:30.958652] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-15T17:54:30.969901] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-09-15T17:54:32.682536] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-15T17:54:32.695558] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-09-15T17:54:33.195187] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-15T17:54:33.206877] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-09-15T17:54:34.172370] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-15T17:54:34.183388] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-09-15T17:54:35.108024] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-15T17:54:35.116617] [INFO ] [REMOTE ] CPNG: Full fetch complete (58348 records). [2025-09-15T17:54:35.116877] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-09-15T17:54:35.664095] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-09-15T17:54:35.664256] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-09-15T17:54:35.665202] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-09-15T17:54:35.665665] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-09-15T17:54:35.673433] [DEBUG] [LOCAL ] CPNG: Trimmed 58348 records to 39648 (keeping 150 days of data) [2025-09-15T17:54:35.684211] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T17:54:35.691335] [INFO ] [REMOTE ] CPRI: Full fetch complete (57173 records). [2025-09-15T17:54:35.691475] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-09-15T17:54:36.241451] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-09-15T17:54:36.241572] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-09-15T17:54:36.242410] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-09-15T17:54:36.242478] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-09-15T17:54:36.331370] [DEBUG] [LOCAL ] CPRI: Trimmed 57173 records to 38730 (keeping 150 days of data) [2025-09-15T17:54:36.535223] [DEBUG] [LOCAL ] CPNG: Primary data saved (39648 records). [2025-09-15T17:54:36.562703] [INFO ] [MAIN ] CPNG: Full history saved. [2025-09-15T17:54:36.567356] [INFO ] [MAIN ] Update Progress: 519/2369 symbols completed. CPNG took 26.6s. Estimated remaining: 3h 14m 28s. Rate: 9.5 symbols/min [2025-09-15T17:54:36.594840] [DEBUG] [LOCAL ] CPRI: Primary data saved (38730 records). [2025-09-15T17:54:36.594997] [INFO ] [MAIN ] CPRI: Full history saved. [2025-09-15T17:54:36.596489] [INFO ] [MAIN ] Update Progress: 520/2369 symbols completed. CPRI took 18.3s. Estimated remaining: 3h 13m 59s. Rate: 9.5 symbols/min [2025-09-15T17:54:37.220307] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:54:37.266768] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:54:37.285273] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:54:37.286853] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:54:37.316063] [DEBUG] [LOCAL ] CPS: Loaded 18945 existing records from primary storage. [2025-09-15T17:54:37.315689] [DEBUG] [LOCAL ] CQP: Loaded 15095 existing records from primary storage. [2025-09-15T17:54:37.316222] [INFO ] [MAIN ] CPS: Loaded 18945 existing records. [2025-09-15T17:54:37.316315] [INFO ] [MAIN ] CQP: Loaded 15095 existing records. [2025-09-15T17:54:37.503318] [DEBUG] [LOCAL ] CR: Loaded 18070 existing records from primary storage. [2025-09-15T17:54:37.528340] [INFO ] [MAIN ] CR: Loaded 18070 existing records. [2025-09-15T17:54:37.755363] [DEBUG] [LOCAL ] CPT: Loaded 33071 existing records from primary storage. [2025-09-15T17:54:37.771087] [INFO ] [MAIN ] CPT: Loaded 33071 existing records. [2025-09-15T17:54:37.760632] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:54:37.830146] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:54:37.877053] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-09-15T17:54:37.877196] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-09-15T17:54:37.901159] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-09-15T17:54:37.901113] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-09-15T17:54:37.942886] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-09-15T17:54:37.982166] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-09-15T17:54:37.990532] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-09-15T17:54:37.982070] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-09-15T17:54:38.070213] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:54:38.225584] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:54:38.269893] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-09-15T17:54:38.281757] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-09-15T17:54:38.297926] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-09-15T17:54:38.316781] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-09-15T17:54:38.349843] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-09-15T17:54:38.359035] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-09-15T17:54:38.390092] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-09-15T17:54:38.388598] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-09-15T17:54:39.171110] [INFO ] [REMOTE ] CQP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:54:39.226239] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-09-15T17:54:39.369417] [INFO ] [REMOTE ] CPS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:54:39.417584] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-09-15T17:54:39.549161] [INFO ] [REMOTE ] CPT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:54:39.567535] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-09-15T17:54:39.587276] [INFO ] [REMOTE ] CR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:54:39.588962] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-09-15T17:54:40.518875] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-15T17:54:40.524447] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-09-15T17:54:40.602455] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-15T17:54:40.607910] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-09-15T17:54:40.713745] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-15T17:54:40.722863] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-09-15T17:54:40.806828] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-15T17:54:40.811431] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-09-15T17:54:41.320231] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-15T17:54:41.325122] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-09-15T17:54:41.843392] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-15T17:54:41.849675] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-09-15T17:54:41.927540] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-15T17:54:41.993358] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-15T17:54:42.013422] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-15T17:54:42.057842] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-09-15T17:54:42.857855] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-09-15T17:54:43.160707] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-15T17:54:43.625684] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T17:54:43.657861] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-09-15T17:54:43.927886] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-15T17:54:44.457887] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-09-15T17:54:45.164627] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-15T17:54:45.257924] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-09-15T17:54:45.659963] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-15T17:54:46.057872] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-09-15T17:54:46.264050] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-15T17:54:46.857871] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-09-15T17:54:47.059209] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-15T17:54:47.657916] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-09-15T17:54:48.149636] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-15T17:54:48.457839] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-09-15T17:54:48.494598] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-15T17:54:49.257887] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-09-15T17:54:49.342171] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-15T17:54:50.057862] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-09-15T17:54:50.706262] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-15T17:54:50.857855] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-09-15T17:54:50.905806] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-15T17:54:51.657918] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-09-15T17:54:52.366041] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-15T17:54:52.457836] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-09-15T17:54:52.747851] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-15T17:54:53.257857] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-09-15T17:54:53.439027] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-15T17:54:53.958577] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-15T17:54:54.057874] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-09-15T17:54:54.826816] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T17:54:54.828708] [INFO ] [REMOTE ] CQP: Full fetch complete (22123 records). [2025-09-15T17:54:54.828789] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-09-15T17:54:54.862982] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-09-15T17:54:55.212136] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-09-15T17:54:55.212222] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-09-15T17:54:55.212711] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-09-15T17:54:55.212768] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-09-15T17:54:55.213403] [DEBUG] [LOCAL ] CQP: Trimmed 22123 records to 14914 (keeping 150 days of data) [2025-09-15T17:54:55.309849] [DEBUG] [LOCAL ] CQP: Primary data saved (14914 records). [2025-09-15T17:54:55.310006] [INFO ] [MAIN ] CQP: Full history saved. [2025-09-15T17:54:55.310102] [INFO ] [MAIN ] Update Progress: 521/2369 symbols completed. CQP took 18.7s. Estimated remaining: 3h 14m 37s. Rate: 9.5 symbols/min [2025-09-15T17:54:55.487201] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:54:55.495574] [DEBUG] [LOCAL ] CRBD: Loaded 6949 existing records from primary storage. [2025-09-15T17:54:55.495689] [INFO ] [MAIN ] CRBD: Loaded 6949 existing records. [2025-09-15T17:54:55.667672] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-09-15T17:54:55.672827] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:54:55.674347] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-09-15T17:54:55.674451] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-09-15T17:54:55.674810] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-09-15T17:54:55.674868] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-09-15T17:54:56.050001] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:54:56.463082] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-09-15T17:54:56.469774] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-15T17:54:56.492769] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-15T17:54:56.500191] [INFO ] [REMOTE ] CPT: Full fetch complete (48281 records). [2025-09-15T17:54:56.500348] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-09-15T17:54:56.891078] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-09-15T17:54:56.891178] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-09-15T17:54:56.891840] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-09-15T17:54:56.891887] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-09-15T17:54:56.893053] [DEBUG] [LOCAL ] CPT: Trimmed 48281 records to 32473 (keeping 150 days of data) [2025-09-15T17:54:57.099571] [DEBUG] [LOCAL ] CPT: Primary data saved (32473 records). [2025-09-15T17:54:57.099727] [INFO ] [MAIN ] CPT: Full history saved. [2025-09-15T17:54:57.099812] [INFO ] [MAIN ] Update Progress: 522/2369 symbols completed. CPT took 20.5s. Estimated remaining: 3h 14m 14s. Rate: 9.5 symbols/min [2025-09-15T17:54:57.266452] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-09-15T17:54:57.269014] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:54:57.277381] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-15T17:54:57.316169] [DEBUG] [LOCAL ] CRBG: Loaded 39482 existing records from primary storage. [2025-09-15T17:54:57.316345] [INFO ] [MAIN ] CRBG: Loaded 39482 existing records. [2025-09-15T17:54:57.493921] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:54:57.494214] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-09-15T17:54:57.494281] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-09-15T17:54:57.495123] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-09-15T17:54:57.495177] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-09-15T17:54:57.839102] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:54:58.057878] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-09-15T17:54:58.524478] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T17:54:58.527838] [INFO ] [REMOTE ] CR: Full fetch complete (26539 records). [2025-09-15T17:54:58.527915] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-09-15T17:54:58.876767] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-09-15T17:54:58.888135] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-09-15T17:54:58.888197] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-09-15T17:54:58.888633] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-09-15T17:54:58.888697] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-09-15T17:54:58.889441] [DEBUG] [LOCAL ] CR: Trimmed 26539 records to 17772 (keeping 150 days of data) [2025-09-15T17:54:59.011053] [DEBUG] [LOCAL ] CR: Primary data saved (17772 records). [2025-09-15T17:54:59.011193] [INFO ] [MAIN ] CR: Full history saved. [2025-09-15T17:54:59.011307] [INFO ] [MAIN ] Update Progress: 523/2369 symbols completed. CR took 22.4s. Estimated remaining: 3h 13m 53s. Rate: 9.5 symbols/min [2025-09-15T17:54:59.178886] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:54:59.210332] [DEBUG] [LOCAL ] CRC: Loaded 32978 existing records from primary storage. [2025-09-15T17:54:59.210483] [INFO ] [MAIN ] CRC: Loaded 32978 existing records. [2025-09-15T17:54:59.386136] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:54:59.386348] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-09-15T17:54:59.386393] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-09-15T17:54:59.387092] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-09-15T17:54:59.387149] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-09-15T17:54:59.658125] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-09-15T17:54:59.743258] [INFO ] [REMOTE ] CRC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:54:59.749333] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-15T17:54:59.886404] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-15T17:55:00.457872] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-09-15T17:55:00.770586] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-15T17:55:01.257883] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-09-15T17:55:02.057846] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-09-15T17:55:02.146725] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T17:55:02.222588] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T17:55:02.857867] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-09-15T17:55:03.657961] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-09-15T17:55:03.837323] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-15T17:55:04.457915] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-09-15T17:55:05.257933] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-09-15T17:55:05.331850] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-15T17:55:05.721404] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (2.86 seconds). [2025-09-15T17:55:05.769084] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-15T17:55:05.771968] [INFO ] [REMOTE ] CPS: Full fetch complete (28923 records). [2025-09-15T17:55:05.772052] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-09-15T17:55:06.063083] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-09-15T17:55:06.140734] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-09-15T17:55:06.140822] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-09-15T17:55:06.141336] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-09-15T17:55:06.141377] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-09-15T17:55:06.142189] [DEBUG] [LOCAL ] CPS: Trimmed 28923 records to 18514 (keeping 150 days of data) [2025-09-15T17:55:06.257545] [DEBUG] [LOCAL ] CPS: Primary data saved (18514 records). [2025-09-15T17:55:06.257733] [INFO ] [MAIN ] CPS: Full history saved. [2025-09-15T17:55:06.257843] [INFO ] [MAIN ] Update Progress: 524/2369 symbols completed. CPS took 29.7s. Estimated remaining: 3h 13m 50s. Rate: 9.5 symbols/min [2025-09-15T17:55:06.453423] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:55:06.453620] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-09-15T17:55:06.453679] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-09-15T17:55:06.453808] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-09-15T17:55:06.453848] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-15T17:55:06.453889] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-15T17:55:06.453921] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-09-15T17:55:06.806810] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:55:06.867900] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-09-15T17:55:06.896622] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T17:55:07.617393] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T17:55:07.657868] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-09-15T17:55:07.769471] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-15T17:55:08.457891] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-09-15T17:55:09.248148] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-15T17:55:09.257809] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-09-15T17:55:09.809465] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T17:55:10.057925] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-02. [2025-09-15T17:55:10.250376] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:55:10.250709] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-02 [2025-09-15T17:55:10.726519] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T17:55:10.857874] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-09-15T17:55:11.657929] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-09-15T17:55:11.992871] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-15T17:55:12.457900] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-03. [2025-09-15T17:55:12.683526] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:55:12.683893] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-03 [2025-09-15T17:55:13.262954] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-09-15T17:55:13.279753] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-15T17:55:14.057866] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-09-15T17:55:14.727860] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-15T17:55:14.857880] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-04. [2025-09-15T17:55:15.044710] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:55:15.045024] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-04 [2025-09-15T17:55:15.657896] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-05. [2025-09-15T17:55:15.791135] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-15T17:55:15.837430] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:55:15.837784] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-05 [2025-09-15T17:55:16.457928] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-09-15T17:55:17.257884] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-06. [2025-09-15T17:55:18.057908] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-09-15T17:55:18.563259] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-15T17:55:18.857864] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-09-15T17:55:19.657985] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-09-15T17:55:19.926301] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-15T17:55:20.054286] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-06 (2.80 seconds). [2025-09-15T17:55:20.228201] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-15T17:55:20.233880] [INFO ] [REMOTE ] CRBG: Full fetch complete (56892 records). [2025-09-15T17:55:20.233972] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-09-15T17:55:20.347965] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-15T17:55:20.462961] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-07. [2025-09-15T17:55:20.634739] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-09-15T17:55:20.634815] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-09-15T17:55:20.635494] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-09-15T17:55:20.635536] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-09-15T17:55:20.636668] [DEBUG] [LOCAL ] CRBG: Trimmed 56892 records to 38714 (keeping 150 days of data) [2025-09-15T17:55:20.869121] [DEBUG] [LOCAL ] CRBG: Primary data saved (38714 records). [2025-09-15T17:55:20.869268] [INFO ] [MAIN ] CRBG: Full history saved. [2025-09-15T17:55:20.869851] [INFO ] [MAIN ] Update Progress: 525/2369 symbols completed. CRBG took 23.8s. Estimated remaining: 3h 14m 12s. Rate: 9.5 symbols/min [2025-09-15T17:55:21.037915] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:55:21.075522] [DEBUG] [LOCAL ] CRGY: Loaded 39368 existing records from primary storage. [2025-09-15T17:55:21.075684] [INFO ] [MAIN ] CRGY: Loaded 39368 existing records. [2025-09-15T17:55:21.255262] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:55:21.255552] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-09-15T17:55:21.255600] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-09-15T17:55:21.256530] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-09-15T17:55:21.256583] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-09-15T17:55:21.267963] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-09-15T17:55:21.617578] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:55:22.057895] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-09-15T17:55:22.775462] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-15T17:55:22.780173] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-15T17:55:22.857817] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-08. [2025-09-15T17:55:22.906933] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T17:55:22.912014] [INFO ] [REMOTE ] CRC: Full fetch complete (47849 records). [2025-09-15T17:55:22.912097] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-09-15T17:55:23.278805] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-09-15T17:55:23.278880] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-09-15T17:55:23.279432] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-09-15T17:55:23.279473] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-09-15T17:55:23.280429] [DEBUG] [LOCAL ] CRC: Trimmed 47849 records to 32513 (keeping 150 days of data) [2025-09-15T17:55:23.492994] [DEBUG] [LOCAL ] CRC: Primary data saved (32513 records). [2025-09-15T17:55:23.493154] [INFO ] [MAIN ] CRC: Full history saved. [2025-09-15T17:55:23.493244] [INFO ] [MAIN ] Update Progress: 526/2369 symbols completed. CRC took 24.5s. Estimated remaining: 3h 13m 53s. Rate: 9.5 symbols/min [2025-09-15T17:55:23.664216] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-09-15T17:55:23.664159] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:55:23.704820] [DEBUG] [LOCAL ] CRH: Loaded 40240 existing records from primary storage. [2025-09-15T17:55:23.704953] [INFO ] [MAIN ] CRH: Loaded 40240 existing records. [2025-09-15T17:55:23.880995] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:55:23.881289] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-09-15T17:55:23.881339] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-09-15T17:55:23.882311] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-09-15T17:55:23.882365] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-09-15T17:55:24.233337] [INFO ] [REMOTE ] CRH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:55:24.239870] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-15T17:55:24.241556] [INFO ] [REMOTE ] CRBD: Full fetch complete (9934 records). [2025-09-15T17:55:24.241637] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-09-15T17:55:24.463049] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-09-15T17:55:24.610793] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-09-15T17:55:24.610872] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-09-15T17:55:24.611144] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-09-15T17:55:24.611189] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-09-15T17:55:24.611671] [DEBUG] [LOCAL ] CRBD: Trimmed 9934 records to 6872 (keeping 150 days of data) [2025-09-15T17:55:24.655860] [DEBUG] [LOCAL ] CRBD: Primary data saved (6872 records). [2025-09-15T17:55:24.656009] [INFO ] [MAIN ] CRBD: Full history saved. [2025-09-15T17:55:24.656107] [INFO ] [MAIN ] Update Progress: 527/2369 symbols completed. CRBD took 29.3s. Estimated remaining: 3h 13m 29s. Rate: 9.5 symbols/min [2025-09-15T17:55:24.825923] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:55:24.865048] [DEBUG] [LOCAL ] CRI: Loaded 37683 existing records from primary storage. [2025-09-15T17:55:24.865218] [INFO ] [MAIN ] CRI: Loaded 37683 existing records. [2025-09-15T17:55:25.041679] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:55:25.041975] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-09-15T17:55:25.042022] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-09-15T17:55:25.042899] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-09-15T17:55:25.042951] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-09-15T17:55:25.261396] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-09-15T17:55:25.402794] [INFO ] [REMOTE ] CRI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:55:25.438187] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-09-15T17:55:26.057832] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-09-15T17:55:26.494124] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-15T17:55:26.773472] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-15T17:55:26.857902] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-09-15T17:55:27.382315] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T17:55:27.657884] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-09-15T17:55:28.463411] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T17:55:28.461263] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-09. [2025-09-15T17:55:29.247501] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-15T17:55:29.258216] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-09-15T17:55:30.057869] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-09-15T17:55:30.530626] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-15T17:55:30.857853] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-09-15T17:55:31.071393] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-09-15T17:55:31.077076] [INFO ] [REMOTE ] CRCL: Full fetch complete (27099 records). [2025-09-15T17:55:31.077153] [DEBUG] [VALIDATOR ] CRCL: Validating primary data. [2025-09-15T17:55:31.261598] [WARN ] [VALIDATOR ] CRCL: Validation failed - insufficient historical data. Have 70 unique days, need 150 days [2025-09-15T17:55:31.262144] [FATAL] [MAIN ] CRCL: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:55:31.262206] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:55:31.262264] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-15T17:55:31.262362] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-15T17:55:31.262431] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-09-15T17:55:31.262495] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-09-15T17:55:31.262572] [INFO ] [MAIN ] Update Progress: 528/2369 symbols completed. CRCL took 25.0s. Estimated remaining: 3h 13m 24s. Rate: 9.5 symbols/min [2025-09-15T17:55:31.459727] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:55:31.502792] [DEBUG] [LOCAL ] CRK: Loaded 39134 existing records from primary storage. [2025-09-15T17:55:31.502951] [INFO ] [MAIN ] CRK: Loaded 39134 existing records. [2025-09-15T17:55:31.663302] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-09-15T17:55:31.727814] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:55:31.731369] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-09-15T17:55:31.730942] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T17:55:31.731587] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-09-15T17:55:31.743942] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-09-15T17:55:31.744018] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-09-15T17:55:32.139521] [INFO ] [REMOTE ] CRK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:55:32.457913] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-09-15T17:55:32.521128] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-15T17:55:33.075053] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-15T17:55:33.257885] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-09-15T17:55:33.808598] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T17:55:34.057875] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-09-15T17:55:34.817373] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T17:55:34.857819] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-09-15T17:55:35.657885] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-09-15T17:55:35.672478] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T17:55:35.932094] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-15T17:55:36.457897] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-09-15T17:55:37.120165] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T17:55:37.257872] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-09-15T17:55:38.057899] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-09-15T17:55:38.144715] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-15T17:55:38.857910] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-09-15T17:55:38.899416] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-15T17:55:39.371127] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T17:55:39.657870] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-09-15T17:55:40.206032] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-15T17:55:40.457869] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-09-15T17:55:41.190551] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-15T17:55:41.257835] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-09-15T17:55:42.062948] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-09-15T17:55:42.082040] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-15T17:55:42.428830] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-15T17:55:42.857864] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-09-15T17:55:43.638941] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T17:55:43.657822] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-09-15T17:55:44.067301] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T17:55:44.457888] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-09-15T17:55:45.031766] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T17:55:45.257879] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-09-15T17:55:46.057885] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-09-15T17:55:46.086772] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-15T17:55:46.092204] [INFO ] [REMOTE ] CRI: Full fetch complete (54169 records). [2025-09-15T17:55:46.092312] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-09-15T17:55:46.483630] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-09-15T17:55:46.483763] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-09-15T17:55:46.484953] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-09-15T17:55:46.485016] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-09-15T17:55:46.486480] [DEBUG] [LOCAL ] CRI: Trimmed 54169 records to 36947 (keeping 150 days of data) [2025-09-15T17:55:46.832668] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-15T17:55:46.882674] [DEBUG] [LOCAL ] CRI: Primary data saved (36947 records). [2025-09-15T17:55:46.883878] [INFO ] [MAIN ] CRI: Full history saved. [2025-09-15T17:55:46.885365] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-09-15T17:55:46.884962] [INFO ] [MAIN ] Update Progress: 529/2369 symbols completed. CRI took 22.2s. Estimated remaining: 3h 13m 50s. Rate: 9.5 symbols/min [2025-09-15T17:55:47.147779] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:55:47.196703] [DEBUG] [LOCAL ] CRL: Loaded 31895 existing records from primary storage. [2025-09-15T17:55:47.196897] [INFO ] [MAIN ] CRL: Loaded 31895 existing records. [2025-09-15T17:55:47.462972] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:55:47.463408] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-09-15T17:55:47.463882] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-09-15T17:55:47.464680] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-09-15T17:55:47.464764] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-09-15T17:55:47.679044] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-09-15T17:55:47.932258] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-15T17:55:47.937595] [INFO ] [REMOTE ] CRL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:55:48.457874] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-09-15T17:55:48.786016] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-15T17:55:49.196755] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-15T17:55:49.203257] [INFO ] [REMOTE ] CRGY: Full fetch complete (57044 records). [2025-09-15T17:55:49.203434] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-09-15T17:55:49.258722] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-09-15T17:55:49.622231] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-09-15T17:55:49.622471] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-09-15T17:55:49.623694] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-09-15T17:55:49.623780] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-09-15T17:55:49.625939] [DEBUG] [LOCAL ] CRGY: Trimmed 57044 records to 38598 (keeping 150 days of data) [2025-09-15T17:55:49.774376] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T17:55:49.931820] [DEBUG] [LOCAL ] CRGY: Primary data saved (38598 records). [2025-09-15T17:55:49.932057] [INFO ] [MAIN ] CRGY: Full history saved. [2025-09-15T17:55:49.932851] [INFO ] [MAIN ] Update Progress: 530/2369 symbols completed. CRGY took 29.1s. Estimated remaining: 3h 13m 32s. Rate: 9.5 symbols/min [2025-09-15T17:55:50.063060] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-09-15T17:55:50.126716] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:55:50.179184] [DEBUG] [LOCAL ] CRM: Loaded 40510 existing records from primary storage. [2025-09-15T17:55:50.179413] [INFO ] [MAIN ] CRM: Loaded 40510 existing records. [2025-09-15T17:55:50.364703] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:55:50.365082] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-09-15T17:55:50.365145] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-09-15T17:55:50.366122] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-09-15T17:55:50.366181] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-09-15T17:55:50.757558] [INFO ] [REMOTE ] CRM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:55:50.857868] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-09-15T17:55:51.202257] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-15T17:55:51.209277] [INFO ] [REMOTE ] CRH: Full fetch complete (58159 records). [2025-09-15T17:55:51.209398] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-09-15T17:55:51.585225] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-09-15T17:55:51.585306] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-09-15T17:55:51.586019] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-09-15T17:55:51.586066] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-09-15T17:55:51.587295] [DEBUG] [LOCAL ] CRH: Trimmed 58159 records to 39445 (keeping 150 days of data) [2025-09-15T17:55:51.660396] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-09-15T17:55:51.867370] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-15T17:55:51.900760] [DEBUG] [LOCAL ] CRH: Primary data saved (39445 records). [2025-09-15T17:55:51.900919] [INFO ] [MAIN ] CRH: Full history saved. [2025-09-15T17:55:51.902039] [INFO ] [MAIN ] Update Progress: 531/2369 symbols completed. CRH took 28.4s. Estimated remaining: 3h 13m 11s. Rate: 9.5 symbols/min [2025-09-15T17:55:52.073022] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:55:52.116726] [DEBUG] [LOCAL ] CRS: Loaded 32697 existing records from primary storage. [2025-09-15T17:55:52.116898] [INFO ] [MAIN ] CRS: Loaded 32697 existing records. [2025-09-15T17:55:52.295710] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:55:52.296158] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-09-15T17:55:52.296319] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-09-15T17:55:52.297408] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-09-15T17:55:52.297473] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-09-15T17:55:52.483557] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-09-15T17:55:52.601622] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-15T17:55:52.701567] [INFO ] [REMOTE ] CRS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:55:53.257888] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-09-15T17:55:53.532174] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-15T17:55:54.057872] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-09-15T17:55:54.250471] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-15T17:55:54.257188] [INFO ] [REMOTE ] CRK: Full fetch complete (56612 records). [2025-09-15T17:55:54.257366] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-09-15T17:55:54.647476] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-09-15T17:55:54.647589] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-09-15T17:55:54.648336] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-09-15T17:55:54.648388] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-09-15T17:55:54.650808] [DEBUG] [LOCAL ] CRK: Trimmed 56612 records to 38364 (keeping 150 days of data) [2025-09-15T17:55:54.861156] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-09-15T17:55:54.894733] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-15T17:55:54.915871] [DEBUG] [LOCAL ] CRK: Primary data saved (38364 records). [2025-09-15T17:55:54.916000] [INFO ] [MAIN ] CRK: Full history saved. [2025-09-15T17:55:54.916490] [INFO ] [MAIN ] Update Progress: 532/2369 symbols completed. CRK took 23.7s. Estimated remaining: 3h 12m 53s. Rate: 9.5 symbols/min [2025-09-15T17:55:55.086500] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:55:55.092106] [DEBUG] [LOCAL ] CRT: Loaded 3442 existing records from primary storage. [2025-09-15T17:55:55.092217] [INFO ] [MAIN ] CRT: Loaded 3442 existing records. [2025-09-15T17:55:55.265329] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:55:55.265559] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-09-15T17:55:55.265628] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-09-15T17:55:55.265873] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-09-15T17:55:55.265919] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-09-15T17:55:55.617334] [INFO ] [REMOTE ] CRT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:55:55.647771] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-15T17:55:55.658001] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-09-15T17:55:56.419633] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-15T17:55:56.457839] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-09-15T17:55:56.936402] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-15T17:55:57.257915] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-09-15T17:55:58.057947] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-09-15T17:55:58.282326] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-15T17:55:58.438324] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-15T17:55:58.769256] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-15T17:55:58.857823] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-09-15T17:55:59.657881] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-09-15T17:56:00.457907] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-09-15T17:56:00.488612] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-15T17:56:01.257878] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-09-15T17:56:01.876661] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-15T17:56:02.018891] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-15T17:56:02.057842] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-09-15T17:56:02.865635] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-09-15T17:56:02.889782] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-15T17:56:03.316458] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-15T17:56:03.657919] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-09-15T17:56:04.360593] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-15T17:56:04.457920] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-09-15T17:56:05.216051] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-15T17:56:05.257823] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-09-15T17:56:05.650483] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-15T17:56:06.057874] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-09-15T17:56:06.857867] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-09-15T17:56:07.347507] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T17:56:07.352025] [INFO ] [REMOTE ] CRL: Full fetch complete (48002 records). [2025-09-15T17:56:07.352144] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-09-15T17:56:07.352772] [FATAL] [VALIDATOR ] CRL: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:56:07.352852] [FATAL] [MAIN ] CRL: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:56:07.352909] [WARN ] [MAIN ] CRL: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:56:07.352956] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-09-15T17:56:07.353023] [DEBUG] [LOCAL ] CRL: No primary data file found to delete. [2025-09-15T17:56:07.353062] [INFO ] [LOCAL ] CRL: Starting deletion of derivative data. [2025-09-15T17:56:07.353384] [DEBUG] [LOCAL ] CRL: Deleted derivative data file. [2025-09-15T17:56:07.354631] [INFO ] [MAIN ] Update Progress: 533/2369 symbols completed. CRL took 20.5s. Estimated remaining: 3h 13m 8s. Rate: 9.5 symbols/min [2025-09-15T17:56:07.530081] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:56:07.565720] [DEBUG] [LOCAL ] CSAN: Loaded 31822 existing records from primary storage. [2025-09-15T17:56:07.565862] [INFO ] [MAIN ] CSAN: Loaded 31822 existing records. [2025-09-15T17:56:07.662934] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-09-15T17:56:07.747515] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:56:07.747950] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-09-15T17:56:07.751885] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-09-15T17:56:07.752630] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-15T17:56:07.754151] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-09-15T17:56:07.754524] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-09-15T17:56:08.064693] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.81 seconds). [2025-09-15T17:56:08.154283] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:56:08.457892] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-09-15T17:56:09.015256] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T17:56:09.257900] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-09-15T17:56:09.636500] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-15T17:56:10.057924] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-09-15T17:56:10.857849] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-09-15T17:56:10.979005] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-09-15T17:56:11.249867] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-15T17:56:11.663619] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-09-15T17:56:11.678736] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T17:56:12.457895] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-09-15T17:56:13.257902] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-09-15T17:56:13.581734] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-15T17:56:13.854590] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T17:56:14.057877] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-09-15T17:56:14.529113] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-15T17:56:14.857894] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-09-15T17:56:14.906550] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T17:56:15.657926] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-09-15T17:56:16.280944] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T17:56:16.282171] [INFO ] [REMOTE ] CRT: Full fetch complete (5393 records). [2025-09-15T17:56:16.282238] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-09-15T17:56:16.457998] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-09-15T17:56:16.668509] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-09-15T17:56:16.668612] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-09-15T17:56:16.668856] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-09-15T17:56:16.668917] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-09-15T17:56:16.669358] [DEBUG] [LOCAL ] CRT: Trimmed 5393 records to 3442 (keeping 150 days of data) [2025-09-15T17:56:16.693146] [DEBUG] [LOCAL ] CRT: Primary data saved (3442 records). [2025-09-15T17:56:16.693328] [INFO ] [MAIN ] CRT: Full history saved. [2025-09-15T17:56:16.693431] [INFO ] [MAIN ] Update Progress: 534/2369 symbols completed. CRT took 21.8s. Estimated remaining: 3h 13m 12s. Rate: 9.5 symbols/min [2025-09-15T17:56:16.880456] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:56:16.906270] [DEBUG] [LOCAL ] CSL: Loaded 22559 existing records from primary storage. [2025-09-15T17:56:16.906478] [INFO ] [MAIN ] CSL: Loaded 22559 existing records. [2025-09-15T17:56:17.087701] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:56:17.088052] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-09-15T17:56:17.088129] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-09-15T17:56:17.088842] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-09-15T17:56:17.088893] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-09-15T17:56:17.263122] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-09-15T17:56:17.452158] [INFO ] [REMOTE ] CSL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:56:17.515611] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-09-15T17:56:17.521700] [INFO ] [REMOTE ] CRM: Full fetch complete (58448 records). [2025-09-15T17:56:17.521823] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-09-15T17:56:17.914207] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-09-15T17:56:17.914299] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-09-15T17:56:17.915127] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-09-15T17:56:17.915174] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-09-15T17:56:17.916432] [DEBUG] [LOCAL ] CRM: Trimmed 58448 records to 39730 (keeping 150 days of data) [2025-09-15T17:56:18.100244] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-09-15T17:56:18.176529] [DEBUG] [LOCAL ] CRM: Primary data saved (39730 records). [2025-09-15T17:56:18.177033] [INFO ] [MAIN ] CRM: Full history saved. [2025-09-15T17:56:18.177753] [INFO ] [MAIN ] Update Progress: 535/2369 symbols completed. CRM took 28.2s. Estimated remaining: 3h 12m 49s. Rate: 9.5 symbols/min [2025-09-15T17:56:18.384524] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-15T17:56:18.386156] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:56:18.410497] [DEBUG] [LOCAL ] CSR: Loaded 9762 existing records from primary storage. [2025-09-15T17:56:18.410679] [INFO ] [MAIN ] CSR: Loaded 9762 existing records. [2025-09-15T17:56:18.590900] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:56:18.591325] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-09-15T17:56:18.591392] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-09-15T17:56:18.591907] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-09-15T17:56:18.592042] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-09-15T17:56:18.871762] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-09-15T17:56:18.951771] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-15T17:56:19.023175] [INFO ] [REMOTE ] CSR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:56:19.265661] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-15T17:56:19.657879] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-09-15T17:56:20.458388] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-09-15T17:56:20.471156] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-15T17:56:20.815427] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-15T17:56:21.089567] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-15T17:56:21.257852] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-09-15T17:56:22.057898] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-09-15T17:56:22.747932] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T17:56:22.857827] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-09-15T17:56:23.657856] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-09-15T17:56:23.726210] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-15T17:56:23.989608] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-15T17:56:24.310231] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-15T17:56:24.457882] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-09-15T17:56:25.257855] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-09-15T17:56:25.552198] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-15T17:56:26.057892] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-09-15T17:56:26.712767] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-15T17:56:26.718567] [INFO ] [REMOTE ] CRS: Full fetch complete (47462 records). [2025-09-15T17:56:26.718704] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-09-15T17:56:26.868029] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-09-15T17:56:27.102433] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-09-15T17:56:27.102603] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-09-15T17:56:27.103311] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-09-15T17:56:27.103371] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-09-15T17:56:27.104578] [DEBUG] [LOCAL ] CRS: Trimmed 47462 records to 32032 (keeping 150 days of data) [2025-09-15T17:56:27.240373] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-15T17:56:27.354142] [DEBUG] [LOCAL ] CRS: Primary data saved (32032 records). [2025-09-15T17:56:27.354286] [INFO ] [MAIN ] CRS: Full history saved. [2025-09-15T17:56:27.354372] [INFO ] [MAIN ] Update Progress: 536/2369 symbols completed. CRS took 35.5s. Estimated remaining: 3h 12m 53s. Rate: 9.5 symbols/min [2025-09-15T17:56:27.523308] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:56:27.558337] [DEBUG] [LOCAL ] CSTM: Loaded 35715 existing records from primary storage. [2025-09-15T17:56:27.558487] [INFO ] [MAIN ] CSTM: Loaded 35715 existing records. [2025-09-15T17:56:27.662945] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-09-15T17:56:27.741887] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:56:27.742155] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-09-15T17:56:27.742212] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-09-15T17:56:27.743019] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-09-15T17:56:27.743074] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-09-15T17:56:28.099383] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:56:28.139848] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-15T17:56:28.457883] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-09-15T17:56:28.495200] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-15T17:56:29.257923] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-09-15T17:56:29.796242] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-15T17:56:30.048996] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-15T17:56:30.057818] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-09-15T17:56:30.859097] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-09-15T17:56:30.862289] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-15T17:56:31.657871] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-09-15T17:56:31.982949] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-15T17:56:32.457873] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-09-15T17:56:32.715534] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T17:56:33.257871] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-09-15T17:56:33.639357] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-15T17:56:34.057901] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-09-15T17:56:34.494281] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-15T17:56:34.857936] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-09-15T17:56:34.967734] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-15T17:56:34.969634] [INFO ] [REMOTE ] CSR: Full fetch complete (13244 records). [2025-09-15T17:56:34.969725] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-09-15T17:56:35.325401] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-09-15T17:56:35.325480] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-09-15T17:56:35.325789] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-09-15T17:56:35.325830] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-09-15T17:56:35.326323] [DEBUG] [LOCAL ] CSR: Trimmed 13244 records to 9476 (keeping 150 days of data) [2025-09-15T17:56:35.385546] [DEBUG] [LOCAL ] CSR: Primary data saved (9476 records). [2025-09-15T17:56:35.385713] [INFO ] [MAIN ] CSR: Full history saved. [2025-09-15T17:56:35.385802] [INFO ] [MAIN ] Update Progress: 537/2369 symbols completed. CSR took 17.2s. Estimated remaining: 3h 12m 52s. Rate: 9.5 symbols/min [2025-09-15T17:56:35.551681] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:56:35.561694] [DEBUG] [LOCAL ] CSV: Loaded 9150 existing records from primary storage. [2025-09-15T17:56:35.561798] [INFO ] [MAIN ] CSV: Loaded 9150 existing records. [2025-09-15T17:56:35.663702] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-09-15T17:56:35.741991] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:56:35.742286] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-09-15T17:56:35.742334] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-09-15T17:56:35.742950] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-09-15T17:56:35.743001] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-09-15T17:56:36.092270] [INFO ] [REMOTE ] CSV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:56:36.231207] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-15T17:56:36.457889] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-09-15T17:56:36.762321] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-15T17:56:36.767472] [INFO ] [REMOTE ] CSAN: Full fetch complete (45451 records). [2025-09-15T17:56:36.767579] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-09-15T17:56:37.139756] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-09-15T17:56:37.139835] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-09-15T17:56:37.140437] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-09-15T17:56:37.140478] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-09-15T17:56:37.141447] [DEBUG] [LOCAL ] CSAN: Trimmed 45451 records to 31174 (keeping 150 days of data) [2025-09-15T17:56:37.258060] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-09-15T17:56:37.329394] [DEBUG] [LOCAL ] CSAN: Primary data saved (31174 records). [2025-09-15T17:56:37.329528] [INFO ] [MAIN ] CSAN: Full history saved. [2025-09-15T17:56:37.330192] [INFO ] [MAIN ] Update Progress: 538/2369 symbols completed. CSAN took 30.0s. Estimated remaining: 3h 12m 31s. Rate: 9.5 symbols/min [2025-09-15T17:56:37.497358] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:56:37.497546] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-09-15T17:56:37.497588] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-09-15T17:56:37.497724] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-09-15T17:56:37.497764] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-15T17:56:37.497804] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-15T17:56:37.497836] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-09-15T17:56:37.761389] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-15T17:56:37.859611] [INFO ] [REMOTE ] CSW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:56:38.057873] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-02. [2025-09-15T17:56:38.240597] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:56:38.240974] [WARN ] [REMOTE ] CSW: No data returned for month 2025-02 [2025-09-15T17:56:38.553621] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-15T17:56:38.559129] [INFO ] [REMOTE ] CSL: Full fetch complete (34158 records). [2025-09-15T17:56:38.559370] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-09-15T17:56:38.863084] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-09-15T17:56:38.938615] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-09-15T17:56:38.938722] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-09-15T17:56:38.939341] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-09-15T17:56:38.939419] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-09-15T17:56:38.940296] [DEBUG] [LOCAL ] CSL: Trimmed 34158 records to 22192 (keeping 150 days of data) [2025-09-15T17:56:39.081136] [DEBUG] [LOCAL ] CSL: Primary data saved (22192 records). [2025-09-15T17:56:39.081268] [INFO ] [MAIN ] CSL: Full history saved. [2025-09-15T17:56:39.081357] [INFO ] [MAIN ] Update Progress: 539/2369 symbols completed. CSL took 22.4s. Estimated remaining: 3h 12m 9s. Rate: 9.5 symbols/min [2025-09-15T17:56:39.247611] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:56:39.254129] [DEBUG] [LOCAL ] CTBB: Loaded 4859 existing records from primary storage. [2025-09-15T17:56:39.254211] [INFO ] [MAIN ] CTBB: Loaded 4859 existing records. [2025-09-15T17:56:39.430762] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:56:39.431031] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-09-15T17:56:39.431076] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-09-15T17:56:39.431367] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-09-15T17:56:39.431413] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-09-15T17:56:39.666693] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-03. [2025-09-15T17:56:39.839529] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:56:39.852307] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-15T17:56:39.913854] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:56:39.914408] [WARN ] [REMOTE ] CSW: No data returned for month 2025-03 [2025-09-15T17:56:40.457964] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-09-15T17:56:41.257866] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-09-15T17:56:41.426248] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-15T17:56:42.057918] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-09-15T17:56:42.632803] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T17:56:42.679620] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-15T17:56:42.857850] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-09-15T17:56:43.446165] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-15T17:56:43.657900] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-09-15T17:56:44.282199] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-15T17:56:44.457885] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-09-15T17:56:45.257940] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-04. [2025-09-15T17:56:45.461409] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:56:45.461711] [WARN ] [REMOTE ] CSW: No data returned for month 2025-04 [2025-09-15T17:56:45.714000] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-15T17:56:46.057863] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-09-15T17:56:46.862443] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-09-15T17:56:46.865302] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-15T17:56:47.657873] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-09-15T17:56:48.233278] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T17:56:48.371746] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-15T17:56:48.457823] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-05. [2025-09-15T17:56:48.644408] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:56:48.644674] [WARN ] [REMOTE ] CSW: No data returned for month 2025-05 [2025-09-15T17:56:49.257863] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-09-15T17:56:50.057897] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-06. [2025-09-15T17:56:50.247631] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-15T17:56:50.857894] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-09-15T17:56:50.865132] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-15T17:56:51.657920] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-07. [2025-09-15T17:56:51.710464] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-15T17:56:52.292298] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-15T17:56:52.457895] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-09-15T17:56:53.040079] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-15T17:56:53.257876] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-09-15T17:56:54.004672] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-15T17:56:54.057832] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-09-15T17:56:54.742065] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-15T17:56:54.857861] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-08. [2025-09-15T17:56:55.657864] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-09-15T17:56:55.815029] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T17:56:56.457855] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-09-15T17:56:56.560472] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T17:56:56.562605] [INFO ] [REMOTE ] CSV: Full fetch complete (14415 records). [2025-09-15T17:56:56.562744] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-09-15T17:56:56.962559] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-09-15T17:56:56.962429] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-15T17:56:56.962734] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-09-15T17:56:56.965341] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-09-15T17:56:56.965696] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-09-15T17:56:56.966321] [DEBUG] [LOCAL ] CSV: Trimmed 14415 records to 8876 (keeping 150 days of data) [2025-09-15T17:56:57.026213] [DEBUG] [LOCAL ] CSV: Primary data saved (8876 records). [2025-09-15T17:56:57.026384] [INFO ] [MAIN ] CSV: Full history saved. [2025-09-15T17:56:57.026500] [INFO ] [MAIN ] Update Progress: 540/2369 symbols completed. CSV took 21.6s. Estimated remaining: 3h 12m 42s. Rate: 9.5 symbols/min [2025-09-15T17:56:57.201230] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:56:57.206946] [DEBUG] [LOCAL ] CTDD: Loaded 3852 existing records from primary storage. [2025-09-15T17:56:57.207036] [INFO ] [MAIN ] CTDD: Loaded 3852 existing records. [2025-09-15T17:56:57.268178] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-09-15T17:56:57.384806] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:56:57.385062] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-09-15T17:56:57.385125] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-09-15T17:56:57.385377] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-09-15T17:56:57.385423] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-09-15T17:56:57.772697] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:56:57.982036] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-15T17:56:57.983369] [INFO ] [REMOTE ] CTBB: Full fetch complete (7887 records). [2025-09-15T17:56:57.983438] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-09-15T17:56:58.062998] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-09-15T17:56:58.333824] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-09-15T17:56:58.333905] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-09-15T17:56:58.334111] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-09-15T17:56:58.334150] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-09-15T17:56:58.334589] [DEBUG] [LOCAL ] CTBB: Trimmed 7887 records to 4787 (keeping 150 days of data) [2025-09-15T17:56:58.364451] [DEBUG] [LOCAL ] CTBB: Primary data saved (4787 records). [2025-09-15T17:56:58.364547] [INFO ] [MAIN ] CTBB: Full history saved. [2025-09-15T17:56:58.364626] [INFO ] [MAIN ] Update Progress: 541/2369 symbols completed. CTBB took 19.3s. Estimated remaining: 3h 12m 19s. Rate: 9.5 symbols/min [2025-09-15T17:56:58.531901] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:56:58.532083] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-09-15T17:56:58.532121] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-09-15T17:56:58.532242] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-09-15T17:56:58.532281] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-15T17:56:58.532321] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-15T17:56:58.532352] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-09-15T17:56:58.811154] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-15T17:56:58.862921] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-09-15T17:56:58.889886] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:56:59.626159] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-15T17:56:59.657877] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-09-15T17:57:00.392735] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-15T17:57:00.457879] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-09-15T17:57:01.257879] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-02. [2025-09-15T17:57:01.691707] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:57:01.692004] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-02 [2025-09-15T17:57:02.059902] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-09-15T17:57:02.065975] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T17:57:02.857873] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-09. [2025-09-15T17:57:03.318137] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-15T17:57:03.657922] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-09-15T17:57:04.457909] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-03. [2025-09-15T17:57:04.560149] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-15T17:57:04.736755] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:57:04.737157] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-03 [2025-09-15T17:57:04.959960] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-15T17:57:04.962338] [INFO ] [REMOTE ] CSW: Full fetch complete (7238 records). [2025-09-15T17:57:04.962417] [DEBUG] [VALIDATOR ] CSW: Validating primary data. [2025-09-15T17:57:05.145625] [WARN ] [VALIDATOR ] CSW: Validation failed - insufficient historical data. Have 68 unique days, need 150 days [2025-09-15T17:57:05.145896] [FATAL] [MAIN ] CSW: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:57:05.145950] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:57:05.145990] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-15T17:57:05.146051] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-15T17:57:05.146088] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-09-15T17:57:05.146130] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-09-15T17:57:05.146188] [INFO ] [MAIN ] Update Progress: 542/2369 symbols completed. CSW took 27.8s. Estimated remaining: 3h 12m 14s. Rate: 9.5 symbols/min [2025-09-15T17:57:05.263067] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-09-15T17:57:05.322280] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:57:05.322483] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-09-15T17:57:05.322522] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-09-15T17:57:05.322666] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-09-15T17:57:05.322711] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-15T17:57:05.322758] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-15T17:57:05.322800] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-09-15T17:57:05.677274] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:57:05.888229] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-15T17:57:06.058049] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-04. [2025-09-15T17:57:06.274059] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:57:06.274370] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-04 [2025-09-15T17:57:06.857873] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-02. [2025-09-15T17:57:07.247096] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-15T17:57:07.657895] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-03. [2025-09-15T17:57:08.457937] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-09-15T17:57:08.488325] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-15T17:57:09.257879] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-09-15T17:57:09.941348] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T17:57:10.057849] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-09-15T17:57:10.124601] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-15T17:57:10.714011] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-15T17:57:10.715246] [INFO ] [REMOTE ] CTDD: Full fetch complete (6229 records). [2025-09-15T17:57:10.715316] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-09-15T17:57:10.865256] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-04. [2025-09-15T17:57:11.083404] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-09-15T17:57:11.083483] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-09-15T17:57:11.083692] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-09-15T17:57:11.083738] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-09-15T17:57:11.084173] [DEBUG] [LOCAL ] CTDD: Trimmed 6229 records to 3783 (keeping 150 days of data) [2025-09-15T17:57:11.108660] [DEBUG] [LOCAL ] CTDD: Primary data saved (3783 records). [2025-09-15T17:57:11.108797] [INFO ] [MAIN ] CTDD: Full history saved. [2025-09-15T17:57:11.108885] [INFO ] [MAIN ] Update Progress: 543/2369 symbols completed. CTDD took 14.1s. Estimated remaining: 3h 12m 7s. Rate: 9.5 symbols/min [2025-09-15T17:57:11.280858] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:57:11.281059] [DEBUG] [LOCAL ] CTO: No existing data file found in primary storage. [2025-09-15T17:57:11.281097] [WARN ] [MAIN ] CTO: No existing data found, performing full refresh instead. [2025-09-15T17:57:11.281248] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-09-15T17:57:11.281308] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-09-15T17:57:11.281350] [DEBUG] [LOCAL ] CTO: No primary data file found to delete. [2025-09-15T17:57:11.281391] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-09-15T17:57:11.640398] [INFO ] [REMOTE ] CTO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:57:11.657814] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-09-15T17:57:11.865677] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-15T17:57:12.457871] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-09-15T17:57:13.257924] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-05. [2025-09-15T17:57:13.337394] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T17:57:14.057885] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-09-15T17:57:14.191411] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-15T17:57:14.196933] [INFO ] [REMOTE ] CSTM: Full fetch complete (52245 records). [2025-09-15T17:57:14.197073] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-09-15T17:57:14.582353] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-09-15T17:57:14.582434] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-09-15T17:57:14.583098] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-09-15T17:57:14.583142] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-09-15T17:57:14.584299] [DEBUG] [LOCAL ] CSTM: Trimmed 52245 records to 34900 (keeping 150 days of data) [2025-09-15T17:57:14.654164] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-15T17:57:14.811905] [DEBUG] [LOCAL ] CSTM: Primary data saved (34900 records). [2025-09-15T17:57:14.812097] [INFO ] [MAIN ] CSTM: Full history saved. [2025-09-15T17:57:14.812219] [INFO ] [MAIN ] Update Progress: 544/2369 symbols completed. CSTM took 47.5s. Estimated remaining: 3h 11m 52s. Rate: 9.5 symbols/min [2025-09-15T17:57:14.866306] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-05. [2025-09-15T17:57:14.987539] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:57:15.014375] [DEBUG] [LOCAL ] CTOS: Loaded 27448 existing records from primary storage. [2025-09-15T17:57:15.014580] [INFO ] [MAIN ] CTOS: Loaded 27448 existing records. [2025-09-15T17:57:15.188824] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:57:15.189092] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-09-15T17:57:15.189139] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-09-15T17:57:15.189807] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-09-15T17:57:15.189864] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-09-15T17:57:15.544323] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:57:15.657864] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-09-15T17:57:15.760162] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-15T17:57:15.834581] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-15T17:57:16.457902] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-06. [2025-09-15T17:57:16.719683] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-15T17:57:16.975227] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T17:57:17.257891] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-09-15T17:57:18.057926] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-09-15T17:57:18.462243] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T17:57:18.857912] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-09-15T17:57:19.010569] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-15T17:57:19.657870] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-07. [2025-09-15T17:57:19.702993] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-15T17:57:19.874293] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-09-15T17:57:20.457917] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-09-15T17:57:21.207277] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-15T17:57:21.257847] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-09-15T17:57:22.057894] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-06. [2025-09-15T17:57:22.440230] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-15T17:57:22.857883] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-09-15T17:57:23.016402] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-15T17:57:23.657888] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-08. [2025-09-15T17:57:23.955486] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:57:23.955849] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-08 [2025-09-15T17:57:24.018691] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-15T17:57:24.457882] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-09-15T17:57:25.257879] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-09-15T17:57:25.590416] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-15T17:57:25.593755] [INFO ] [REMOTE ] CTO: Full fetch complete (31223 records). [2025-09-15T17:57:25.593842] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-09-15T17:57:25.962405] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-09-15T17:57:25.962494] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-09-15T17:57:25.963235] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-09-15T17:57:25.963300] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-09-15T17:57:25.964161] [DEBUG] [LOCAL ] CTO: Trimmed 31223 records to 19381 (keeping 150 days of data) [2025-09-15T17:57:26.061089] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-07. [2025-09-15T17:57:26.100370] [DEBUG] [LOCAL ] CTO: Primary data saved (19381 records). [2025-09-15T17:57:26.100547] [INFO ] [MAIN ] CTO: Full history saved. [2025-09-15T17:57:26.100632] [INFO ] [MAIN ] Update Progress: 545/2369 symbols completed. CTO took 15.0s. Estimated remaining: 3h 12m 2s. Rate: 9.5 symbols/min [2025-09-15T17:57:26.286827] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:57:26.332073] [DEBUG] [LOCAL ] CTRA: Loaded 40394 existing records from primary storage. [2025-09-15T17:57:26.332257] [INFO ] [MAIN ] CTRA: Loaded 40394 existing records. [2025-09-15T17:57:26.523156] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:57:26.523427] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-09-15T17:57:26.523487] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-09-15T17:57:26.524627] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-09-15T17:57:26.524722] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-09-15T17:57:26.870312] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-09. [2025-09-15T17:57:26.912020] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:57:26.925965] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-15T17:57:26.960883] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T17:57:27.420225] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T17:57:27.420711] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-09 [2025-09-15T17:57:27.420816] [INFO ] [REMOTE ] CTEST: Full fetch complete (1020 records). [2025-09-15T17:57:27.420902] [DEBUG] [VALIDATOR ] CTEST: Validating primary data. [2025-09-15T17:57:27.422264] [FATAL] [VALIDATOR ] CTEST: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T17:57:27.422632] [FATAL] [MAIN ] CTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:57:27.422720] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:57:27.422774] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-15T17:57:27.422842] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-15T17:57:27.422882] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-09-15T17:57:27.422929] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-09-15T17:57:27.423026] [INFO ] [MAIN ] Update Progress: 546/2369 symbols completed. CTEST took 29.1s. Estimated remaining: 3h 11m 39s. Rate: 9.5 symbols/min [2025-09-15T17:57:27.602943] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:57:27.650890] [DEBUG] [LOCAL ] CTRE: Loaded 36929 existing records from primary storage. [2025-09-15T17:57:27.651073] [INFO ] [MAIN ] CTRE: Loaded 36929 existing records. [2025-09-15T17:57:27.664737] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-09-15T17:57:27.857066] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:57:27.857396] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-09-15T17:57:27.857462] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-09-15T17:57:27.858310] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-09-15T17:57:27.858379] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-09-15T17:57:28.219535] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:57:28.457890] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-09-15T17:57:29.093178] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-15T17:57:29.257886] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-09-15T17:57:30.057875] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-08. [2025-09-15T17:57:30.120504] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-15T17:57:30.483494] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T17:57:30.655146] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-15T17:57:30.857863] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-09-15T17:57:31.657875] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-09. [2025-09-15T17:57:32.408197] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T17:57:32.457957] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-09-15T17:57:32.483213] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-15T17:57:32.485797] [INFO ] [REMOTE ] CTEV: Full fetch complete (12953 records). [2025-09-15T17:57:32.485920] [DEBUG] [VALIDATOR ] CTEV: Validating primary data. [2025-09-15T17:57:32.711432] [WARN ] [VALIDATOR ] CTEV: Validation failed - insufficient historical data. Have 137 unique days, need 150 days [2025-09-15T17:57:32.711988] [FATAL] [MAIN ] CTEV: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:57:32.712072] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:57:32.712131] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-15T17:57:32.712216] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-15T17:57:32.712257] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-09-15T17:57:32.712299] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-09-15T17:57:32.712387] [INFO ] [MAIN ] Update Progress: 547/2369 symbols completed. CTEV took 27.6s. Estimated remaining: 3h 11m 30s. Rate: 9.5 symbols/min [2025-09-15T17:57:32.936390] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:57:32.998586] [DEBUG] [LOCAL ] CTRI: Loaded 29300 existing records from primary storage. [2025-09-15T17:57:32.998955] [INFO ] [MAIN ] CTRI: Loaded 29300 existing records. [2025-09-15T17:57:33.264022] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-09-15T17:57:33.264348] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:57:33.266302] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-09-15T17:57:33.266423] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-09-15T17:57:33.267450] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-09-15T17:57:33.267535] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-09-15T17:57:33.721930] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:57:34.057903] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-09-15T17:57:34.307442] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-15T17:57:34.339893] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-15T17:57:34.857853] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-09-15T17:57:35.189707] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-15T17:57:35.657878] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-09-15T17:57:35.760555] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-15T17:57:36.457899] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-09-15T17:57:36.951969] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-15T17:57:37.257930] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-09-15T17:57:38.057927] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-09-15T17:57:38.097198] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-15T17:57:38.159662] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-15T17:57:38.857869] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-09-15T17:57:39.295592] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-15T17:57:39.299688] [INFO ] [REMOTE ] CTOS: Full fetch complete (39820 records). [2025-09-15T17:57:39.299780] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-09-15T17:57:39.663566] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-09-15T17:57:39.686209] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-09-15T17:57:39.686324] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-09-15T17:57:39.687039] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-09-15T17:57:39.687207] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-09-15T17:57:39.688705] [DEBUG] [LOCAL ] CTOS: Trimmed 39820 records to 26642 (keeping 150 days of data) [2025-09-15T17:57:39.853540] [DEBUG] [LOCAL ] CTOS: Primary data saved (26642 records). [2025-09-15T17:57:39.853711] [INFO ] [MAIN ] CTOS: Full history saved. [2025-09-15T17:57:39.853832] [INFO ] [MAIN ] Update Progress: 548/2369 symbols completed. CTOS took 25.0s. Estimated remaining: 3h 11m 26s. Rate: 9.5 symbols/min [2025-09-15T17:57:40.028334] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:57:40.045003] [DEBUG] [LOCAL ] CTS: Loaded 14207 existing records from primary storage. [2025-09-15T17:57:40.045139] [INFO ] [MAIN ] CTS: Loaded 14207 existing records. [2025-09-15T17:57:40.219864] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:57:40.220119] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-09-15T17:57:40.220186] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-09-15T17:57:40.220545] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-09-15T17:57:40.220590] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-09-15T17:57:40.464634] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-09-15T17:57:40.574623] [INFO ] [REMOTE ] CTS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:57:40.663706] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-15T17:57:40.695965] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-15T17:57:41.257893] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-09-15T17:57:41.819494] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T17:57:42.057899] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-09-15T17:57:42.439008] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-15T17:57:42.857864] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-09-15T17:57:43.454629] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-15T17:57:43.657926] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-09-15T17:57:44.442946] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-15T17:57:44.464270] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-09-15T17:57:44.465935] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-15T17:57:45.257871] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-09-15T17:57:45.834095] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T17:57:46.057927] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-09-15T17:57:46.280327] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-15T17:57:46.857933] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-09-15T17:57:47.333313] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T17:57:47.657870] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-09-15T17:57:48.457873] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-09-15T17:57:48.661103] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-15T17:57:48.779866] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-15T17:57:48.785372] [INFO ] [REMOTE ] CTRE: Full fetch complete (53477 records). [2025-09-15T17:57:48.785472] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-09-15T17:57:49.164955] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-09-15T17:57:49.165062] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-09-15T17:57:49.165752] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-09-15T17:57:49.165806] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-09-15T17:57:49.167168] [DEBUG] [LOCAL ] CTRE: Trimmed 53477 records to 36257 (keeping 150 days of data) [2025-09-15T17:57:49.263213] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-09-15T17:57:49.413315] [DEBUG] [LOCAL ] CTRE: Primary data saved (36257 records). [2025-09-15T17:57:49.413457] [INFO ] [MAIN ] CTRE: Full history saved. [2025-09-15T17:57:49.413996] [INFO ] [MAIN ] Update Progress: 549/2369 symbols completed. CTRE took 22.0s. Estimated remaining: 3h 11m 30s. Rate: 9.5 symbols/min [2025-09-15T17:57:49.579730] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:57:49.618833] [DEBUG] [LOCAL ] CTVA: Loaded 40082 existing records from primary storage. [2025-09-15T17:57:49.618970] [INFO ] [MAIN ] CTVA: Loaded 40082 existing records. [2025-09-15T17:57:49.814478] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:57:49.816053] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-15T17:57:49.823480] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-09-15T17:57:49.823890] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-09-15T17:57:49.825176] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-09-15T17:57:49.825232] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-09-15T17:57:50.067940] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-09-15T17:57:50.179750] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:57:50.659407] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T17:57:50.862921] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-09-15T17:57:50.871216] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-15T17:57:51.657925] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-09-15T17:57:52.457914] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-09-15T17:57:52.719548] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-15T17:57:52.725797] [INFO ] [REMOTE ] CTRA: Full fetch complete (58329 records). [2025-09-15T17:57:52.726011] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-09-15T17:57:52.834328] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-15T17:57:53.128878] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-09-15T17:57:53.128969] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-09-15T17:57:53.129692] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-09-15T17:57:53.129738] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-09-15T17:57:53.131080] [DEBUG] [LOCAL ] CTRA: Trimmed 58329 records to 39612 (keeping 150 days of data) [2025-09-15T17:57:53.258468] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-09-15T17:57:53.391625] [DEBUG] [LOCAL ] CTRA: Primary data saved (39612 records). [2025-09-15T17:57:53.391816] [INFO ] [MAIN ] CTRA: Full history saved. [2025-09-15T17:57:53.392679] [INFO ] [MAIN ] Update Progress: 550/2369 symbols completed. CTRA took 27.3s. Estimated remaining: 3h 11m 16s. Rate: 9.5 symbols/min [2025-09-15T17:57:53.564559] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:57:53.564772] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-09-15T17:57:53.564814] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-09-15T17:57:53.564942] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-09-15T17:57:53.564981] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-15T17:57:53.565022] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-15T17:57:53.565054] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-09-15T17:57:53.932765] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:57:53.963612] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-15T17:57:54.057894] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-09-15T17:57:54.595880] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-15T17:57:54.857876] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-09-15T17:57:55.547463] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-15T17:57:55.657868] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-09-15T17:57:55.846515] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-15T17:57:56.101812] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-15T17:57:56.457869] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-09-15T17:57:57.210996] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-15T17:57:57.257822] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-09-15T17:57:58.057909] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-09-15T17:57:58.301121] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-15T17:57:58.309329] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-15T17:57:58.857881] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-09-15T17:57:59.657904] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-09-15T17:57:59.983868] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-15T17:58:00.462704] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-09-15T17:58:00.467841] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T17:58:00.806254] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-15T17:58:01.257874] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-09-15T17:58:01.874114] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-15T17:58:02.057848] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-09-15T17:58:02.857888] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-09-15T17:58:03.112454] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-15T17:58:03.114931] [INFO ] [REMOTE ] CTS: Full fetch complete (20645 records). [2025-09-15T17:58:03.115010] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-09-15T17:58:03.475521] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-09-15T17:58:03.475606] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-09-15T17:58:03.476072] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-09-15T17:58:03.476118] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-09-15T17:58:03.476791] [DEBUG] [LOCAL ] CTS: Trimmed 20645 records to 13778 (keeping 150 days of data) [2025-09-15T17:58:03.561250] [DEBUG] [LOCAL ] CTS: Primary data saved (13778 records). [2025-09-15T17:58:03.561389] [INFO ] [MAIN ] CTS: Full history saved. [2025-09-15T17:58:03.561485] [INFO ] [MAIN ] Update Progress: 551/2369 symbols completed. CTS took 23.7s. Estimated remaining: 3h 11m 23s. Rate: 9.5 symbols/min [2025-09-15T17:58:03.662834] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-09-15T17:58:03.733392] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:58:03.770822] [DEBUG] [LOCAL ] CUBE: Loaded 38219 existing records from primary storage. [2025-09-15T17:58:03.770982] [INFO ] [MAIN ] CUBE: Loaded 38219 existing records. [2025-09-15T17:58:03.946793] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:58:03.947001] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-09-15T17:58:03.947053] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-09-15T17:58:03.947963] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-09-15T17:58:03.948014] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-09-15T17:58:04.334013] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:58:04.348388] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-15T17:58:04.353890] [INFO ] [REMOTE ] CTRI: Full fetch complete (39693 records). [2025-09-15T17:58:04.353972] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-09-15T17:58:04.462920] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-09-15T17:58:04.725395] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-09-15T17:58:04.725472] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-09-15T17:58:04.726048] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-09-15T17:58:04.726091] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-09-15T17:58:04.726968] [DEBUG] [LOCAL ] CTRI: Trimmed 39693 records to 29026 (keeping 150 days of data) [2025-09-15T17:58:04.901588] [DEBUG] [LOCAL ] CTRI: Primary data saved (29026 records). [2025-09-15T17:58:04.901745] [INFO ] [MAIN ] CTRI: Full history saved. [2025-09-15T17:58:04.901830] [INFO ] [MAIN ] Update Progress: 552/2369 symbols completed. CTRI took 32.2s. Estimated remaining: 3h 11m 0s. Rate: 9.5 symbols/min [2025-09-15T17:58:05.074031] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:58:05.093069] [DEBUG] [LOCAL ] CUBI: Loaded 20046 existing records from primary storage. [2025-09-15T17:58:05.093194] [INFO ] [MAIN ] CUBI: Loaded 20046 existing records. [2025-09-15T17:58:05.268290] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-09-15T17:58:05.273637] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:58:05.274722] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-09-15T17:58:05.274786] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-09-15T17:58:05.275374] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-09-15T17:58:05.275485] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-09-15T17:58:05.544512] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-15T17:58:05.638082] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:58:05.667375] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-15T17:58:05.929844] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-15T17:58:06.057840] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-09-15T17:58:06.419493] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-15T17:58:06.857883] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-09-15T17:58:07.657891] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-09-15T17:58:07.977881] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-15T17:58:08.457918] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-09-15T17:58:08.825025] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-15T17:58:08.825875] [INFO ] [REMOTE ] CUBB: Full fetch complete (737 records). [2025-09-15T17:58:08.825950] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-09-15T17:58:09.006571] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 138 unique days, need 150 days [2025-09-15T17:58:09.006846] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-09-15T17:58:09.006905] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-09-15T17:58:09.006951] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-15T17:58:09.007088] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-15T17:58:09.007130] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-09-15T17:58:09.007297] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-09-15T17:58:09.007366] [INFO ] [MAIN ] Update Progress: 553/2369 symbols completed. CUBB took 15.6s. Estimated remaining: 3h 10m 47s. Rate: 9.5 symbols/min [2025-09-15T17:58:09.137101] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-15T17:58:09.221547] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:58:09.258544] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-09-15T17:58:09.260117] [DEBUG] [LOCAL ] CUK: Loaded 38115 existing records from primary storage. [2025-09-15T17:58:09.260198] [INFO ] [MAIN ] CUK: Loaded 38115 existing records. [2025-09-15T17:58:09.437235] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:58:09.437505] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-09-15T17:58:09.437554] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-09-15T17:58:09.438322] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-09-15T17:58:09.438373] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-09-15T17:58:09.790659] [INFO ] [REMOTE ] CUK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:58:10.057954] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-09-15T17:58:10.832278] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-15T17:58:10.857818] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-09-15T17:58:11.391717] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-15T17:58:11.657873] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-09-15T17:58:12.458195] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-09-15T17:58:12.461260] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-15T17:58:12.683495] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-15T17:58:13.257923] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-09-15T17:58:13.833797] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-15T17:58:14.057893] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-09-15T17:58:14.857914] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-09-15T17:58:15.105412] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-15T17:58:15.657988] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-09-15T17:58:15.966499] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-15T17:58:16.432277] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T17:58:16.457834] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-09-15T17:58:17.257952] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-09-15T17:58:17.517054] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-15T17:58:17.605536] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-15T17:58:18.057893] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-09-15T17:58:18.378095] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-15T17:58:18.857877] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-09-15T17:58:19.385000] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T17:58:19.657883] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-09-15T17:58:20.472466] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-09-15T17:58:20.504484] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T17:58:21.040157] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-15T17:58:21.257873] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-09-15T17:58:22.057844] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-09-15T17:58:22.190761] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-15T17:58:22.857897] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-09-15T17:58:23.091842] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-15T17:58:23.619223] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-15T17:58:23.657826] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-09-15T17:58:24.391201] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T17:58:24.396935] [INFO ] [REMOTE ] CTVA: Full fetch complete (57836 records). [2025-09-15T17:58:24.397033] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-09-15T17:58:24.462934] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-09-15T17:58:24.773859] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-09-15T17:58:24.774038] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-09-15T17:58:24.774806] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-09-15T17:58:24.774862] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-09-15T17:58:24.781327] [DEBUG] [LOCAL ] CTVA: Trimmed 57836 records to 39324 (keeping 150 days of data) [2025-09-15T17:58:24.790922] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-15T17:58:24.859953] [INFO ] [REMOTE ] CUBE: Full fetch complete (54949 records). [2025-09-15T17:58:24.860157] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-09-15T17:58:25.263884] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-09-15T17:58:25.644456] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-09-15T17:58:25.650485] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-09-15T17:58:25.657407] [DEBUG] [LOCAL ] CTVA: Primary data saved (39324 records). [2025-09-15T17:58:25.657615] [INFO ] [MAIN ] CTVA: Full history saved. [2025-09-15T17:58:25.658054] [INFO ] [MAIN ] Update Progress: 554/2369 symbols completed. CTVA took 36.2s. Estimated remaining: 3h 11m 14s. Rate: 9.5 symbols/min [2025-09-15T17:58:25.680183] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-09-15T17:58:25.707934] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-09-15T17:58:25.761147] [DEBUG] [LOCAL ] CUBE: Trimmed 54949 records to 37556 (keeping 150 days of data) [2025-09-15T17:58:26.130897] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:58:26.176377] [DEBUG] [LOCAL ] CULP: Loaded 2034 existing records from primary storage. [2025-09-15T17:58:26.177259] [INFO ] [MAIN ] CULP: Loaded 2034 existing records. [2025-09-15T17:58:26.316715] [DEBUG] [LOCAL ] CUBE: Primary data saved (37556 records). [2025-09-15T17:58:26.327880] [INFO ] [MAIN ] CUBE: Full history saved. [2025-09-15T17:58:26.340345] [INFO ] [MAIN ] Update Progress: 555/2369 symbols completed. CUBE took 22.8s. Estimated remaining: 3h 10m 49s. Rate: 9.5 symbols/min [2025-09-15T17:58:26.444078] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:58:26.537018] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-15T17:58:26.549562] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-09-15T17:58:26.555870] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-09-15T17:58:26.576606] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-09-15T17:58:26.603724] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-09-15T17:58:26.623807] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-09-15T17:58:26.623737] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:58:26.909672] [DEBUG] [LOCAL ] CURB: Loaded 23951 existing records from primary storage. [2025-09-15T17:58:26.921809] [INFO ] [MAIN ] CURB: Loaded 23951 existing records. [2025-09-15T17:58:27.093617] [INFO ] [REMOTE ] CULP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:58:27.113560] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-09-15T17:58:27.134596] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-15T17:58:27.226548] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:58:27.226827] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-09-15T17:58:27.226877] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-09-15T17:58:27.227441] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-09-15T17:58:27.227494] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-09-15T17:58:27.584831] [INFO ] [REMOTE ] CURB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:58:27.657900] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-09-15T17:58:27.718660] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-15T17:58:28.311881] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-15T17:58:28.317611] [INFO ] [REMOTE ] CUK: Full fetch complete (55539 records). [2025-09-15T17:58:28.317751] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-09-15T17:58:28.470059] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-09-15T17:58:28.716983] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-09-15T17:58:28.717081] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-09-15T17:58:28.717823] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-09-15T17:58:28.717987] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-09-15T17:58:28.732047] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-15T17:58:28.736858] [DEBUG] [LOCAL ] CUK: Trimmed 55539 records to 37358 (keeping 150 days of data) [2025-09-15T17:58:28.947829] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-15T17:58:28.968514] [DEBUG] [LOCAL ] CUK: Primary data saved (37358 records). [2025-09-15T17:58:28.968689] [INFO ] [MAIN ] CUK: Full history saved. [2025-09-15T17:58:28.968775] [INFO ] [MAIN ] Update Progress: 556/2369 symbols completed. CUK took 20.0s. Estimated remaining: 3h 10m 31s. Rate: 9.5 symbols/min [2025-09-15T17:58:29.135152] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:58:29.155787] [DEBUG] [LOCAL ] CURV: Loaded 19974 existing records from primary storage. [2025-09-15T17:58:29.155945] [INFO ] [MAIN ] CURV: Loaded 19974 existing records. [2025-09-15T17:58:29.259146] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-09-15T17:58:29.339569] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:58:29.339864] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-09-15T17:58:29.339922] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-09-15T17:58:29.340513] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-09-15T17:58:29.340569] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-09-15T17:58:29.693210] [INFO ] [REMOTE ] CURV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:58:30.057888] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-09-15T17:58:30.365392] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-15T17:58:30.468614] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-15T17:58:30.857893] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-09-15T17:58:31.657905] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-09-15T17:58:32.015043] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-15T17:58:32.457889] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-09-15T17:58:32.936587] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T17:58:33.106264] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-15T17:58:33.257893] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-09-15T17:58:34.057900] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-09-15T17:58:34.408245] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-15T17:58:34.858343] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-15T17:58:34.858482] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-09-15T17:58:35.320394] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-15T17:58:35.657956] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-09-15T17:58:36.457896] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-09-15T17:58:36.788063] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-15T17:58:37.257902] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-09-15T17:58:37.732161] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-15T17:58:38.057913] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-09-15T17:58:38.303255] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-15T17:58:38.608994] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-15T17:58:38.857881] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-09-15T17:58:39.657884] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-09-15T17:58:39.803117] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-15T17:58:40.100022] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-15T17:58:40.457872] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-09-15T17:58:40.897239] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-15T17:58:41.257866] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-09-15T17:58:41.836315] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-15T17:58:41.837276] [INFO ] [REMOTE ] CULP: Full fetch complete (3333 records). [2025-09-15T17:58:41.837343] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-09-15T17:58:42.065793] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-09-15T17:58:42.193727] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-09-15T17:58:42.193805] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-09-15T17:58:42.193926] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-09-15T17:58:42.193964] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-09-15T17:58:42.194335] [DEBUG] [LOCAL ] CULP: Trimmed 3333 records to 1982 (keeping 150 days of data) [2025-09-15T17:58:42.206110] [DEBUG] [LOCAL ] CULP: Primary data saved (1982 records). [2025-09-15T17:58:42.206169] [INFO ] [MAIN ] CULP: Full history saved. [2025-09-15T17:58:42.206238] [INFO ] [MAIN ] Update Progress: 557/2369 symbols completed. CULP took 16.5s. Estimated remaining: 3h 10m 47s. Rate: 9.5 symbols/min [2025-09-15T17:58:42.857872] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-09-15T17:58:43.396135] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T17:58:43.657899] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-09-15T17:58:43.809565] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-15T17:58:43.813178] [INFO ] [REMOTE ] CUBI: Full fetch complete (29050 records). [2025-09-15T17:58:43.813262] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-09-15T17:58:44.191939] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-09-15T17:58:44.192152] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-09-15T17:58:44.192660] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-09-15T17:58:44.192704] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-09-15T17:58:44.193501] [DEBUG] [LOCAL ] CUBI: Trimmed 29050 records to 19575 (keeping 150 days of data) [2025-09-15T17:58:44.311854] [DEBUG] [LOCAL ] CUBI: Primary data saved (19575 records). [2025-09-15T17:58:44.312024] [INFO ] [MAIN ] CUBI: Full history saved. [2025-09-15T17:58:44.312150] [INFO ] [MAIN ] Update Progress: 558/2369 symbols completed. CUBI took 39.4s. Estimated remaining: 3h 10m 27s. Rate: 9.5 symbols/min [2025-09-15T17:58:44.457877] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-09-15T17:58:44.842956] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T17:58:45.257930] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-09-15T17:58:45.756774] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-15T17:58:46.057925] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-09-15T17:58:46.600252] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-15T17:58:46.857905] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-09-15T17:58:47.094949] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-15T17:58:47.657865] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-09-15T17:58:47.790207] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-15T17:58:48.457857] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-09-15T17:58:48.488456] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-15T17:58:49.257919] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-09-15T17:58:49.763853] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-15T17:58:49.767714] [INFO ] [REMOTE ] CURB: Full fetch complete (35549 records). [2025-09-15T17:58:49.767796] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-09-15T17:58:50.165458] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-09-15T17:58:50.165631] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-09-15T17:58:50.166668] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-09-15T17:58:50.166742] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-09-15T17:58:50.173721] [DEBUG] [LOCAL ] CURB: Trimmed 35549 records to 23402 (keeping 150 days of data) [2025-09-15T17:58:50.182211] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-15T17:58:50.187158] [INFO ] [REMOTE ] CURV: Full fetch complete (28525 records). [2025-09-15T17:58:50.187313] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-09-15T17:58:50.666750] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-09-15T17:58:50.667844] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-09-15T17:58:50.669675] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-09-15T17:58:50.669959] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-09-15T17:58:50.676155] [DEBUG] [LOCAL ] CURV: Trimmed 28525 records to 19728 (keeping 150 days of data) [2025-09-15T17:58:50.794119] [DEBUG] [LOCAL ] CURB: Primary data saved (23402 records). [2025-09-15T17:58:50.795303] [INFO ] [MAIN ] CURB: Full history saved. [2025-09-15T17:58:50.795837] [INFO ] [MAIN ] Update Progress: 559/2369 symbols completed. CURB took 24.4s. Estimated remaining: 3h 10m 22s. Rate: 9.5 symbols/min [2025-09-15T17:58:50.824555] [DEBUG] [LOCAL ] CURV: Primary data saved (19728 records). [2025-09-15T17:58:50.824726] [INFO ] [MAIN ] CURV: Full history saved. [2025-09-15T17:58:50.824824] [INFO ] [MAIN ] Update Progress: 560/2369 symbols completed. CURV took 21.9s. Estimated remaining: 3h 9m 55s. Rate: 9.5 symbols/min [2025-09-15T17:58:51.368222] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:58:51.516905] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:58:51.470920] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:58:51.551108] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:58:51.588389] [DEBUG] [LOCAL ] CVEO: Loaded 11781 existing records from primary storage. [2025-09-15T17:58:51.588702] [INFO ] [MAIN ] CVEO: Loaded 11781 existing records. [2025-09-15T17:58:51.739552] [DEBUG] [LOCAL ] CVE: Loaded 40314 existing records from primary storage. [2025-09-15T17:58:51.755194] [DEBUG] [LOCAL ] CVI: Loaded 34598 existing records from primary storage. [2025-09-15T17:58:51.756087] [DEBUG] [LOCAL ] CUZ: Loaded 37222 existing records from primary storage. [2025-09-15T17:58:51.756259] [INFO ] [MAIN ] CUZ: Loaded 37222 existing records. [2025-09-15T17:58:51.756202] [INFO ] [MAIN ] CVE: Loaded 40314 existing records. [2025-09-15T17:58:51.761620] [INFO ] [MAIN ] CVI: Loaded 34598 existing records. [2025-09-15T17:58:52.158257] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:58:52.274521] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-09-15T17:58:52.319959] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-09-15T17:58:52.366124] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:58:52.405080] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:58:52.460516] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-09-15T17:58:52.460743] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-09-15T17:58:52.460614] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:58:52.460931] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-09-15T17:58:52.461061] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-09-15T17:58:52.461110] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-09-15T17:58:52.461197] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-09-15T17:58:52.461277] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-09-15T17:58:52.460831] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-09-15T17:58:52.468686] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-09-15T17:58:52.473884] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-09-15T17:58:52.474076] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-09-15T17:58:52.493691] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-09-15T17:58:52.483366] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-09-15T17:58:52.526708] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-09-15T17:58:53.830231] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:58:53.814999] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:58:53.877839] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-09-15T17:58:53.886008] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-09-15T17:58:53.938411] [INFO ] [REMOTE ] CVI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:58:53.960564] [INFO ] [REMOTE ] CVE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:58:53.961490] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-09-15T17:58:53.960938] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-09-15T17:58:54.561824] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-15T17:58:54.564789] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-09-15T17:58:55.439115] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-15T17:58:55.447700] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-09-15T17:58:55.485607] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-15T17:58:55.489612] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-09-15T17:58:55.567389] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T17:58:55.662412] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-09-15T17:58:55.667729] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-15T17:58:56.118490] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-15T17:58:56.457912] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-09-15T17:58:56.715352] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-15T17:58:56.755348] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T17:58:57.257911] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-09-15T17:58:58.057832] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-09-15T17:58:58.163664] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-15T17:58:58.437781] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-15T17:58:58.862974] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-09-15T17:58:58.871906] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-15T17:58:59.657936] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-09-15T17:59:00.457931] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-09-15T17:59:00.710831] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-15T17:59:00.994540] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T17:59:01.257879] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-09-15T17:59:01.404032] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-15T17:59:02.057913] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-09-15T17:59:02.455195] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-15T17:59:02.857928] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-09-15T17:59:03.657895] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-09-15T17:59:03.772635] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-15T17:59:04.306054] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-15T17:59:04.457883] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-09-15T17:59:04.699020] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-15T17:59:05.257898] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-09-15T17:59:06.057875] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-09-15T17:59:06.186416] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-15T17:59:06.589838] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-15T17:59:06.857881] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-09-15T17:59:07.657922] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-09-15T17:59:07.932024] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-15T17:59:08.457895] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-09-15T17:59:08.538978] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-15T17:59:08.612808] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T17:59:09.257886] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-09-15T17:59:09.877116] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T17:59:09.879221] [INFO ] [REMOTE ] CVEO: Full fetch complete (16868 records). [2025-09-15T17:59:09.879290] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-09-15T17:59:10.058858] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-09-15T17:59:10.196983] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-15T17:59:10.284892] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-09-15T17:59:10.284969] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-09-15T17:59:10.285364] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-09-15T17:59:10.285415] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-09-15T17:59:10.285955] [DEBUG] [LOCAL ] CVEO: Trimmed 16868 records to 11679 (keeping 150 days of data) [2025-09-15T17:59:10.354229] [DEBUG] [LOCAL ] CVEO: Primary data saved (11679 records). [2025-09-15T17:59:10.354368] [INFO ] [MAIN ] CVEO: Full history saved. [2025-09-15T17:59:10.354486] [INFO ] [MAIN ] Update Progress: 561/2369 symbols completed. CVEO took 19.5s. Estimated remaining: 3h 10m 31s. Rate: 9.5 symbols/min [2025-09-15T17:59:10.522161] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:59:10.534883] [DEBUG] [LOCAL ] CVLG: Loaded 11706 existing records from primary storage. [2025-09-15T17:59:10.535005] [INFO ] [MAIN ] CVLG: Loaded 11706 existing records. [2025-09-15T17:59:10.714154] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:59:10.714480] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-09-15T17:59:10.714544] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-09-15T17:59:10.715000] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-09-15T17:59:10.715050] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-09-15T17:59:10.863006] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-09-15T17:59:11.070518] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:59:11.537969] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-15T17:59:11.657848] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-09-15T17:59:12.457876] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-09-15T17:59:12.682441] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-15T17:59:12.758583] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T17:59:13.257889] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-09-15T17:59:13.637375] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-15T17:59:13.643138] [INFO ] [REMOTE ] CUZ: Full fetch complete (53419 records). [2025-09-15T17:59:13.643240] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-09-15T17:59:14.017612] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-09-15T17:59:14.017708] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-09-15T17:59:14.018383] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-09-15T17:59:14.018426] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-09-15T17:59:14.019471] [DEBUG] [LOCAL ] CUZ: Trimmed 53419 records to 36592 (keeping 150 days of data) [2025-09-15T17:59:14.074522] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-09-15T17:59:14.250119] [DEBUG] [LOCAL ] CUZ: Primary data saved (36592 records). [2025-09-15T17:59:14.250280] [INFO ] [MAIN ] CUZ: Full history saved. [2025-09-15T17:59:14.250375] [INFO ] [MAIN ] Update Progress: 562/2369 symbols completed. CUZ took 23.4s. Estimated remaining: 3h 10m 17s. Rate: 9.5 symbols/min [2025-09-15T17:59:14.421541] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:59:14.459800] [DEBUG] [LOCAL ] CVNA: Loaded 39897 existing records from primary storage. [2025-09-15T17:59:14.459935] [INFO ] [MAIN ] CVNA: Loaded 39897 existing records. [2025-09-15T17:59:14.635000] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:59:14.635279] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-09-15T17:59:14.635386] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-09-15T17:59:14.636271] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-09-15T17:59:14.636323] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-09-15T17:59:14.866381] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-09-15T17:59:14.997213] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:59:15.006789] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-15T17:59:15.012114] [INFO ] [REMOTE ] CVI: Full fetch complete (50274 records). [2025-09-15T17:59:15.012206] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-09-15T17:59:15.388206] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-09-15T17:59:15.388328] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-09-15T17:59:15.389171] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-09-15T17:59:15.389232] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-09-15T17:59:15.390662] [DEBUG] [LOCAL ] CVI: Trimmed 50274 records to 33984 (keeping 150 days of data) [2025-09-15T17:59:15.511921] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-15T17:59:15.534139] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-15T17:59:15.656804] [DEBUG] [LOCAL ] CVI: Primary data saved (33984 records). [2025-09-15T17:59:15.657001] [INFO ] [MAIN ] CVI: Full history saved. [2025-09-15T17:59:15.657124] [INFO ] [MAIN ] Update Progress: 563/2369 symbols completed. CVI took 24.8s. Estimated remaining: 3h 9m 55s. Rate: 9.5 symbols/min [2025-09-15T17:59:15.663129] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-09-15T17:59:15.830742] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:59:15.871459] [DEBUG] [LOCAL ] CVS: Loaded 40438 existing records from primary storage. [2025-09-15T17:59:15.871629] [INFO ] [MAIN ] CVS: Loaded 40438 existing records. [2025-09-15T17:59:16.048095] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:59:16.048372] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-09-15T17:59:16.048418] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-09-15T17:59:16.049289] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-09-15T17:59:16.049351] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-09-15T17:59:16.405671] [INFO ] [REMOTE ] CVS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:59:16.457850] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-09-15T17:59:17.257894] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-09-15T17:59:17.488484] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-15T17:59:18.057834] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-09-15T17:59:18.179775] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-15T17:59:18.857891] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-09-15T17:59:18.968419] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-15T17:59:18.974511] [INFO ] [REMOTE ] CVE: Full fetch complete (58231 records). [2025-09-15T17:59:18.974718] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-09-15T17:59:19.367171] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-09-15T17:59:19.367258] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-09-15T17:59:19.367989] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-09-15T17:59:19.368076] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-09-15T17:59:19.370920] [DEBUG] [LOCAL ] CVE: Trimmed 58231 records to 39534 (keeping 150 days of data) [2025-09-15T17:59:19.507999] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-15T17:59:19.633101] [DEBUG] [LOCAL ] CVE: Primary data saved (39534 records). [2025-09-15T17:59:19.633247] [INFO ] [MAIN ] CVE: Full history saved. [2025-09-15T17:59:19.633341] [INFO ] [MAIN ] Update Progress: 564/2369 symbols completed. CVE took 28.8s. Estimated remaining: 3h 9m 41s. Rate: 9.5 symbols/min [2025-09-15T17:59:19.665389] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-09-15T17:59:19.807848] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:59:19.850506] [DEBUG] [LOCAL ] CVX: Loaded 40500 existing records from primary storage. [2025-09-15T17:59:19.850665] [INFO ] [MAIN ] CVX: Loaded 40500 existing records. [2025-09-15T17:59:20.031496] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:59:20.031780] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-09-15T17:59:20.031842] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-09-15T17:59:20.032780] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-09-15T17:59:20.032832] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-09-15T17:59:20.388796] [INFO ] [REMOTE ] CVX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:59:20.444944] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-15T17:59:20.457810] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-09-15T17:59:21.257884] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-09-15T17:59:21.555245] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-15T17:59:22.057868] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-09-15T17:59:22.378496] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-15T17:59:22.841457] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-15T17:59:22.857813] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-09-15T17:59:23.657908] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-09-15T17:59:23.973260] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-15T17:59:24.457941] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-09-15T17:59:25.045166] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-15T17:59:25.257861] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-09-15T17:59:25.668391] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-15T17:59:26.057880] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-09-15T17:59:26.596485] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-15T17:59:26.857890] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-09-15T17:59:27.161162] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-15T17:59:27.461014] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-15T17:59:27.657907] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-09-15T17:59:28.457935] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-09-15T17:59:28.551167] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-15T17:59:28.692537] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-15T17:59:29.257874] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-09-15T17:59:29.853508] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-15T17:59:30.057870] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-09-15T17:59:30.161737] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-15T17:59:30.857947] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-09-15T17:59:31.657882] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-09-15T17:59:31.775407] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-15T17:59:32.091465] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-15T17:59:32.457947] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-09-15T17:59:33.257945] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-09-15T17:59:33.984449] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T17:59:34.059328] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-09-15T17:59:34.065749] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T17:59:34.308127] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-09-15T17:59:34.857873] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-09-15T17:59:35.657906] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-09-15T17:59:35.698926] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-15T17:59:35.700720] [INFO ] [REMOTE ] CVLG: Full fetch complete (16182 records). [2025-09-15T17:59:35.700823] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-09-15T17:59:36.074802] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-09-15T17:59:36.074979] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-09-15T17:59:36.075423] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-09-15T17:59:36.075481] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-09-15T17:59:36.076256] [DEBUG] [LOCAL ] CVLG: Trimmed 16182 records to 11290 (keeping 150 days of data) [2025-09-15T17:59:36.170573] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-15T17:59:36.197650] [DEBUG] [LOCAL ] CVLG: Primary data saved (11290 records). [2025-09-15T17:59:36.197789] [INFO ] [MAIN ] CVLG: Full history saved. [2025-09-15T17:59:36.197915] [INFO ] [MAIN ] Update Progress: 565/2369 symbols completed. CVLG took 25.8s. Estimated remaining: 3h 10m 8s. Rate: 9.5 symbols/min [2025-09-15T17:59:36.368409] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:59:36.388363] [DEBUG] [LOCAL ] CW: Loaded 16960 existing records from primary storage. [2025-09-15T17:59:36.388486] [INFO ] [MAIN ] CW: Loaded 16960 existing records. [2025-09-15T17:59:36.462959] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-09-15T17:59:36.565859] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:59:36.566136] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-09-15T17:59:36.566187] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-09-15T17:59:36.566713] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-09-15T17:59:36.566769] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-09-15T17:59:36.926242] [INFO ] [REMOTE ] CW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:59:37.257969] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-09-15T17:59:37.930579] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-15T17:59:38.054401] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-15T17:59:38.060171] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-09-15T17:59:38.063246] [INFO ] [REMOTE ] CVS: Full fetch complete (58378 records). [2025-09-15T17:59:38.063559] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-09-15T17:59:38.542956] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-09-15T17:59:38.543066] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-09-15T17:59:38.543888] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-09-15T17:59:38.543966] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-09-15T17:59:38.561051] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-15T17:59:38.566882] [DEBUG] [LOCAL ] CVS: Trimmed 58378 records to 39658 (keeping 150 days of data) [2025-09-15T17:59:38.831429] [DEBUG] [LOCAL ] CVS: Primary data saved (39658 records). [2025-09-15T17:59:38.831700] [INFO ] [MAIN ] CVS: Full history saved. [2025-09-15T17:59:38.832496] [INFO ] [MAIN ] Update Progress: 566/2369 symbols completed. CVS took 23.2s. Estimated remaining: 3h 9m 50s. Rate: 9.5 symbols/min [2025-09-15T17:59:38.864276] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-09-15T17:59:39.006739] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:59:39.058680] [DEBUG] [LOCAL ] CWAN: Loaded 39593 existing records from primary storage. [2025-09-15T17:59:39.058827] [INFO ] [MAIN ] CWAN: Loaded 39593 existing records. [2025-09-15T17:59:39.235747] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:59:39.236000] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-09-15T17:59:39.236055] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-09-15T17:59:39.236869] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-09-15T17:59:39.236917] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-09-15T17:59:39.600811] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:59:39.657871] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-09-15T17:59:39.706121] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-15T17:59:40.457875] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-09-15T17:59:41.061906] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-15T17:59:41.222492] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T17:59:41.257822] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-09-15T17:59:41.501216] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-15T17:59:42.057891] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-09-15T17:59:42.804517] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T17:59:42.857825] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-09-15T17:59:43.474496] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-15T17:59:43.480376] [INFO ] [REMOTE ] CVNA: Full fetch complete (57717 records). [2025-09-15T17:59:43.480488] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-09-15T17:59:43.658762] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-09-15T17:59:43.869544] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-09-15T17:59:43.869632] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-09-15T17:59:43.870360] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-09-15T17:59:43.870404] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-09-15T17:59:43.871744] [DEBUG] [LOCAL ] CVNA: Trimmed 57717 records to 39119 (keeping 150 days of data) [2025-09-15T17:59:44.122564] [DEBUG] [LOCAL ] CVNA: Primary data saved (39119 records). [2025-09-15T17:59:44.122734] [INFO ] [MAIN ] CVNA: Full history saved. [2025-09-15T17:59:44.122839] [INFO ] [MAIN ] Update Progress: 567/2369 symbols completed. CVNA took 29.9s. Estimated remaining: 3h 9m 40s. Rate: 9.5 symbols/min [2025-09-15T17:59:44.299701] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:59:44.335779] [DEBUG] [LOCAL ] CWEN: Loaded 33419 existing records from primary storage. [2025-09-15T17:59:44.335921] [INFO ] [MAIN ] CWEN: Loaded 33419 existing records. [2025-09-15T17:59:44.462850] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-09-15T17:59:44.530665] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:59:44.531684] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-09-15T17:59:44.532040] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-09-15T17:59:44.543505] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-09-15T17:59:44.560801] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-09-15T17:59:44.598191] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-15T17:59:44.941411] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:59:44.957327] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T17:59:45.257874] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-09-15T17:59:46.057849] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-09-15T17:59:46.546538] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-15T17:59:46.683372] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-15T17:59:46.857877] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-09-15T17:59:47.309342] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-15T17:59:47.657877] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-09-15T17:59:47.763990] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-15T17:59:48.457876] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-09-15T17:59:48.743630] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-15T17:59:49.257893] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-09-15T17:59:49.980842] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-15T17:59:50.057872] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-09-15T17:59:50.756543] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T17:59:50.857847] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-09-15T17:59:51.657948] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-09-15T17:59:51.913226] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-15T17:59:51.982176] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-15T17:59:51.989195] [INFO ] [REMOTE ] CVX: Full fetch complete (58440 records). [2025-09-15T17:59:51.989425] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-09-15T17:59:52.380807] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-09-15T17:59:52.380898] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-09-15T17:59:52.381660] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-09-15T17:59:52.381727] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-09-15T17:59:52.382997] [DEBUG] [LOCAL ] CVX: Trimmed 58440 records to 39720 (keeping 150 days of data) [2025-09-15T17:59:52.482374] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-09-15T17:59:52.631906] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-15T17:59:52.675928] [DEBUG] [LOCAL ] CVX: Primary data saved (39720 records). [2025-09-15T17:59:52.676099] [INFO ] [MAIN ] CVX: Full history saved. [2025-09-15T17:59:52.677429] [INFO ] [MAIN ] Update Progress: 568/2369 symbols completed. CVX took 33.0s. Estimated remaining: 3h 9m 41s. Rate: 9.5 symbols/min [2025-09-15T17:59:52.859899] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:59:52.902387] [DEBUG] [LOCAL ] CWH: Loaded 38864 existing records from primary storage. [2025-09-15T17:59:52.902562] [INFO ] [MAIN ] CWH: Loaded 38864 existing records. [2025-09-15T17:59:53.081963] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:59:53.082228] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-09-15T17:59:53.082274] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-09-15T17:59:53.083226] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-09-15T17:59:53.083278] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-09-15T17:59:53.268178] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-09-15T17:59:53.433717] [INFO ] [REMOTE ] CWH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T17:59:53.582050] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-15T17:59:54.057901] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-09-15T17:59:54.857904] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-09-15T17:59:55.113990] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-15T17:59:55.404236] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T17:59:55.657872] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-09-15T17:59:55.949045] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-15T17:59:56.457923] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-09-15T17:59:56.653091] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-15T17:59:57.257900] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-09-15T17:59:57.888819] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-15T17:59:58.038080] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-15T17:59:58.057824] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-09-15T17:59:58.821411] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-15T17:59:58.823909] [INFO ] [REMOTE ] CW: Full fetch complete (25634 records). [2025-09-15T17:59:58.823978] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-09-15T17:59:58.863137] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-09-15T17:59:59.190730] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-09-15T17:59:59.190830] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-09-15T17:59:59.191293] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-09-15T17:59:59.191332] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-09-15T17:59:59.192116] [DEBUG] [LOCAL ] CW: Trimmed 25634 records to 16766 (keeping 150 days of data) [2025-09-15T17:59:59.304281] [DEBUG] [LOCAL ] CW: Primary data saved (16766 records). [2025-09-15T17:59:59.304458] [INFO ] [MAIN ] CW: Full history saved. [2025-09-15T17:59:59.304570] [INFO ] [MAIN ] Update Progress: 569/2369 symbols completed. CW took 23.1s. Estimated remaining: 3h 9m 36s. Rate: 9.5 symbols/min [2025-09-15T17:59:59.471977] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T17:59:59.516149] [DEBUG] [LOCAL ] CWK: Loaded 37114 existing records from primary storage. [2025-09-15T17:59:59.516287] [INFO ] [MAIN ] CWK: Loaded 37114 existing records. [2025-09-15T17:59:59.665351] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-09-15T17:59:59.729143] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T17:59:59.729956] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-09-15T17:59:59.730005] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-09-15T17:59:59.730732] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-09-15T17:59:59.730779] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-09-15T18:00:00.087328] [INFO ] [REMOTE ] CWK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:00:00.143304] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T18:00:00.457910] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-09-15T18:00:01.257929] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-09-15T18:00:01.515868] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-15T18:00:02.057875] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-09-15T18:00:02.340428] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-15T18:00:02.857831] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-09-15T18:00:03.301565] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-15T18:00:03.657932] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-09-15T18:00:04.341321] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-15T18:00:04.457936] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-09-15T18:00:05.257894] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-09-15T18:00:05.896409] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (3.04 seconds). [2025-09-15T18:00:06.064885] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-09-15T18:00:06.067831] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T18:00:06.472041] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-09-15T18:00:06.479293] [INFO ] [REMOTE ] CWAN: Full fetch complete (56808 records). [2025-09-15T18:00:06.479488] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-09-15T18:00:06.865988] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-09-15T18:00:06.865830] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-09-15T18:00:06.866222] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-09-15T18:00:06.879583] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-09-15T18:00:06.880502] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-09-15T18:00:06.881775] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-15T18:00:06.887484] [INFO ] [REMOTE ] CWEN: Full fetch complete (48956 records). [2025-09-15T18:00:06.887632] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-09-15T18:00:06.888102] [DEBUG] [LOCAL ] CWAN: Trimmed 56808 records to 38857 (keeping 150 days of data) [2025-09-15T18:00:07.401429] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-09-15T18:00:07.405500] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-09-15T18:00:07.409883] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-09-15T18:00:07.412514] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-09-15T18:00:07.418755] [DEBUG] [LOCAL ] CWEN: Trimmed 48956 records to 32791 (keeping 150 days of data) [2025-09-15T18:00:07.639690] [DEBUG] [LOCAL ] CWAN: Primary data saved (38857 records). [2025-09-15T18:00:07.644745] [INFO ] [MAIN ] CWAN: Full history saved. [2025-09-15T18:00:07.645982] [INFO ] [MAIN ] Update Progress: 570/2369 symbols completed. CWAN took 28.8s. Estimated remaining: 3h 9m 36s. Rate: 9.5 symbols/min [2025-09-15T18:00:07.893927] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:00:07.918296] [DEBUG] [LOCAL ] CWEN: Primary data saved (32791 records). [2025-09-15T18:00:07.918672] [INFO ] [MAIN ] CWEN: Full history saved. [2025-09-15T18:00:07.918781] [INFO ] [MAIN ] Update Progress: 571/2369 symbols completed. CWEN took 23.8s. Estimated remaining: 3h 9m 10s. Rate: 9.5 symbols/min [2025-09-15T18:00:08.046184] [DEBUG] [LOCAL ] CWT: Loaded 20471 existing records from primary storage. [2025-09-15T18:00:08.062026] [INFO ] [MAIN ] CWT: Loaded 20471 existing records. [2025-09-15T18:00:08.192042] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:00:08.337509] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:00:08.341144] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-15T18:00:08.338540] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-09-15T18:00:08.351256] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-09-15T18:00:08.355429] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-09-15T18:00:08.355873] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-09-15T18:00:08.405728] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-09-15T18:00:08.565784] [DEBUG] [LOCAL ] CX: Loaded 39740 existing records from primary storage. [2025-09-15T18:00:08.616691] [INFO ] [MAIN ] CX: Loaded 39740 existing records. [2025-09-15T18:00:08.857331] [INFO ] [REMOTE ] CWT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:00:08.857936] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-09-15T18:00:08.926669] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:00:08.927104] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-09-15T18:00:08.927158] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-09-15T18:00:08.960931] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-09-15T18:00:08.964097] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-09-15T18:00:09.064334] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-15T18:00:09.262949] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-09-15T18:00:09.327099] [INFO ] [REMOTE ] CX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:00:10.031882] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T18:00:10.057871] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-09-15T18:00:10.308708] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T18:00:10.857901] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-09-15T18:00:11.095965] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-15T18:00:11.245625] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T18:00:11.657860] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-09-15T18:00:12.002275] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-15T18:00:12.457954] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-09-15T18:00:13.257947] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-09-15T18:00:13.347281] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T18:00:13.850354] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-15T18:00:13.855781] [INFO ] [REMOTE ] CWH: Full fetch complete (55405 records). [2025-09-15T18:00:13.855884] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-09-15T18:00:14.065173] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-09-15T18:00:14.248897] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-09-15T18:00:14.248983] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-09-15T18:00:14.249722] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-09-15T18:00:14.249837] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-09-15T18:00:14.251035] [DEBUG] [LOCAL ] CWH: Trimmed 55405 records to 38060 (keeping 150 days of data) [2025-09-15T18:00:14.485975] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-15T18:00:14.515770] [DEBUG] [LOCAL ] CWH: Primary data saved (38060 records). [2025-09-15T18:00:14.515934] [INFO ] [MAIN ] CWH: Full history saved. [2025-09-15T18:00:14.516423] [INFO ] [MAIN ] Update Progress: 572/2369 symbols completed. CWH took 21.8s. Estimated remaining: 3h 9m 5s. Rate: 9.5 symbols/min [2025-09-15T18:00:14.690891] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:00:14.699056] [DEBUG] [LOCAL ] CXE: Loaded 4713 existing records from primary storage. [2025-09-15T18:00:14.699195] [INFO ] [MAIN ] CXE: Loaded 4713 existing records. [2025-09-15T18:00:14.862045] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-09-15T18:00:14.889003] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:00:14.889279] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-09-15T18:00:14.889354] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-09-15T18:00:14.889681] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-09-15T18:00:14.889732] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-09-15T18:00:15.244572] [INFO ] [REMOTE ] CXE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:00:15.657893] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-09-15T18:00:16.457872] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-09-15T18:00:16.590031] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-09-15T18:00:16.860314] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-15T18:00:17.260625] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-09-15T18:00:17.265158] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-15T18:00:18.057959] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-09-15T18:00:18.506225] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (2.85 seconds). [2025-09-15T18:00:18.553572] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-15T18:00:18.857935] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-09-15T18:00:19.172719] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-15T18:00:19.631166] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-15T18:00:19.657825] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-09-15T18:00:20.114051] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-15T18:00:20.457875] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-09-15T18:00:20.869422] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-15T18:00:21.257873] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-09-15T18:00:22.057859] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-09-15T18:00:22.383104] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-15T18:00:22.435041] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-15T18:00:22.857873] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-09-15T18:00:23.657899] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-09-15T18:00:24.090834] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T18:00:24.144274] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-15T18:00:24.457881] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-09-15T18:00:25.257927] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-09-15T18:00:25.533287] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-15T18:00:25.536617] [INFO ] [REMOTE ] CWT: Full fetch complete (30654 records). [2025-09-15T18:00:25.536773] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-09-15T18:00:25.854276] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-15T18:00:25.919457] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-09-15T18:00:25.919537] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-09-15T18:00:25.920041] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-09-15T18:00:25.920084] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-09-15T18:00:25.920982] [DEBUG] [LOCAL ] CWT: Trimmed 30654 records to 20038 (keeping 150 days of data) [2025-09-15T18:00:26.045715] [DEBUG] [LOCAL ] CWT: Primary data saved (20038 records). [2025-09-15T18:00:26.045844] [INFO ] [MAIN ] CWT: Full history saved. [2025-09-15T18:00:26.045926] [INFO ] [MAIN ] Update Progress: 573/2369 symbols completed. CWT took 18.4s. Estimated remaining: 3h 9m 15s. Rate: 9.5 symbols/min [2025-09-15T18:00:26.066377] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-09-15T18:00:26.225265] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:00:26.230787] [DEBUG] [LOCAL ] CXH: Loaded 3883 existing records from primary storage. [2025-09-15T18:00:26.230870] [INFO ] [MAIN ] CXH: Loaded 3883 existing records. [2025-09-15T18:00:26.407354] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:00:26.407660] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-09-15T18:00:26.407712] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-09-15T18:00:26.408031] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-09-15T18:00:26.408079] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-09-15T18:00:26.768700] [INFO ] [REMOTE ] CXH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:00:26.857873] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-09-15T18:00:26.883564] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-15T18:00:26.885375] [INFO ] [REMOTE ] CXE: Full fetch complete (8080 records). [2025-09-15T18:00:26.885456] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-09-15T18:00:27.252748] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-09-15T18:00:27.252898] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-09-15T18:00:27.253112] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-09-15T18:00:27.253152] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-09-15T18:00:27.253719] [DEBUG] [LOCAL ] CXE: Trimmed 8080 records to 4647 (keeping 150 days of data) [2025-09-15T18:00:27.287451] [DEBUG] [LOCAL ] CXE: Primary data saved (4647 records). [2025-09-15T18:00:27.287630] [INFO ] [MAIN ] CXE: Full history saved. [2025-09-15T18:00:27.287805] [INFO ] [MAIN ] Update Progress: 574/2369 symbols completed. CXE took 12.8s. Estimated remaining: 3h 8m 53s. Rate: 9.5 symbols/min [2025-09-15T18:00:27.394933] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-15T18:00:27.467754] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:00:27.500500] [DEBUG] [LOCAL ] CXM: Loaded 35801 existing records from primary storage. [2025-09-15T18:00:27.500687] [INFO ] [MAIN ] CXM: Loaded 35801 existing records. [2025-09-15T18:00:27.657942] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-09-15T18:00:27.680347] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:00:27.680608] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-09-15T18:00:27.680680] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-09-15T18:00:27.681480] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-09-15T18:00:27.681531] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-09-15T18:00:28.038927] [INFO ] [REMOTE ] CXM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:00:28.457885] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-09-15T18:00:28.746870] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-15T18:00:29.257911] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-09-15T18:00:30.057967] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-09-15T18:00:30.341129] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-15T18:00:30.646117] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-15T18:00:30.857924] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-09-15T18:00:31.412655] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T18:00:31.657924] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-09-15T18:00:32.302720] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-15T18:00:32.457874] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-09-15T18:00:32.888003] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T18:00:33.257911] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-09-15T18:00:34.057901] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-09-15T18:00:34.157686] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T18:00:34.732387] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T18:00:34.737696] [INFO ] [REMOTE ] CWK: Full fetch complete (53265 records). [2025-09-15T18:00:34.737792] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-09-15T18:00:34.738556] [FATAL] [VALIDATOR ] CWK: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:00:34.738637] [FATAL] [MAIN ] CWK: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:00:34.738696] [WARN ] [MAIN ] CWK: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:00:34.738766] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-09-15T18:00:34.738837] [DEBUG] [LOCAL ] CWK: No primary data file found to delete. [2025-09-15T18:00:34.738882] [INFO ] [LOCAL ] CWK: Starting deletion of derivative data. [2025-09-15T18:00:34.739281] [DEBUG] [LOCAL ] CWK: Deleted derivative data file. [2025-09-15T18:00:34.741059] [INFO ] [MAIN ] Update Progress: 575/2369 symbols completed. CWK took 35.4s. Estimated remaining: 3h 8m 50s. Rate: 9.5 symbols/min [2025-09-15T18:00:34.863057] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-09-15T18:00:34.919273] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:00:34.947338] [DEBUG] [LOCAL ] CXT: Loaded 22501 existing records from primary storage. [2025-09-15T18:00:34.947553] [INFO ] [MAIN ] CXT: Loaded 22501 existing records. [2025-09-15T18:00:35.135985] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:00:35.136337] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-09-15T18:00:35.136391] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-09-15T18:00:35.137161] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-09-15T18:00:35.137217] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-09-15T18:00:35.499728] [INFO ] [REMOTE ] CXT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:00:35.657904] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-09-15T18:00:35.845402] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-15T18:00:36.109167] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-15T18:00:36.266012] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-15T18:00:36.457869] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-09-15T18:00:37.054100] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-15T18:00:37.257880] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-09-15T18:00:38.057888] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-09-15T18:00:38.442244] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-15T18:00:38.716807] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T18:00:38.857871] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-09-15T18:00:39.663666] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-09-15T18:00:39.665363] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-15T18:00:40.457881] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-09-15T18:00:40.852421] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-15T18:00:41.257863] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-09-15T18:00:41.709831] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-15T18:00:41.802935] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-15T18:00:42.057841] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-09-15T18:00:42.857879] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-09-15T18:00:43.384476] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-15T18:00:43.479058] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T18:00:43.480457] [INFO ] [REMOTE ] CXH: Full fetch complete (4611 records). [2025-09-15T18:00:43.480536] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-09-15T18:00:43.662961] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-09-15T18:00:43.864991] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-09-15T18:00:43.865097] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-09-15T18:00:43.865240] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-09-15T18:00:43.865280] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-09-15T18:00:43.865749] [DEBUG] [LOCAL ] CXH: Trimmed 4611 records to 3905 (keeping 150 days of data) [2025-09-15T18:00:43.890206] [DEBUG] [LOCAL ] CXH: Primary data saved (3905 records). [2025-09-15T18:00:43.890359] [INFO ] [MAIN ] CXH: Full history saved. [2025-09-15T18:00:43.890465] [INFO ] [MAIN ] Update Progress: 576/2369 symbols completed. CXH took 17.8s. Estimated remaining: 3h 8m 52s. Rate: 9.5 symbols/min [2025-09-15T18:00:44.082571] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:00:44.123267] [DEBUG] [LOCAL ] CXW: Loaded 33263 existing records from primary storage. [2025-09-15T18:00:44.123434] [INFO ] [MAIN ] CXW: Loaded 33263 existing records. [2025-09-15T18:00:44.305315] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:00:44.305601] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-09-15T18:00:44.305665] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-09-15T18:00:44.306376] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-09-15T18:00:44.306425] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-09-15T18:00:44.462944] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-09-15T18:00:44.687954] [INFO ] [REMOTE ] CXW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:00:45.237116] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T18:00:45.243165] [INFO ] [REMOTE ] CX: Full fetch complete (57448 records). [2025-09-15T18:00:45.243289] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-09-15T18:00:45.264625] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-09-15T18:00:45.639673] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-09-15T18:00:45.639804] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-09-15T18:00:45.640707] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-09-15T18:00:45.640878] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-09-15T18:00:45.642248] [DEBUG] [LOCAL ] CX: Trimmed 57448 records to 38965 (keeping 150 days of data) [2025-09-15T18:00:45.762446] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-15T18:00:45.920595] [DEBUG] [LOCAL ] CX: Primary data saved (38965 records). [2025-09-15T18:00:45.920792] [INFO ] [MAIN ] CX: Full history saved. [2025-09-15T18:00:45.920944] [INFO ] [MAIN ] Update Progress: 577/2369 symbols completed. CX took 38.0s. Estimated remaining: 3h 8m 33s. Rate: 9.5 symbols/min [2025-09-15T18:00:46.065395] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-09-15T18:00:46.098171] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:00:46.119089] [DEBUG] [LOCAL ] CYD: Loaded 19326 existing records from primary storage. [2025-09-15T18:00:46.119244] [INFO ] [MAIN ] CYD: Loaded 19326 existing records. [2025-09-15T18:00:46.299334] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:00:46.299775] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-09-15T18:00:46.299879] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-09-15T18:00:46.300482] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-09-15T18:00:46.300547] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-09-15T18:00:46.485252] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T18:00:46.701104] [INFO ] [REMOTE ] CYD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:00:46.857909] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-09-15T18:00:47.488566] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-15T18:00:47.494811] [INFO ] [REMOTE ] CXM: Full fetch complete (52007 records). [2025-09-15T18:00:47.494989] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-09-15T18:00:47.658935] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-09-15T18:00:47.892356] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-15T18:00:47.912816] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-09-15T18:00:47.912888] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-09-15T18:00:47.913599] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-09-15T18:00:47.913667] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-09-15T18:00:47.914744] [DEBUG] [LOCAL ] CXM: Trimmed 52007 records to 35117 (keeping 150 days of data) [2025-09-15T18:00:48.127490] [DEBUG] [LOCAL ] CXM: Primary data saved (35117 records). [2025-09-15T18:00:48.127691] [INFO ] [MAIN ] CXM: Full history saved. [2025-09-15T18:00:48.127785] [INFO ] [MAIN ] Update Progress: 578/2369 symbols completed. CXM took 20.8s. Estimated remaining: 3h 8m 14s. Rate: 9.5 symbols/min [2025-09-15T18:00:48.297974] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:00:48.336886] [DEBUG] [LOCAL ] CYH: Loaded 36354 existing records from primary storage. [2025-09-15T18:00:48.337028] [INFO ] [MAIN ] CYH: Loaded 36354 existing records. [2025-09-15T18:00:48.463101] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-09-15T18:00:48.518156] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:00:48.518473] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-09-15T18:00:48.518522] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-09-15T18:00:48.519256] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-09-15T18:00:48.519306] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-09-15T18:00:48.867212] [INFO ] [REMOTE ] CYH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:00:49.004319] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T18:00:49.257929] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-09-15T18:00:49.495083] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-15T18:00:50.057915] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-09-15T18:00:50.547454] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-15T18:00:50.857885] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-09-15T18:00:51.587898] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-15T18:00:51.657875] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-09-15T18:00:51.722413] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-15T18:00:52.457899] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-09-15T18:00:52.547797] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-15T18:00:53.257949] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-09-15T18:00:53.868511] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-15T18:00:54.057910] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-09-15T18:00:54.797125] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-15T18:00:54.857844] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-09-15T18:00:55.590843] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-15T18:00:55.657924] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-09-15T18:00:56.435329] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T18:00:56.457834] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-09-15T18:00:56.551694] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-15T18:00:57.257874] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-09-15T18:00:57.641400] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-15T18:00:58.057872] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-09-15T18:00:58.188239] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-15T18:00:58.857884] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-09-15T18:00:59.616803] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T18:00:59.657814] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-09-15T18:01:00.457921] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-09-15T18:01:00.485684] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-15T18:01:01.252760] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T18:01:01.262350] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-09-15T18:01:01.655475] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-15T18:01:02.057912] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-09-15T18:01:02.172892] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-15T18:01:02.857894] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-09-15T18:01:03.657919] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-09-15T18:01:03.745161] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-15T18:01:04.331214] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-15T18:01:04.401348] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-15T18:01:04.457905] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-09-15T18:01:05.257853] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-09-15T18:01:05.625917] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-15T18:01:06.057962] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-09-15T18:01:06.857958] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-09-15T18:01:06.981061] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-15T18:01:07.263281] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T18:01:07.657966] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-09-15T18:01:07.991625] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T18:01:08.457965] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-09-15T18:01:08.969801] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-15T18:01:08.973884] [INFO ] [REMOTE ] CXT: Full fetch complete (33987 records). [2025-09-15T18:01:08.973982] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-09-15T18:01:09.267521] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-09-15T18:01:09.365204] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-09-15T18:01:09.365320] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-09-15T18:01:09.366086] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-09-15T18:01:09.366152] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-09-15T18:01:09.367352] [DEBUG] [LOCAL ] CXT: Trimmed 33987 records to 22071 (keeping 150 days of data) [2025-09-15T18:01:09.518999] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T18:01:09.524196] [INFO ] [REMOTE ] CYD: Full fetch complete (29007 records). [2025-09-15T18:01:09.524798] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-09-15T18:01:09.920839] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-09-15T18:01:09.921620] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-09-15T18:01:09.922899] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-09-15T18:01:09.923632] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-09-15T18:01:09.927018] [DEBUG] [LOCAL ] CYD: Trimmed 29007 records to 18953 (keeping 150 days of data) [2025-09-15T18:01:10.047707] [DEBUG] [LOCAL ] CXT: Primary data saved (22071 records). [2025-09-15T18:01:10.051326] [INFO ] [MAIN ] CXT: Full history saved. [2025-09-15T18:01:10.051962] [INFO ] [MAIN ] Update Progress: 579/2369 symbols completed. CXT took 35.3s. Estimated remaining: 3h 8m 56s. Rate: 9.5 symbols/min [2025-09-15T18:01:10.067495] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-09-15T18:01:10.174176] [DEBUG] [LOCAL ] CYD: Primary data saved (18953 records). [2025-09-15T18:01:10.174420] [INFO ] [MAIN ] CYD: Full history saved. [2025-09-15T18:01:10.174883] [INFO ] [MAIN ] Update Progress: 580/2369 symbols completed. CYD took 24.3s. Estimated remaining: 3h 8m 30s. Rate: 9.5 symbols/min [2025-09-15T18:01:10.320629] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:01:10.432787] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:01:10.443863] [DEBUG] [LOCAL ] DAC: Loaded 9159 existing records from primary storage. [2025-09-15T18:01:10.444073] [INFO ] [MAIN ] DAC: Loaded 9159 existing records. [2025-09-15T18:01:10.649254] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:01:10.650367] [DEBUG] [LOCAL ] D: Loaded 40397 existing records from primary storage. [2025-09-15T18:01:10.650676] [INFO ] [MAIN ] D: Loaded 40397 existing records. [2025-09-15T18:01:10.650619] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-09-15T18:01:10.650773] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-09-15T18:01:10.730470] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-09-15T18:01:10.740750] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-09-15T18:01:10.917763] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:01:10.951998] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-09-15T18:01:10.994531] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-09-15T18:01:11.104715] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-09-15T18:01:11.106358] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-15T18:01:11.106490] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-09-15T18:01:11.171040] [INFO ] [REMOTE ] CYH: Full fetch complete (52732 records). [2025-09-15T18:01:11.176800] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-09-15T18:01:11.408627] [INFO ] [REMOTE ] DAC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:01:11.462554] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-09-15T18:01:11.908877] [INFO ] [REMOTE ] D: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:01:11.909246] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-09-15T18:01:11.999008] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-09-15T18:01:11.999096] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-09-15T18:01:11.999832] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-09-15T18:01:11.999882] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-09-15T18:01:12.002710] [DEBUG] [LOCAL ] CYH: Trimmed 52732 records to 35531 (keeping 150 days of data) [2025-09-15T18:01:12.125466] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-15T18:01:12.135459] [INFO ] [REMOTE ] CXW: Full fetch complete (49046 records). [2025-09-15T18:01:12.136159] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-09-15T18:01:12.627356] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-09-15T18:01:12.627796] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-09-15T18:01:12.632065] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-09-15T18:01:12.632946] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-09-15T18:01:12.634993] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-15T18:01:12.641699] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-09-15T18:01:12.643237] [DEBUG] [LOCAL ] CXW: Trimmed 49046 records to 32561 (keeping 150 days of data) [2025-09-15T18:01:12.655154] [DEBUG] [LOCAL ] CYH: Primary data saved (35531 records). [2025-09-15T18:01:12.655367] [INFO ] [MAIN ] CYH: Full history saved. [2025-09-15T18:01:12.656262] [INFO ] [MAIN ] Update Progress: 581/2369 symbols completed. CYH took 24.5s. Estimated remaining: 3h 8m 12s. Rate: 9.5 symbols/min [2025-09-15T18:01:12.926157] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:01:13.040676] [DEBUG] [LOCAL ] DAL: Loaded 40493 existing records from primary storage. [2025-09-15T18:01:13.041932] [INFO ] [MAIN ] DAL: Loaded 40493 existing records. [2025-09-15T18:01:13.126820] [DEBUG] [LOCAL ] CXW: Primary data saved (32561 records). [2025-09-15T18:01:13.153826] [INFO ] [MAIN ] CXW: Full history saved. [2025-09-15T18:01:13.154552] [INFO ] [MAIN ] Update Progress: 582/2369 symbols completed. CXW took 29.3s. Estimated remaining: 3h 7m 48s. Rate: 9.5 symbols/min [2025-09-15T18:01:13.335050] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:01:13.344891] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-09-15T18:01:13.345017] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-09-15T18:01:13.365699] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-09-15T18:01:13.380575] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-09-15T18:01:13.442912] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:01:13.660794] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-15T18:01:13.686606] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-09-15T18:01:13.849655] [DEBUG] [LOCAL ] DAN: Loaded 36951 existing records from primary storage. [2025-09-15T18:01:13.875122] [INFO ] [REMOTE ] DAL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:01:13.884516] [INFO ] [MAIN ] DAN: Loaded 36951 existing records. [2025-09-15T18:01:13.990548] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-15T18:01:14.071458] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-09-15T18:01:14.075803] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:01:14.076765] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-09-15T18:01:14.076834] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-09-15T18:01:14.077693] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-09-15T18:01:14.077756] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-09-15T18:01:14.427747] [INFO ] [REMOTE ] DAN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:01:14.738935] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-15T18:01:14.857949] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-09-15T18:01:15.657858] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-09-15T18:01:15.721899] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T18:01:15.971995] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-15T18:01:16.457933] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-09-15T18:01:17.182053] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-15T18:01:17.257933] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-09-15T18:01:18.057861] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-09-15T18:01:18.096471] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T18:01:18.382275] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-15T18:01:18.857897] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-09-15T18:01:19.657914] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-09-15T18:01:19.754243] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T18:01:20.457854] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-09-15T18:01:20.885410] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-15T18:01:21.020475] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-15T18:01:21.204828] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T18:01:21.257821] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-09-15T18:01:22.057887] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-09-15T18:01:22.497212] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T18:01:22.857974] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-09-15T18:01:23.657965] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-09-15T18:01:23.753900] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-15T18:01:24.092536] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-15T18:01:24.457934] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-09-15T18:01:24.857142] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-15T18:01:25.257931] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-09-15T18:01:26.057924] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-09-15T18:01:26.341104] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-15T18:01:26.857834] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-09-15T18:01:27.335316] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-15T18:01:27.657900] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-09-15T18:01:28.114051] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-15T18:01:28.457919] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-09-15T18:01:28.575481] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-15T18:01:29.257864] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-09-15T18:01:29.395282] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-15T18:01:29.615893] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-15T18:01:30.057883] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-09-15T18:01:30.857887] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-09-15T18:01:31.027751] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-15T18:01:31.657898] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-09-15T18:01:32.263332] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-15T18:01:32.448445] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-15T18:01:32.457807] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-09-15T18:01:32.628017] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-15T18:01:32.633561] [INFO ] [REMOTE ] DAN: Full fetch complete (53319 records). [2025-09-15T18:01:32.633696] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-09-15T18:01:33.016386] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-09-15T18:01:33.016480] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-09-15T18:01:33.017231] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-09-15T18:01:33.017305] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-09-15T18:01:33.018506] [DEBUG] [LOCAL ] DAN: Trimmed 53319 records to 36208 (keeping 150 days of data) [2025-09-15T18:01:33.248806] [DEBUG] [LOCAL ] DAN: Primary data saved (36208 records). [2025-09-15T18:01:33.249046] [INFO ] [MAIN ] DAN: Full history saved. [2025-09-15T18:01:33.249157] [INFO ] [MAIN ] Update Progress: 583/2369 symbols completed. DAN took 20.1s. Estimated remaining: 3h 8m 24s. Rate: 9.5 symbols/min [2025-09-15T18:01:33.262966] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-09-15T18:01:33.359079] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T18:01:33.381755] [INFO ] [REMOTE ] DAC: Full fetch complete (14203 records). [2025-09-15T18:01:33.432572] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:01:33.432891] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-09-15T18:01:33.434406] [FATAL] [VALIDATOR ] DAC: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:01:33.434533] [FATAL] [MAIN ] DAC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:01:33.434609] [WARN ] [MAIN ] DAC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:01:33.434708] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-09-15T18:01:33.434806] [DEBUG] [LOCAL ] DAC: No primary data file found to delete. [2025-09-15T18:01:33.434865] [INFO ] [LOCAL ] DAC: Starting deletion of derivative data. [2025-09-15T18:01:33.435263] [DEBUG] [LOCAL ] DAC: Deleted derivative data file. [2025-09-15T18:01:33.435451] [INFO ] [MAIN ] Update Progress: 584/2369 symbols completed. DAC took 23.2s. Estimated remaining: 3h 7m 59s. Rate: 9.5 symbols/min [2025-09-15T18:01:33.549917] [DEBUG] [LOCAL ] DAO: Loaded 13641 existing records from primary storage. [2025-09-15T18:01:33.555786] [INFO ] [MAIN ] DAO: Loaded 13641 existing records. [2025-09-15T18:01:33.728149] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:01:33.806700] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:01:33.806993] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-09-15T18:01:33.807833] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-09-15T18:01:33.808190] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-09-15T18:01:33.808237] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-09-15T18:01:33.987170] [DEBUG] [LOCAL ] DAR: Loaded 39024 existing records from primary storage. [2025-09-15T18:01:34.001767] [INFO ] [MAIN ] DAR: Loaded 39024 existing records. [2025-09-15T18:01:34.070087] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-09-15T18:01:34.357127] [INFO ] [REMOTE ] DAO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:01:34.377441] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:01:34.377782] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-09-15T18:01:34.377831] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-09-15T18:01:34.378858] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-09-15T18:01:34.378910] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-09-15T18:01:34.732030] [INFO ] [REMOTE ] DAR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:01:34.747179] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T18:01:34.752875] [INFO ] [REMOTE ] D: Full fetch complete (57935 records). [2025-09-15T18:01:34.752989] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-09-15T18:01:34.753629] [FATAL] [VALIDATOR ] D: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:01:34.753728] [FATAL] [MAIN ] D: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:01:34.753766] [WARN ] [MAIN ] D: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:01:34.753813] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-09-15T18:01:34.753873] [DEBUG] [LOCAL ] D: No primary data file found to delete. [2025-09-15T18:01:34.753908] [INFO ] [LOCAL ] D: Starting deletion of derivative data. [2025-09-15T18:01:34.754199] [DEBUG] [LOCAL ] D: Deleted derivative data file. [2025-09-15T18:01:34.754314] [INFO ] [MAIN ] Update Progress: 585/2369 symbols completed. D took 24.7s. Estimated remaining: 3h 7m 37s. Rate: 9.5 symbols/min [2025-09-15T18:01:34.862932] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-09-15T18:01:34.926489] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:01:34.964328] [DEBUG] [LOCAL ] DAVA: Loaded 30679 existing records from primary storage. [2025-09-15T18:01:34.964494] [INFO ] [MAIN ] DAVA: Loaded 30679 existing records. [2025-09-15T18:01:35.142175] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:01:35.142426] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-09-15T18:01:35.142472] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-09-15T18:01:35.143456] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-09-15T18:01:35.143511] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-09-15T18:01:35.497786] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:01:35.657870] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-09-15T18:01:35.988186] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-15T18:01:36.096716] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-15T18:01:36.457866] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-09-15T18:01:37.064010] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T18:01:37.257867] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-09-15T18:01:37.367606] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-15T18:01:38.057871] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-09-15T18:01:38.743172] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-15T18:01:38.857882] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-09-15T18:01:39.253811] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T18:01:39.657878] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-09-15T18:01:39.905008] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-15T18:01:40.457865] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-09-15T18:01:40.663787] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-15T18:01:41.257864] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-09-15T18:01:41.717041] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-15T18:01:42.057924] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-09-15T18:01:42.857906] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-09-15T18:01:43.356218] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-15T18:01:43.415796] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-15T18:01:43.641046] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-15T18:01:43.657820] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-09-15T18:01:44.457886] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-09-15T18:01:44.792628] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-15T18:01:45.257912] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-09-15T18:01:45.805414] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T18:01:45.812498] [INFO ] [REMOTE ] DAL: Full fetch complete (58043 records). [2025-09-15T18:01:45.812690] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-09-15T18:01:45.813564] [FATAL] [VALIDATOR ] DAL: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:01:45.813698] [FATAL] [MAIN ] DAL: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:01:45.813752] [WARN ] [MAIN ] DAL: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:01:45.813804] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-09-15T18:01:45.813896] [DEBUG] [LOCAL ] DAL: No primary data file found to delete. [2025-09-15T18:01:45.813948] [INFO ] [LOCAL ] DAL: Starting deletion of derivative data. [2025-09-15T18:01:45.814271] [DEBUG] [LOCAL ] DAL: Deleted derivative data file. [2025-09-15T18:01:45.815539] [INFO ] [MAIN ] Update Progress: 586/2369 symbols completed. DAL took 33.2s. Estimated remaining: 3h 7m 45s. Rate: 9.5 symbols/min [2025-09-15T18:01:45.997853] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:01:46.037598] [DEBUG] [LOCAL ] DAY: Loaded 37479 existing records from primary storage. [2025-09-15T18:01:46.037791] [INFO ] [MAIN ] DAY: Loaded 37479 existing records. [2025-09-15T18:01:46.063208] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-09-15T18:01:46.229735] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:01:46.229985] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-09-15T18:01:46.230033] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-09-15T18:01:46.230934] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-09-15T18:01:46.230988] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-09-15T18:01:46.589859] [INFO ] [REMOTE ] DAY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:01:46.857876] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-09-15T18:01:46.983679] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-15T18:01:47.616137] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-15T18:01:47.657822] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-09-15T18:01:48.160365] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-15T18:01:48.457878] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-09-15T18:01:48.599197] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T18:01:49.257890] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-09-15T18:01:49.815901] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T18:01:50.057902] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-09-15T18:01:50.365931] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-15T18:01:50.857963] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-09-15T18:01:51.532988] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T18:01:51.657874] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-09-15T18:01:51.818303] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T18:01:52.457876] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-09-15T18:01:53.206895] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-15T18:01:53.257825] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-09-15T18:01:54.058673] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-09-15T18:01:54.062208] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-15T18:01:54.857882] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-09-15T18:01:55.016221] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-15T18:01:55.099777] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T18:01:55.102360] [INFO ] [REMOTE ] DAO: Full fetch complete (24676 records). [2025-09-15T18:01:55.102447] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-09-15T18:01:55.487626] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-09-15T18:01:55.487725] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-09-15T18:01:55.488254] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-09-15T18:01:55.488320] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-09-15T18:01:55.489005] [DEBUG] [LOCAL ] DAO: Trimmed 24676 records to 13357 (keeping 150 days of data) [2025-09-15T18:01:55.565547] [DEBUG] [LOCAL ] DAO: Primary data saved (13357 records). [2025-09-15T18:01:55.565697] [INFO ] [MAIN ] DAO: Full history saved. [2025-09-15T18:01:55.565792] [INFO ] [MAIN ] Update Progress: 587/2369 symbols completed. DAO took 22.3s. Estimated remaining: 3h 7m 49s. Rate: 9.5 symbols/min [2025-09-15T18:01:55.667187] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-09-15T18:01:55.739350] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:01:55.775997] [DEBUG] [LOCAL ] DB: Loaded 39472 existing records from primary storage. [2025-09-15T18:01:55.776141] [INFO ] [MAIN ] DB: Loaded 39472 existing records. [2025-09-15T18:01:55.951238] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:01:55.951517] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-09-15T18:01:55.951583] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-09-15T18:01:55.952506] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-09-15T18:01:55.952569] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-09-15T18:01:56.308445] [INFO ] [REMOTE ] DB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:01:56.462933] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-09-15T18:01:56.478676] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-15T18:01:57.073068] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T18:01:57.079362] [INFO ] [REMOTE ] DAVA: Full fetch complete (43381 records). [2025-09-15T18:01:57.079520] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-09-15T18:01:57.261462] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-09-15T18:01:57.487594] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-09-15T18:01:57.487689] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-09-15T18:01:57.488283] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-09-15T18:01:57.488323] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-09-15T18:01:57.490193] [DEBUG] [LOCAL ] DAVA: Trimmed 43381 records to 30318 (keeping 150 days of data) [2025-09-15T18:01:57.673709] [DEBUG] [LOCAL ] DAVA: Primary data saved (30318 records). [2025-09-15T18:01:57.673874] [INFO ] [MAIN ] DAVA: Full history saved. [2025-09-15T18:01:57.673987] [INFO ] [MAIN ] Update Progress: 588/2369 symbols completed. DAVA took 22.9s. Estimated remaining: 3h 7m 30s. Rate: 9.5 symbols/min [2025-09-15T18:01:57.849461] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:01:57.868177] [DEBUG] [LOCAL ] DBD: Loaded 18458 existing records from primary storage. [2025-09-15T18:01:57.868308] [INFO ] [MAIN ] DBD: Loaded 18458 existing records. [2025-09-15T18:01:58.044286] [WARN ] [MAIN ] DBD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:01:58.044581] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-09-15T18:01:58.044630] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-15T18:01:58.045148] [DEBUG] [LOCAL ] DBD: Deleted primary data file. [2025-09-15T18:01:58.045202] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-09-15T18:01:58.076437] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-09-15T18:01:58.403784] [INFO ] [REMOTE ] DBD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:01:58.435453] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-15T18:01:58.839172] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T18:01:58.857831] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-09-15T18:01:59.657879] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-09-15T18:01:59.773896] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T18:02:00.052020] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T18:02:00.457852] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-09-15T18:02:00.608911] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-15T18:02:01.257883] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-09-15T18:02:02.057884] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-09-15T18:02:02.157996] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T18:02:02.270790] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-15T18:02:02.857900] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-09-15T18:02:03.526794] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-15T18:02:03.657900] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-09-15T18:02:04.383595] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T18:02:04.389237] [INFO ] [REMOTE ] DAR: Full fetch complete (55942 records). [2025-09-15T18:02:04.389362] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-09-15T18:02:04.390139] [FATAL] [VALIDATOR ] DAR: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:02:04.390226] [FATAL] [MAIN ] DAR: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:02:04.390266] [WARN ] [MAIN ] DAR: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:02:04.390307] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-09-15T18:02:04.390367] [DEBUG] [LOCAL ] DAR: No primary data file found to delete. [2025-09-15T18:02:04.390405] [INFO ] [LOCAL ] DAR: Starting deletion of derivative data. [2025-09-15T18:02:04.390714] [DEBUG] [LOCAL ] DAR: Deleted derivative data file. [2025-09-15T18:02:04.390801] [INFO ] [MAIN ] Update Progress: 589/2369 symbols completed. DAR took 31.0s. Estimated remaining: 3h 7m 25s. Rate: 9.5 symbols/min [2025-09-15T18:02:04.462972] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-09-15T18:02:04.572132] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:02:04.609267] [DEBUG] [LOCAL ] DBI: Loaded 33452 existing records from primary storage. [2025-09-15T18:02:04.609417] [INFO ] [MAIN ] DBI: Loaded 33452 existing records. [2025-09-15T18:02:04.787203] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:02:04.787486] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-09-15T18:02:04.787538] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-09-15T18:02:04.788304] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-09-15T18:02:04.788368] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-09-15T18:02:05.163262] [INFO ] [REMOTE ] DBI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:02:05.249485] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-15T18:02:05.260516] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-09-15T18:02:05.935813] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T18:02:06.057877] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-09-15T18:02:06.827205] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-15T18:02:06.857838] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-09-15T18:02:07.657844] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-09-15T18:02:08.049084] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-15T18:02:08.054436] [INFO ] [REMOTE ] DAY: Full fetch complete (54493 records). [2025-09-15T18:02:08.054534] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-09-15T18:02:08.461987] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-09-15T18:02:08.481199] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-09-15T18:02:08.481301] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-09-15T18:02:08.482052] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-09-15T18:02:08.482193] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-09-15T18:02:08.509027] [DEBUG] [LOCAL ] DAY: Trimmed 54493 records to 36701 (keeping 150 days of data) [2025-09-15T18:02:08.510383] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-15T18:02:08.748058] [DEBUG] [LOCAL ] DAY: Primary data saved (36701 records). [2025-09-15T18:02:08.748441] [INFO ] [MAIN ] DAY: Full history saved. [2025-09-15T18:02:08.749029] [INFO ] [MAIN ] Update Progress: 590/2369 symbols completed. DAY took 22.9s. Estimated remaining: 3h 7m 13s. Rate: 9.5 symbols/min [2025-09-15T18:02:08.924211] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:02:08.940410] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-15T18:02:08.952293] [DEBUG] [LOCAL ] DBL: Loaded 7122 existing records from primary storage. [2025-09-15T18:02:08.952443] [INFO ] [MAIN ] DBL: Loaded 7122 existing records. [2025-09-15T18:02:09.127295] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:02:09.127570] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-09-15T18:02:09.127619] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-09-15T18:02:09.128050] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-09-15T18:02:09.128100] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-09-15T18:02:09.263108] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-09-15T18:02:09.511373] [INFO ] [REMOTE ] DBL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:02:10.057899] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-09-15T18:02:10.329034] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-15T18:02:10.831854] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T18:02:10.857874] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-09-15T18:02:11.045836] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-15T18:02:11.251215] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-15T18:02:11.657895] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-09-15T18:02:12.457879] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-09-15T18:02:13.257894] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-09-15T18:02:13.297125] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-15T18:02:14.056245] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-15T18:02:14.058553] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-09-15T18:02:14.197227] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-15T18:02:14.857892] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-09-15T18:02:15.052898] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T18:02:15.233338] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-15T18:02:15.657898] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-09-15T18:02:16.462971] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-09-15T18:02:16.474065] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T18:02:17.257873] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-09-15T18:02:18.057279] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-15T18:02:18.064831] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-09-15T18:02:18.069965] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-15T18:02:18.857849] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-09-15T18:02:18.901099] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-15T18:02:19.657906] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-09-15T18:02:19.687813] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-15T18:02:20.457925] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-09-15T18:02:21.257881] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-09-15T18:02:21.464597] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T18:02:21.499355] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-15T18:02:22.052722] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-15T18:02:22.057814] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-09-15T18:02:22.857916] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-09-15T18:02:23.244956] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-15T18:02:23.657946] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-09-15T18:02:23.807281] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-15T18:02:23.810156] [INFO ] [REMOTE ] DBD: Full fetch complete (24926 records). [2025-09-15T18:02:23.810269] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-09-15T18:02:23.810838] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:02:23.810933] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:02:23.810978] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:02:23.811025] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-15T18:02:23.811093] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-15T18:02:23.811130] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-09-15T18:02:23.811622] [DEBUG] [LOCAL ] DBD: Deleted derivative data file. [2025-09-15T18:02:23.811731] [INFO ] [MAIN ] Update Progress: 591/2369 symbols completed. DBD took 26.1s. Estimated remaining: 3h 7m 33s. Rate: 9.5 symbols/min [2025-09-15T18:02:23.986366] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:02:24.023433] [DEBUG] [LOCAL ] DBRG: Loaded 37419 existing records from primary storage. [2025-09-15T18:02:24.023584] [INFO ] [MAIN ] DBRG: Loaded 37419 existing records. [2025-09-15T18:02:24.206159] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:02:24.206411] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-09-15T18:02:24.206458] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-09-15T18:02:24.207307] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-09-15T18:02:24.207357] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-09-15T18:02:24.462953] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-09-15T18:02:24.506224] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-15T18:02:24.573168] [INFO ] [REMOTE ] DBL: Full fetch complete (9857 records). [2025-09-15T18:02:24.578779] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:02:24.579677] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-09-15T18:02:24.952536] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-09-15T18:02:24.952622] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-09-15T18:02:24.952886] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-09-15T18:02:24.952927] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-09-15T18:02:24.953362] [DEBUG] [LOCAL ] DBL: Trimmed 9857 records to 7034 (keeping 150 days of data) [2025-09-15T18:02:24.996833] [DEBUG] [LOCAL ] DBL: Primary data saved (7034 records). [2025-09-15T18:02:24.996947] [INFO ] [MAIN ] DBL: Full history saved. [2025-09-15T18:02:24.997030] [INFO ] [MAIN ] Update Progress: 592/2369 symbols completed. DBL took 16.2s. Estimated remaining: 3h 7m 11s. Rate: 9.5 symbols/min [2025-09-15T18:02:25.167849] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:02:25.195904] [DEBUG] [LOCAL ] DCI: Loaded 27720 existing records from primary storage. [2025-09-15T18:02:25.196107] [INFO ] [MAIN ] DCI: Loaded 27720 existing records. [2025-09-15T18:02:25.263247] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-09-15T18:02:25.381216] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:02:25.381468] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-09-15T18:02:25.381514] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-09-15T18:02:25.382196] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-09-15T18:02:25.382249] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-09-15T18:02:25.743469] [INFO ] [REMOTE ] DCI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:02:26.057881] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-09-15T18:02:26.648558] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-15T18:02:26.857904] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-09-15T18:02:26.930577] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-15T18:02:27.470302] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-15T18:02:27.657898] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-09-15T18:02:28.395575] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-15T18:02:28.402185] [INFO ] [REMOTE ] DB: Full fetch complete (57068 records). [2025-09-15T18:02:28.402387] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-09-15T18:02:28.468790] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-09-15T18:02:28.793228] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-09-15T18:02:28.793331] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-09-15T18:02:28.794117] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-09-15T18:02:28.794177] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-09-15T18:02:28.795482] [DEBUG] [LOCAL ] DB: Trimmed 57068 records to 38694 (keeping 150 days of data) [2025-09-15T18:02:29.065806] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T18:02:29.083494] [DEBUG] [LOCAL ] DB: Primary data saved (38694 records). [2025-09-15T18:02:29.083708] [INFO ] [MAIN ] DB: Full history saved. [2025-09-15T18:02:29.084855] [INFO ] [MAIN ] Update Progress: 593/2369 symbols completed. DB took 33.5s. Estimated remaining: 3h 6m 58s. Rate: 9.5 symbols/min [2025-09-15T18:02:29.263605] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:02:29.263735] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-09-15T18:02:29.278062] [DEBUG] [LOCAL ] DCO: Loaded 10870 existing records from primary storage. [2025-09-15T18:02:29.278204] [INFO ] [MAIN ] DCO: Loaded 10870 existing records. [2025-09-15T18:02:29.466502] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:02:29.466782] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-09-15T18:02:29.466842] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-09-15T18:02:29.467239] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-09-15T18:02:29.467286] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-09-15T18:02:29.843053] [INFO ] [REMOTE ] DCO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:02:30.046463] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-15T18:02:30.051993] [INFO ] [REMOTE ] DBI: Full fetch complete (49344 records). [2025-09-15T18:02:30.052142] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-09-15T18:02:30.063776] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-09-15T18:02:30.444245] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-09-15T18:02:30.444348] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-09-15T18:02:30.445151] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-09-15T18:02:30.445201] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-09-15T18:02:30.446374] [DEBUG] [LOCAL ] DBI: Trimmed 49344 records to 32715 (keeping 150 days of data) [2025-09-15T18:02:30.651462] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-15T18:02:30.679574] [DEBUG] [LOCAL ] DBI: Primary data saved (32715 records). [2025-09-15T18:02:30.679751] [INFO ] [MAIN ] DBI: Full history saved. [2025-09-15T18:02:30.679850] [INFO ] [MAIN ] Update Progress: 594/2369 symbols completed. DBI took 26.3s. Estimated remaining: 3h 6m 38s. Rate: 9.5 symbols/min [2025-09-15T18:02:30.853139] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:02:30.857853] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-09-15T18:02:30.892543] [DEBUG] [LOCAL ] DD: Loaded 39762 existing records from primary storage. [2025-09-15T18:02:30.892711] [INFO ] [MAIN ] DD: Loaded 39762 existing records. [2025-09-15T18:02:31.079055] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:02:31.079323] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-09-15T18:02:31.079371] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-09-15T18:02:31.080193] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-09-15T18:02:31.080244] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-09-15T18:02:31.444254] [INFO ] [REMOTE ] DD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:02:31.657882] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-09-15T18:02:31.712675] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-15T18:02:32.457846] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-09-15T18:02:32.520063] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T18:02:32.552882] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T18:02:33.257897] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-09-15T18:02:33.809219] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-15T18:02:33.858425] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T18:02:34.057898] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-09-15T18:02:34.857907] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-09-15T18:02:35.455943] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-15T18:02:35.664577] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-09-15T18:02:35.667082] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-15T18:02:36.457878] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-09-15T18:02:37.263574] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-09-15T18:02:37.276191] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-15T18:02:37.982080] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T18:02:38.027190] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-15T18:02:38.057874] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-09-15T18:02:38.857882] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-09-15T18:02:39.256293] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-15T18:02:39.657867] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-09-15T18:02:40.457866] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-09-15T18:02:41.257953] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-09-15T18:02:41.543348] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-09-15T18:02:41.856230] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-15T18:02:42.043950] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T18:02:42.057819] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-09-15T18:02:42.150212] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-09-15T18:02:42.858006] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-09-15T18:02:43.505869] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-15T18:02:43.657889] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-09-15T18:02:44.457918] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-09-15T18:02:44.763063] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-15T18:02:45.197472] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-15T18:02:45.257913] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-09-15T18:02:46.057877] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-09-15T18:02:46.175951] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-15T18:02:46.482623] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-15T18:02:46.863373] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-09-15T18:02:46.865210] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-15T18:02:47.658146] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-09-15T18:02:48.215277] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T18:02:48.220309] [INFO ] [REMOTE ] DCI: Full fetch complete (40888 records). [2025-09-15T18:02:48.220433] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-09-15T18:02:48.463029] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-09-15T18:02:48.585241] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-15T18:02:48.621438] [INFO ] [REMOTE ] DCO: Full fetch complete (14574 records). [2025-09-15T18:02:48.621680] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-09-15T18:02:48.621775] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-09-15T18:02:48.621836] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-09-15T18:02:48.622707] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-09-15T18:02:48.638690] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-09-15T18:02:48.733940] [DEBUG] [LOCAL ] DCI: Trimmed 40888 records to 27192 (keeping 150 days of data) [2025-09-15T18:02:49.094372] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-09-15T18:02:49.094659] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-09-15T18:02:49.096894] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-09-15T18:02:49.097861] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-09-15T18:02:49.104822] [DEBUG] [LOCAL ] DCO: Trimmed 14574 records to 10699 (keeping 150 days of data) [2025-09-15T18:02:49.220517] [DEBUG] [LOCAL ] DCO: Primary data saved (10699 records). [2025-09-15T18:02:49.221939] [INFO ] [MAIN ] DCO: Full history saved. [2025-09-15T18:02:49.222733] [INFO ] [MAIN ] Update Progress: 595/2369 symbols completed. DCO took 20.1s. Estimated remaining: 3h 7m 8s. Rate: 9.5 symbols/min [2025-09-15T18:02:49.268018] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-09-15T18:02:49.335878] [DEBUG] [LOCAL ] DCI: Primary data saved (27192 records). [2025-09-15T18:02:49.341566] [INFO ] [MAIN ] DCI: Full history saved. [2025-09-15T18:02:49.352061] [INFO ] [MAIN ] Update Progress: 596/2369 symbols completed. DCI took 24.4s. Estimated remaining: 3h 6m 43s. Rate: 9.5 symbols/min [2025-09-15T18:02:49.494082] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:02:49.596945] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:02:49.630005] [DEBUG] [LOCAL ] DDL: Loaded 26209 existing records from primary storage. [2025-09-15T18:02:49.641465] [INFO ] [MAIN ] DDL: Loaded 26209 existing records. [2025-09-15T18:02:49.697881] [DEBUG] [LOCAL ] DDD: Loaded 38100 existing records from primary storage. [2025-09-15T18:02:49.712071] [INFO ] [MAIN ] DDD: Loaded 38100 existing records. [2025-09-15T18:02:49.957682] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:02:50.016975] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-09-15T18:02:50.020367] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:02:50.020552] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-09-15T18:02:50.020945] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-09-15T18:02:50.021014] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-09-15T18:02:50.021502] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-09-15T18:02:50.021572] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-09-15T18:02:50.026930] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-09-15T18:02:50.060558] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-09-15T18:02:50.367333] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-15T18:02:50.508106] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-09-15T18:02:50.759226] [INFO ] [REMOTE ] DDL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:02:50.827380] [INFO ] [REMOTE ] DDD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:02:50.866858] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-09-15T18:02:50.875829] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T18:02:51.657843] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-09-15T18:02:51.677293] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-15T18:02:51.682739] [INFO ] [REMOTE ] DBRG: Full fetch complete (54364 records). [2025-09-15T18:02:51.682883] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-09-15T18:02:52.066682] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-09-15T18:02:52.066765] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-09-15T18:02:52.067442] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-09-15T18:02:52.067484] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-09-15T18:02:52.068632] [DEBUG] [LOCAL ] DBRG: Trimmed 54364 records to 36678 (keeping 150 days of data) [2025-09-15T18:02:52.299323] [DEBUG] [LOCAL ] DBRG: Primary data saved (36678 records). [2025-09-15T18:02:52.299476] [INFO ] [MAIN ] DBRG: Full history saved. [2025-09-15T18:02:52.301190] [INFO ] [MAIN ] Update Progress: 597/2369 symbols completed. DBRG took 28.5s. Estimated remaining: 3h 6m 27s. Rate: 9.5 symbols/min [2025-09-15T18:02:52.407328] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-15T18:02:52.457893] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-09-15T18:02:53.131385] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-15T18:02:53.257832] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-09-15T18:02:53.805263] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T18:02:54.057897] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-09-15T18:02:54.732926] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-15T18:02:54.857907] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-09-15T18:02:55.306397] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-15T18:02:55.657909] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-09-15T18:02:56.125106] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T18:02:56.131181] [INFO ] [REMOTE ] DD: Full fetch complete (57377 records). [2025-09-15T18:02:56.131346] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-09-15T18:02:56.468450] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-09-15T18:02:56.519831] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-09-15T18:02:56.519910] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-09-15T18:02:56.520710] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-09-15T18:02:56.520775] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-09-15T18:02:56.522020] [DEBUG] [LOCAL ] DD: Trimmed 57377 records to 38986 (keeping 150 days of data) [2025-09-15T18:02:56.777002] [DEBUG] [LOCAL ] DD: Primary data saved (38986 records). [2025-09-15T18:02:56.777175] [INFO ] [MAIN ] DD: Full history saved. [2025-09-15T18:02:56.777263] [INFO ] [MAIN ] Update Progress: 598/2369 symbols completed. DD took 26.1s. Estimated remaining: 3h 6m 15s. Rate: 9.5 symbols/min [2025-09-15T18:02:57.088446] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-15T18:02:57.257879] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-09-15T18:02:58.317444] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-15T18:02:58.326973] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-09-15T18:02:58.411002] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-15T18:02:58.857920] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-09-15T18:02:59.696997] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-15T18:02:59.707790] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-09-15T18:02:59.931319] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-15T18:03:00.457948] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-09-15T18:03:01.665920] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-15T18:03:01.680141] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-09-15T18:03:01.705264] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-15T18:03:02.057888] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-09-15T18:03:03.180913] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-15T18:03:03.192074] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-09-15T18:03:03.553271] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T18:03:03.558052] [INFO ] [REMOTE ] DDL: Full fetch complete (39485 records). [2025-09-15T18:03:03.558172] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-09-15T18:03:03.944790] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-09-15T18:03:03.944876] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-09-15T18:03:03.945501] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-09-15T18:03:03.945544] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-09-15T18:03:03.946498] [DEBUG] [LOCAL ] DDL: Trimmed 39485 records to 25348 (keeping 150 days of data) [2025-09-15T18:03:04.102677] [DEBUG] [LOCAL ] DDL: Primary data saved (25348 records). [2025-09-15T18:03:04.102824] [INFO ] [MAIN ] DDL: Full history saved. [2025-09-15T18:03:04.102926] [INFO ] [MAIN ] Update Progress: 599/2369 symbols completed. DDL took 14.7s. Estimated remaining: 3h 6m 12s. Rate: 9.5 symbols/min [2025-09-15T18:03:04.999070] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-15T18:03:05.010050] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-09-15T18:03:06.670657] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-15T18:03:06.681876] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-09-15T18:03:08.115235] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-15T18:03:08.126122] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-09-15T18:03:09.759151] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-15T18:03:09.764850] [INFO ] [REMOTE ] DDD: Full fetch complete (55223 records). [2025-09-15T18:03:09.764994] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-09-15T18:03:10.140601] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-09-15T18:03:10.140697] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-09-15T18:03:10.141388] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-09-15T18:03:10.141440] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-09-15T18:03:10.142747] [DEBUG] [LOCAL ] DDD: Trimmed 55223 records to 37346 (keeping 150 days of data) [2025-09-15T18:03:10.362449] [DEBUG] [LOCAL ] DDD: Primary data saved (37346 records). [2025-09-15T18:03:10.362624] [INFO ] [MAIN ] DDD: Full history saved. [2025-09-15T18:03:10.362751] [INFO ] [MAIN ] Update Progress: 600/2369 symbols completed. DDD took 21.1s. Estimated remaining: 3h 6m 5s. Rate: 9.5 symbols/min [2025-09-15T18:03:10.965567] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:03:11.037238] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:03:11.066815] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:03:11.091725] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:03:11.095842] [DEBUG] [LOCAL ] DDT: Loaded 1389 existing records from primary storage. [2025-09-15T18:03:11.096044] [INFO ] [MAIN ] DDT: Loaded 1389 existing records. [2025-09-15T18:03:11.231743] [DEBUG] [LOCAL ] DDS: Loaded 9703 existing records from primary storage. [2025-09-15T18:03:11.232333] [INFO ] [MAIN ] DDS: Loaded 9703 existing records. [2025-09-15T18:03:11.336457] [DEBUG] [LOCAL ] DEA: Loaded 29951 existing records from primary storage. [2025-09-15T18:03:11.375467] [INFO ] [MAIN ] DEA: Loaded 29951 existing records. [2025-09-15T18:03:11.380694] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:03:11.486476] [DEBUG] [LOCAL ] DE: Loaded 35483 existing records from primary storage. [2025-09-15T18:03:11.495102] [INFO ] [MAIN ] DE: Loaded 35483 existing records. [2025-09-15T18:03:11.482531] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-09-15T18:03:11.559557] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-09-15T18:03:11.647783] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-09-15T18:03:11.671459] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-09-15T18:03:11.712136] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:03:11.856743] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-09-15T18:03:11.934967] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:03:11.921582] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-09-15T18:03:11.975622] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:03:11.978933] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-09-15T18:03:11.979363] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-09-15T18:03:11.979277] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-09-15T18:03:12.001116] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-09-15T18:03:12.070533] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-09-15T18:03:12.083801] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-09-15T18:03:12.070397] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-09-15T18:03:12.103594] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-09-15T18:03:12.110590] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-09-15T18:03:12.108828] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-09-15T18:03:12.759688] [INFO ] [REMOTE ] DDT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:03:12.798090] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-09-15T18:03:13.121078] [INFO ] [REMOTE ] DDS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:03:13.190137] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-09-15T18:03:13.240498] [INFO ] [REMOTE ] DEA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:03:13.241587] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-09-15T18:03:13.318117] [INFO ] [REMOTE ] DE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:03:13.318416] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-09-15T18:03:13.409222] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-15T18:03:13.410259] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-09-15T18:03:13.752387] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-15T18:03:13.753565] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-09-15T18:03:14.193304] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-15T18:03:14.196549] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-09-15T18:03:14.252837] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-15T18:03:14.254402] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-09-15T18:03:14.620714] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-15T18:03:14.621808] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-09-15T18:03:14.898557] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-15T18:03:14.908563] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-09-15T18:03:14.912120] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-15T18:03:14.913553] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-09-15T18:03:14.924866] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-15T18:03:14.928460] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-09-15T18:03:15.246855] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-15T18:03:15.457337] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-15T18:03:15.657893] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-09-15T18:03:15.715859] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-15T18:03:16.249618] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T18:03:16.457866] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-09-15T18:03:17.257829] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-09-15T18:03:17.382744] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-15T18:03:17.973683] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-15T18:03:18.057857] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-09-15T18:03:18.297359] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-15T18:03:18.857871] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-09-15T18:03:19.128724] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-09-15T18:03:19.444262] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-15T18:03:19.657923] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-09-15T18:03:20.439494] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-15T18:03:20.457843] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-09-15T18:03:21.003566] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-15T18:03:21.257880] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-09-15T18:03:22.057878] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-09-15T18:03:22.709119] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T18:03:22.857854] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-09-15T18:03:23.657872] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-09-15T18:03:23.966816] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-15T18:03:24.141523] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T18:03:24.457854] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-09-15T18:03:24.510744] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-15T18:03:25.257876] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-09-15T18:03:25.909847] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-15T18:03:26.008143] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-15T18:03:26.010623] [INFO ] [REMOTE ] DDS: Full fetch complete (14799 records). [2025-09-15T18:03:26.010748] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-09-15T18:03:26.063005] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-09-15T18:03:26.379658] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-09-15T18:03:26.379764] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-09-15T18:03:26.380132] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-09-15T18:03:26.380176] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-09-15T18:03:26.380780] [DEBUG] [LOCAL ] DDS: Trimmed 14799 records to 9514 (keeping 150 days of data) [2025-09-15T18:03:26.448129] [DEBUG] [LOCAL ] DDS: Primary data saved (9514 records). [2025-09-15T18:03:26.448280] [INFO ] [MAIN ] DDS: Full history saved. [2025-09-15T18:03:26.448399] [INFO ] [MAIN ] Update Progress: 601/2369 symbols completed. DDS took 16.1s. Estimated remaining: 3h 6m 28s. Rate: 9.5 symbols/min [2025-09-15T18:03:26.614916] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:03:26.640387] [DEBUG] [LOCAL ] DEC: Loaded 21746 existing records from primary storage. [2025-09-15T18:03:26.640518] [INFO ] [MAIN ] DEC: Loaded 21746 existing records. [2025-09-15T18:03:26.739376] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-15T18:03:26.742405] [INFO ] [REMOTE ] DDT: Full fetch complete (2191 records). [2025-09-15T18:03:26.742745] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-09-15T18:03:26.858866] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-09-15T18:03:26.925760] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:03:26.947947] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-09-15T18:03:26.953214] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-09-15T18:03:27.048018] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-09-15T18:03:27.088389] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-09-15T18:03:27.316266] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-09-15T18:03:27.334611] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-09-15T18:03:27.350887] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-09-15T18:03:27.367323] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-09-15T18:03:27.447020] [DEBUG] [LOCAL ] DDT: Trimmed 2191 records to 1355 (keeping 150 days of data) [2025-09-15T18:03:27.507006] [DEBUG] [LOCAL ] DDT: Primary data saved (1355 records). [2025-09-15T18:03:27.530258] [INFO ] [MAIN ] DDT: Full history saved. [2025-09-15T18:03:27.540376] [INFO ] [MAIN ] Update Progress: 602/2369 symbols completed. DDT took 17.2s. Estimated remaining: 3h 6m 6s. Rate: 9.5 symbols/min [2025-09-15T18:03:27.559932] [INFO ] [REMOTE ] DEC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:03:27.666772] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-09-15T18:03:27.748716] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:03:27.795154] [DEBUG] [LOCAL ] DECK: Loaded 40114 existing records from primary storage. [2025-09-15T18:03:27.795307] [INFO ] [MAIN ] DECK: Loaded 40114 existing records. [2025-09-15T18:03:27.973679] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:03:27.973917] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-09-15T18:03:27.973964] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-09-15T18:03:27.974984] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-09-15T18:03:27.975036] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-09-15T18:03:28.342090] [INFO ] [REMOTE ] DECK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:03:28.357195] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T18:03:28.362391] [INFO ] [REMOTE ] DEA: Full fetch complete (46310 records). [2025-09-15T18:03:28.362512] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-09-15T18:03:28.463039] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-09-15T18:03:28.753663] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-09-15T18:03:28.753754] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-09-15T18:03:28.754551] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-09-15T18:03:28.754598] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-09-15T18:03:28.755764] [DEBUG] [LOCAL ] DEA: Trimmed 46310 records to 29061 (keeping 150 days of data) [2025-09-15T18:03:28.965778] [DEBUG] [LOCAL ] DEA: Primary data saved (29061 records). [2025-09-15T18:03:28.965945] [INFO ] [MAIN ] DEA: Full history saved. [2025-09-15T18:03:28.966883] [INFO ] [MAIN ] Update Progress: 603/2369 symbols completed. DEA took 18.6s. Estimated remaining: 3h 5m 46s. Rate: 9.5 symbols/min [2025-09-15T18:03:29.201333] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:03:29.264601] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-09-15T18:03:29.269941] [DEBUG] [LOCAL ] DEI: Loaded 36290 existing records from primary storage. [2025-09-15T18:03:29.270170] [INFO ] [MAIN ] DEI: Loaded 36290 existing records. [2025-09-15T18:03:29.571377] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:03:29.571952] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-09-15T18:03:29.572051] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-09-15T18:03:29.573137] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-09-15T18:03:29.573228] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-09-15T18:03:29.945007] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-15T18:03:30.063276] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-09-15T18:03:30.238375] [INFO ] [REMOTE ] DEI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:03:30.328280] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-15T18:03:30.608404] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-15T18:03:30.857867] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-09-15T18:03:31.333764] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-15T18:03:31.657874] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-09-15T18:03:32.206140] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T18:03:32.457878] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-09-15T18:03:33.257874] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-09-15T18:03:33.305315] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T18:03:34.057849] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-09-15T18:03:34.106672] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-15T18:03:34.763466] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-15T18:03:34.857885] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-09-15T18:03:35.657888] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-09-15T18:03:36.398810] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-15T18:03:36.457836] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-09-15T18:03:36.621164] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T18:03:36.663564] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-15T18:03:37.257873] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-09-15T18:03:37.978489] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-15T18:03:38.057869] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-09-15T18:03:38.661126] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T18:03:38.857866] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-09-15T18:03:39.657845] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-09-15T18:03:40.136527] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-15T18:03:40.216554] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-15T18:03:40.221757] [INFO ] [REMOTE ] DE: Full fetch complete (51937 records). [2025-09-15T18:03:40.221886] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-09-15T18:03:40.222623] [FATAL] [VALIDATOR ] DE: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:03:40.222723] [FATAL] [MAIN ] DE: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:03:40.222784] [WARN ] [MAIN ] DE: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:03:40.222830] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-09-15T18:03:40.222891] [DEBUG] [LOCAL ] DE: No primary data file found to delete. [2025-09-15T18:03:40.222928] [INFO ] [LOCAL ] DE: Starting deletion of derivative data. [2025-09-15T18:03:40.223324] [DEBUG] [LOCAL ] DE: Deleted derivative data file. [2025-09-15T18:03:40.223418] [INFO ] [MAIN ] Update Progress: 604/2369 symbols completed. DE took 29.9s. Estimated remaining: 3h 5m 54s. Rate: 9.5 symbols/min [2025-09-15T18:03:40.395531] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:03:40.437879] [DEBUG] [LOCAL ] DELL: Loaded 40477 existing records from primary storage. [2025-09-15T18:03:40.438049] [INFO ] [MAIN ] DELL: Loaded 40477 existing records. [2025-09-15T18:03:40.468345] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-09-15T18:03:40.620405] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:03:40.620703] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-09-15T18:03:40.620755] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-09-15T18:03:40.622013] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-09-15T18:03:40.622068] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-09-15T18:03:40.968593] [INFO ] [REMOTE ] DELL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:03:41.084691] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-15T18:03:41.257873] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-09-15T18:03:42.057886] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-09-15T18:03:42.118890] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-15T18:03:42.447829] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T18:03:42.857911] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-09-15T18:03:43.657893] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-09-15T18:03:43.919748] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-15T18:03:43.971497] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-15T18:03:44.457870] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-09-15T18:03:45.240787] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-15T18:03:45.257822] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-09-15T18:03:45.688152] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T18:03:46.057900] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-09-15T18:03:46.857974] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-09-15T18:03:47.258090] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-15T18:03:47.657933] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-09-15T18:03:47.985856] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T18:03:48.406085] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-15T18:03:48.457906] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-09-15T18:03:49.257889] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-09-15T18:03:49.487836] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-15T18:03:50.057892] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-09-15T18:03:50.102863] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-15T18:03:50.105859] [INFO ] [REMOTE ] DEC: Full fetch complete (34077 records). [2025-09-15T18:03:50.105936] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-09-15T18:03:50.470547] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-09-15T18:03:50.470626] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-09-15T18:03:50.471224] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-09-15T18:03:50.471276] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-09-15T18:03:50.472068] [DEBUG] [LOCAL ] DEC: Trimmed 34077 records to 21123 (keeping 150 days of data) [2025-09-15T18:03:50.617937] [DEBUG] [LOCAL ] DEC: Primary data saved (21123 records). [2025-09-15T18:03:50.618065] [INFO ] [MAIN ] DEC: Full history saved. [2025-09-15T18:03:50.618152] [INFO ] [MAIN ] Update Progress: 605/2369 symbols completed. DEC took 24.2s. Estimated remaining: 3h 5m 59s. Rate: 9.5 symbols/min [2025-09-15T18:03:50.791789] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:03:50.834807] [DEBUG] [LOCAL ] DEO: Loaded 36454 existing records from primary storage. [2025-09-15T18:03:50.835010] [INFO ] [MAIN ] DEO: Loaded 36454 existing records. [2025-09-15T18:03:50.865280] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-09-15T18:03:51.014184] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:03:51.014570] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-09-15T18:03:51.014627] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-09-15T18:03:51.015504] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-09-15T18:03:51.015554] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-09-15T18:03:51.320316] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.86 seconds). [2025-09-15T18:03:51.409828] [INFO ] [REMOTE ] DEO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:03:51.462263] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T18:03:51.657875] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-09-15T18:03:52.457889] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-09-15T18:03:52.685525] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-15T18:03:52.691425] [INFO ] [REMOTE ] DECK: Full fetch complete (57997 records). [2025-09-15T18:03:52.691583] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-09-15T18:03:53.076167] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-09-15T18:03:53.076267] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-09-15T18:03:53.077104] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-09-15T18:03:53.077163] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-09-15T18:03:53.078702] [DEBUG] [LOCAL ] DECK: Trimmed 57997 records to 39340 (keeping 150 days of data) [2025-09-15T18:03:53.262815] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-09-15T18:03:53.341592] [DEBUG] [LOCAL ] DECK: Primary data saved (39340 records). [2025-09-15T18:03:53.341779] [INFO ] [MAIN ] DECK: Full history saved. [2025-09-15T18:03:53.341879] [INFO ] [MAIN ] Update Progress: 606/2369 symbols completed. DECK took 25.8s. Estimated remaining: 3h 5m 42s. Rate: 9.5 symbols/min [2025-09-15T18:03:53.527487] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-15T18:03:53.563120] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:03:53.587522] [DEBUG] [LOCAL ] DFH: Loaded 24215 existing records from primary storage. [2025-09-15T18:03:53.587699] [INFO ] [MAIN ] DFH: Loaded 24215 existing records. [2025-09-15T18:03:53.804402] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:03:53.804689] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-09-15T18:03:53.804737] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-09-15T18:03:53.805389] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-09-15T18:03:53.805438] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-09-15T18:03:54.064932] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-09-15T18:03:54.186956] [INFO ] [REMOTE ] DFH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:03:54.220657] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-15T18:03:54.857866] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-09-15T18:03:55.594264] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-15T18:03:55.648870] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T18:03:55.658762] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-09-15T18:03:56.457923] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-09-15T18:03:56.480751] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-15T18:03:56.486613] [INFO ] [REMOTE ] DEI: Full fetch complete (52484 records). [2025-09-15T18:03:56.486801] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-09-15T18:03:56.871260] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-09-15T18:03:56.871370] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-09-15T18:03:56.872583] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-09-15T18:03:56.872655] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-09-15T18:03:56.874153] [DEBUG] [LOCAL ] DEI: Trimmed 52484 records to 35546 (keeping 150 days of data) [2025-09-15T18:03:57.115546] [DEBUG] [LOCAL ] DEI: Primary data saved (35546 records). [2025-09-15T18:03:57.115777] [INFO ] [MAIN ] DEI: Full history saved. [2025-09-15T18:03:57.116929] [INFO ] [MAIN ] Update Progress: 607/2369 symbols completed. DEI took 28.1s. Estimated remaining: 3h 5m 29s. Rate: 9.5 symbols/min [2025-09-15T18:03:57.291569] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-09-15T18:03:57.296768] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:03:57.317132] [DEBUG] [LOCAL ] DFIN: Loaded 16451 existing records from primary storage. [2025-09-15T18:03:57.317311] [INFO ] [MAIN ] DFIN: Loaded 16451 existing records. [2025-09-15T18:03:57.510110] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:03:57.510756] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-09-15T18:03:57.510884] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-09-15T18:03:57.511582] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-09-15T18:03:57.511630] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-09-15T18:03:57.793744] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-15T18:03:57.907061] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:03:57.989228] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-15T18:03:58.057900] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-09-15T18:03:58.274138] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-15T18:03:58.857922] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-09-15T18:03:59.226984] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-15T18:03:59.657882] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-09-15T18:04:00.457876] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-09-15T18:04:01.115949] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-15T18:04:01.257861] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-09-15T18:04:01.452502] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-15T18:04:01.521590] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-15T18:04:02.057925] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-09-15T18:04:02.857871] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-09-15T18:04:02.938956] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T18:04:02.976588] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-15T18:04:03.657874] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-09-15T18:04:04.457884] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-09-15T18:04:04.692891] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-15T18:04:05.257875] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-09-15T18:04:05.326605] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-15T18:04:05.388301] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-15T18:04:05.393797] [INFO ] [REMOTE ] DELL: Full fetch complete (58026 records). [2025-09-15T18:04:05.393929] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-09-15T18:04:05.394872] [FATAL] [VALIDATOR ] DELL: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:04:05.394967] [FATAL] [MAIN ] DELL: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:04:05.395028] [WARN ] [MAIN ] DELL: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:04:05.395096] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-09-15T18:04:05.395166] [DEBUG] [LOCAL ] DELL: No primary data file found to delete. [2025-09-15T18:04:05.395203] [INFO ] [LOCAL ] DELL: Starting deletion of derivative data. [2025-09-15T18:04:05.395489] [DEBUG] [LOCAL ] DELL: Deleted derivative data file. [2025-09-15T18:04:05.396107] [INFO ] [MAIN ] Update Progress: 608/2369 symbols completed. DELL took 25.2s. Estimated remaining: 3h 5m 28s. Rate: 9.5 symbols/min [2025-09-15T18:04:05.577199] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:04:05.592123] [DEBUG] [LOCAL ] DFP: Loaded 8600 existing records from primary storage. [2025-09-15T18:04:05.592281] [INFO ] [MAIN ] DFP: Loaded 8600 existing records. [2025-09-15T18:04:05.768822] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:04:05.769096] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-09-15T18:04:05.769142] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-09-15T18:04:05.769581] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-09-15T18:04:05.769627] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-09-15T18:04:06.062949] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-09-15T18:04:06.117808] [INFO ] [REMOTE ] DFP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:04:06.857862] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-09-15T18:04:07.195512] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-15T18:04:07.544154] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T18:04:07.657901] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-09-15T18:04:07.682105] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-15T18:04:08.421572] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-15T18:04:08.457812] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-09-15T18:04:09.257924] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-09-15T18:04:09.446240] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-15T18:04:10.057881] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-09-15T18:04:10.772489] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-15T18:04:10.857871] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-09-15T18:04:10.993054] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-15T18:04:11.657883] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-09-15T18:04:11.848090] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-15T18:04:12.457877] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-09-15T18:04:13.045078] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-15T18:04:13.050560] [INFO ] [REMOTE ] DEO: Full fetch complete (53242 records). [2025-09-15T18:04:13.050687] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-09-15T18:04:13.263079] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-09-15T18:04:13.373738] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-15T18:04:13.445420] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-09-15T18:04:13.445504] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-09-15T18:04:13.446228] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-09-15T18:04:13.446274] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-09-15T18:04:13.447360] [DEBUG] [LOCAL ] DEO: Trimmed 53242 records to 35760 (keeping 150 days of data) [2025-09-15T18:04:13.671374] [DEBUG] [LOCAL ] DEO: Primary data saved (35760 records). [2025-09-15T18:04:13.671553] [INFO ] [MAIN ] DEO: Full history saved. [2025-09-15T18:04:13.673146] [INFO ] [MAIN ] Update Progress: 609/2369 symbols completed. DEO took 23.1s. Estimated remaining: 3h 5m 27s. Rate: 9.5 symbols/min [2025-09-15T18:04:13.842373] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:04:13.887503] [DEBUG] [LOCAL ] DG: Loaded 40084 existing records from primary storage. [2025-09-15T18:04:13.887665] [INFO ] [MAIN ] DG: Loaded 40084 existing records. [2025-09-15T18:04:14.059624] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-09-15T18:04:14.066793] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:04:14.067065] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-09-15T18:04:14.067115] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-09-15T18:04:14.068151] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-09-15T18:04:14.068209] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-09-15T18:04:14.362123] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T18:04:14.445144] [INFO ] [REMOTE ] DG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:04:14.857887] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-09-15T18:04:15.341452] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T18:04:15.641437] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-15T18:04:15.644223] [INFO ] [REMOTE ] DFIN: Full fetch complete (25996 records). [2025-09-15T18:04:15.644297] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-09-15T18:04:15.663023] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-09-15T18:04:16.034801] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-09-15T18:04:16.034889] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-09-15T18:04:16.035422] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-09-15T18:04:16.035486] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-09-15T18:04:16.036329] [DEBUG] [LOCAL ] DFIN: Trimmed 25996 records to 15977 (keeping 150 days of data) [2025-09-15T18:04:16.139357] [DEBUG] [LOCAL ] DFIN: Primary data saved (15977 records). [2025-09-15T18:04:16.139532] [INFO ] [MAIN ] DFIN: Full history saved. [2025-09-15T18:04:16.139676] [INFO ] [MAIN ] Update Progress: 610/2369 symbols completed. DFIN took 19.0s. Estimated remaining: 3h 5m 10s. Rate: 9.5 symbols/min [2025-09-15T18:04:16.313599] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:04:16.348968] [DEBUG] [LOCAL ] DGX: Loaded 33788 existing records from primary storage. [2025-09-15T18:04:16.349115] [INFO ] [MAIN ] DGX: Loaded 33788 existing records. [2025-09-15T18:04:16.462972] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-09-15T18:04:16.525965] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:04:16.527752] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-09-15T18:04:16.536001] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-09-15T18:04:16.536972] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-15T18:04:16.540106] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-09-15T18:04:16.541025] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-09-15T18:04:16.910176] [INFO ] [REMOTE ] DGX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:04:17.257886] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-09-15T18:04:18.057905] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-09-15T18:04:18.144147] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-15T18:04:18.390997] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-15T18:04:18.857898] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-09-15T18:04:19.397058] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-15T18:04:19.657870] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-09-15T18:04:19.681155] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T18:04:20.457870] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-09-15T18:04:21.227154] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-15T18:04:21.257832] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-09-15T18:04:21.955975] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-15T18:04:22.057927] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-09-15T18:04:22.858674] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-09-15T18:04:22.863922] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-15T18:04:23.454522] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T18:04:23.657892] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-09-15T18:04:24.457915] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-09-15T18:04:24.683084] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-15T18:04:24.933809] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-15T18:04:25.257877] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-09-15T18:04:25.318497] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-15T18:04:25.697959] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-15T18:04:26.057863] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-09-15T18:04:26.857904] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-09-15T18:04:27.277581] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-15T18:04:27.281397] [INFO ] [REMOTE ] DFH: Full fetch complete (36222 records). [2025-09-15T18:04:27.281523] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-09-15T18:04:27.618364] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-15T18:04:27.667400] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-09-15T18:04:27.669543] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-09-15T18:04:27.670366] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-09-15T18:04:27.671135] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-09-15T18:04:27.671274] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-09-15T18:04:27.672310] [DEBUG] [LOCAL ] DFH: Trimmed 36222 records to 23634 (keeping 150 days of data) [2025-09-15T18:04:27.817478] [DEBUG] [LOCAL ] DFH: Primary data saved (23634 records). [2025-09-15T18:04:27.817619] [INFO ] [MAIN ] DFH: Full history saved. [2025-09-15T18:04:27.817782] [INFO ] [MAIN ] Update Progress: 611/2369 symbols completed. DFH took 34.5s. Estimated remaining: 3h 5m 19s. Rate: 9.5 symbols/min [2025-09-15T18:04:27.989973] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:04:28.007295] [DEBUG] [LOCAL ] DHF: Loaded 16009 existing records from primary storage. [2025-09-15T18:04:28.007422] [INFO ] [MAIN ] DHF: Loaded 16009 existing records. [2025-09-15T18:04:28.184770] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:04:28.185035] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-09-15T18:04:28.185082] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-09-15T18:04:28.185559] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-09-15T18:04:28.185617] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-09-15T18:04:28.466911] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-09-15T18:04:28.551986] [INFO ] [REMOTE ] DHF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:04:29.257898] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-09-15T18:04:29.641968] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-15T18:04:29.676264] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T18:04:30.057854] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-09-15T18:04:30.114361] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T18:04:30.857882] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-09-15T18:04:31.657874] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-09-15T18:04:31.904267] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-15T18:04:31.924320] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-15T18:04:31.926303] [INFO ] [REMOTE ] DFP: Full fetch complete (12667 records). [2025-09-15T18:04:31.926388] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-09-15T18:04:31.926845] [FATAL] [VALIDATOR ] DFP: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:04:31.926922] [FATAL] [MAIN ] DFP: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:04:31.926964] [WARN ] [MAIN ] DFP: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:04:31.927048] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-09-15T18:04:31.927124] [DEBUG] [LOCAL ] DFP: No primary data file found to delete. [2025-09-15T18:04:31.927184] [INFO ] [LOCAL ] DFP: Starting deletion of derivative data. [2025-09-15T18:04:31.927490] [DEBUG] [LOCAL ] DFP: Deleted derivative data file. [2025-09-15T18:04:31.927616] [INFO ] [MAIN ] Update Progress: 612/2369 symbols completed. DFP took 26.5s. Estimated remaining: 3h 5m 6s. Rate: 9.5 symbols/min [2025-09-15T18:04:32.096898] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:04:32.138944] [DEBUG] [LOCAL ] DHI: Loaded 40196 existing records from primary storage. [2025-09-15T18:04:32.139109] [INFO ] [MAIN ] DHI: Loaded 40196 existing records. [2025-09-15T18:04:32.315425] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:04:32.315731] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-09-15T18:04:32.315793] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-09-15T18:04:32.316739] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-09-15T18:04:32.316799] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-09-15T18:04:32.463918] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-09-15T18:04:32.672809] [INFO ] [REMOTE ] DHI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:04:32.930786] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-15T18:04:33.257862] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-09-15T18:04:33.936422] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-15T18:04:34.057862] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-09-15T18:04:34.383360] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-15T18:04:34.857866] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-09-15T18:04:35.657855] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-09-15T18:04:35.889538] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-15T18:04:36.457871] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-09-15T18:04:36.552114] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-15T18:04:36.642376] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-15T18:04:37.257873] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-09-15T18:04:37.777579] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-15T18:04:38.057857] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-09-15T18:04:38.210518] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-15T18:04:38.857868] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-09-15T18:04:39.657849] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-09-15T18:04:39.817189] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-15T18:04:40.048076] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-15T18:04:40.054136] [INFO ] [REMOTE ] DG: Full fetch complete (57969 records). [2025-09-15T18:04:40.054271] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-09-15T18:04:40.462973] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-09-15T18:04:40.464759] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-09-15T18:04:40.464858] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-09-15T18:04:40.465581] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-09-15T18:04:40.465780] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-09-15T18:04:40.467039] [DEBUG] [LOCAL ] DG: Trimmed 57969 records to 39311 (keeping 150 days of data) [2025-09-15T18:04:40.719003] [DEBUG] [LOCAL ] DG: Primary data saved (39311 records). [2025-09-15T18:04:40.719167] [INFO ] [MAIN ] DG: Full history saved. [2025-09-15T18:04:40.720781] [INFO ] [MAIN ] Update Progress: 613/2369 symbols completed. DG took 27.0s. Estimated remaining: 3h 5m 7s. Rate: 9.5 symbols/min [2025-09-15T18:04:40.895750] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:04:40.939987] [DEBUG] [LOCAL ] DHR: Loaded 40171 existing records from primary storage. [2025-09-15T18:04:40.940141] [INFO ] [MAIN ] DHR: Loaded 40171 existing records. [2025-09-15T18:04:41.118807] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:04:41.119109] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-09-15T18:04:41.119156] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-09-15T18:04:41.120152] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-09-15T18:04:41.120204] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-09-15T18:04:41.266625] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-09-15T18:04:41.497940] [INFO ] [REMOTE ] DHR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:04:41.530998] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-15T18:04:41.610875] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-15T18:04:42.057823] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-09-15T18:04:42.432388] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-15T18:04:42.857932] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-09-15T18:04:43.426506] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-15T18:04:43.431242] [INFO ] [REMOTE ] DGX: Full fetch complete (49927 records). [2025-09-15T18:04:43.431358] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-09-15T18:04:43.662994] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-09-15T18:04:43.830465] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-09-15T18:04:43.830556] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-09-15T18:04:43.831294] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-09-15T18:04:43.831344] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-09-15T18:04:43.832721] [DEBUG] [LOCAL ] DGX: Trimmed 49927 records to 32994 (keeping 150 days of data) [2025-09-15T18:04:44.052840] [DEBUG] [LOCAL ] DGX: Primary data saved (32994 records). [2025-09-15T18:04:44.053013] [INFO ] [MAIN ] DGX: Full history saved. [2025-09-15T18:04:44.053808] [INFO ] [MAIN ] Update Progress: 614/2369 symbols completed. DGX took 27.9s. Estimated remaining: 3h 4m 52s. Rate: 9.5 symbols/min [2025-09-15T18:04:44.224256] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:04:44.255581] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T18:04:44.300201] [DEBUG] [LOCAL ] DHT: Loaded 35605 existing records from primary storage. [2025-09-15T18:04:44.300369] [INFO ] [MAIN ] DHT: Loaded 35605 existing records. [2025-09-15T18:04:44.458461] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-09-15T18:04:44.480292] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:04:44.480564] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-09-15T18:04:44.480612] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-09-15T18:04:44.481477] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-09-15T18:04:44.481531] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-09-15T18:04:44.837619] [INFO ] [REMOTE ] DHT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:04:45.257898] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-09-15T18:04:45.362411] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-15T18:04:46.057873] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-09-15T18:04:46.124837] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-15T18:04:46.297454] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-15T18:04:46.857890] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-09-15T18:04:47.504098] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-15T18:04:47.506524] [INFO ] [REMOTE ] DHF: Full fetch complete (22726 records). [2025-09-15T18:04:47.506598] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-09-15T18:04:47.669512] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-09-15T18:04:47.770419] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-15T18:04:47.936881] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-09-15T18:04:47.936963] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-09-15T18:04:47.937443] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-09-15T18:04:47.937483] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-09-15T18:04:47.938161] [DEBUG] [LOCAL ] DHF: Trimmed 22726 records to 15803 (keeping 150 days of data) [2025-09-15T18:04:48.033958] [DEBUG] [LOCAL ] DHF: Primary data saved (15803 records). [2025-09-15T18:04:48.034136] [INFO ] [MAIN ] DHF: Full history saved. [2025-09-15T18:04:48.034260] [INFO ] [MAIN ] Update Progress: 615/2369 symbols completed. DHF took 20.2s. Estimated remaining: 3h 4m 39s. Rate: 9.5 symbols/min [2025-09-15T18:04:48.209587] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:04:48.219713] [DEBUG] [LOCAL ] DHX: Loaded 9236 existing records from primary storage. [2025-09-15T18:04:48.219833] [INFO ] [MAIN ] DHX: Loaded 9236 existing records. [2025-09-15T18:04:48.398338] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:04:48.398630] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-09-15T18:04:48.398707] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-09-15T18:04:48.399021] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-09-15T18:04:48.399076] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-09-15T18:04:48.462941] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-09-15T18:04:48.759924] [INFO ] [REMOTE ] DHX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:04:49.257879] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-09-15T18:04:49.658233] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-15T18:04:50.057885] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-09-15T18:04:50.122300] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T18:04:50.264728] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-15T18:04:50.857887] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-09-15T18:04:51.657877] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-09-15T18:04:51.959220] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-15T18:04:52.173596] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-15T18:04:52.457906] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-09-15T18:04:53.068150] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-15T18:04:53.258148] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-09-15T18:04:53.264264] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T18:04:54.057865] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-09-15T18:04:54.184478] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-15T18:04:54.857931] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-09-15T18:04:55.657920] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-09-15T18:04:55.845185] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-15T18:04:56.457935] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-09-15T18:04:57.257863] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-09-15T18:04:57.454595] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-09-15T18:04:58.057837] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-09-15T18:04:58.165283] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-09-15T18:04:58.272622] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-15T18:04:58.472722] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-15T18:04:58.857897] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-09-15T18:04:59.657838] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-09-15T18:04:59.885278] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-15T18:05:00.457902] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-09-15T18:05:00.582666] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-15T18:05:00.610755] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-15T18:05:00.616689] [INFO ] [REMOTE ] DHI: Full fetch complete (58044 records). [2025-09-15T18:05:00.616801] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-09-15T18:05:01.040388] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-09-15T18:05:01.040478] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-09-15T18:05:01.041277] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-09-15T18:05:01.041330] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-09-15T18:05:01.042666] [DEBUG] [LOCAL ] DHI: Trimmed 58044 records to 39418 (keeping 150 days of data) [2025-09-15T18:05:01.259155] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-09-15T18:05:01.332771] [DEBUG] [LOCAL ] DHI: Primary data saved (39418 records). [2025-09-15T18:05:01.332955] [INFO ] [MAIN ] DHI: Full history saved. [2025-09-15T18:05:01.333600] [INFO ] [MAIN ] Update Progress: 616/2369 symbols completed. DHI took 29.4s. Estimated remaining: 3h 4m 53s. Rate: 9.5 symbols/min [2025-09-15T18:05:01.513272] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:05:01.527501] [DEBUG] [LOCAL ] DIAX: Loaded 8704 existing records from primary storage. [2025-09-15T18:05:01.527635] [INFO ] [MAIN ] DIAX: Loaded 8704 existing records. [2025-09-15T18:05:01.709953] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:05:01.710244] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-09-15T18:05:01.710293] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-09-15T18:05:01.710699] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-09-15T18:05:01.710778] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-09-15T18:05:01.980474] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-15T18:05:02.066208] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-09-15T18:05:02.112022] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:05:02.253893] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-15T18:05:02.857886] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-09-15T18:05:03.657856] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-09-15T18:05:04.053517] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-15T18:05:04.420851] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-15T18:05:04.467836] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-09-15T18:05:04.472015] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T18:05:05.257911] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-09-15T18:05:05.268957] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-15T18:05:05.861134] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-15T18:05:05.863497] [INFO ] [REMOTE ] DHX: Full fetch complete (15358 records). [2025-09-15T18:05:05.863581] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-09-15T18:05:06.063360] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-09-15T18:05:06.225964] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-09-15T18:05:06.226054] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-09-15T18:05:06.226424] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-09-15T18:05:06.226480] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-09-15T18:05:06.227066] [DEBUG] [LOCAL ] DHX: Trimmed 15358 records to 9039 (keeping 150 days of data) [2025-09-15T18:05:06.280488] [DEBUG] [LOCAL ] DHX: Primary data saved (9039 records). [2025-09-15T18:05:06.280662] [INFO ] [MAIN ] DHX: Full history saved. [2025-09-15T18:05:06.280781] [INFO ] [MAIN ] Update Progress: 617/2369 symbols completed. DHX took 18.2s. Estimated remaining: 3h 4m 43s. Rate: 9.5 symbols/min [2025-09-15T18:05:06.459619] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:05:06.486796] [DEBUG] [LOCAL ] DIN: Loaded 27267 existing records from primary storage. [2025-09-15T18:05:06.486940] [INFO ] [MAIN ] DIN: Loaded 27267 existing records. [2025-09-15T18:05:06.669054] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:05:06.669331] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-09-15T18:05:06.669380] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-09-15T18:05:06.670169] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-09-15T18:05:06.670227] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-09-15T18:05:06.870470] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-09-15T18:05:07.056204] [INFO ] [REMOTE ] DIN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:05:07.657891] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-09-15T18:05:08.007155] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-15T18:05:08.014295] [INFO ] [REMOTE ] DHR: Full fetch complete (58043 records). [2025-09-15T18:05:08.014482] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-09-15T18:05:08.361138] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-15T18:05:08.436835] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-09-15T18:05:08.436931] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-09-15T18:05:08.437687] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-09-15T18:05:08.437741] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-09-15T18:05:08.440721] [DEBUG] [LOCAL ] DHR: Trimmed 58043 records to 39395 (keeping 150 days of data) [2025-09-15T18:05:08.509329] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-09-15T18:05:08.609379] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-15T18:05:08.786074] [DEBUG] [LOCAL ] DHR: Primary data saved (39395 records). [2025-09-15T18:05:08.786255] [INFO ] [MAIN ] DHR: Full history saved. [2025-09-15T18:05:08.787347] [INFO ] [MAIN ] Update Progress: 618/2369 symbols completed. DHR took 28.1s. Estimated remaining: 3h 4m 25s. Rate: 9.5 symbols/min [2025-09-15T18:05:08.960077] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:05:09.008740] [DEBUG] [LOCAL ] DINO: Loaded 39866 existing records from primary storage. [2025-09-15T18:05:09.008939] [INFO ] [MAIN ] DINO: Loaded 39866 existing records. [2025-09-15T18:05:09.185676] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:05:09.185974] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-09-15T18:05:09.186033] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-09-15T18:05:09.186959] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-09-15T18:05:09.187015] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-09-15T18:05:09.262983] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-09-15T18:05:09.547495] [INFO ] [REMOTE ] DINO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:05:10.057902] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-09-15T18:05:10.108193] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T18:05:10.163492] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-15T18:05:10.857897] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-09-15T18:05:11.608582] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-15T18:05:11.657928] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-09-15T18:05:12.157406] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-15T18:05:12.314190] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T18:05:12.457889] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-09-15T18:05:13.257876] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-09-15T18:05:13.551386] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-15T18:05:14.057934] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-09-15T18:05:14.513459] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-15T18:05:14.857952] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-09-15T18:05:14.921599] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-15T18:05:14.930360] [INFO ] [REMOTE ] DHT: Full fetch complete (51961 records). [2025-09-15T18:05:14.930597] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-09-15T18:05:14.931786] [FATAL] [VALIDATOR ] DHT: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:05:14.931946] [FATAL] [MAIN ] DHT: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:05:14.932023] [WARN ] [MAIN ] DHT: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:05:14.932095] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-09-15T18:05:14.932200] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-09-15T18:05:14.932269] [INFO ] [LOCAL ] DHT: Starting deletion of derivative data. [2025-09-15T18:05:14.934584] [DEBUG] [LOCAL ] DHT: Deleted derivative data file. [2025-09-15T18:05:14.939143] [INFO ] [MAIN ] Update Progress: 619/2369 symbols completed. DHT took 30.9s. Estimated remaining: 3h 4m 19s. Rate: 9.5 symbols/min [2025-09-15T18:05:15.217487] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:05:15.297409] [DEBUG] [LOCAL ] DIS: Loaded 40528 existing records from primary storage. [2025-09-15T18:05:15.297673] [INFO ] [MAIN ] DIS: Loaded 40528 existing records. [2025-09-15T18:05:15.514162] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:05:15.514737] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-09-15T18:05:15.520059] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-09-15T18:05:15.527149] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-15T18:05:15.527211] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-09-15T18:05:15.530459] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-09-15T18:05:15.673168] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-09-15T18:05:15.921820] [INFO ] [REMOTE ] DIS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:05:16.457909] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-09-15T18:05:17.257831] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-09-15T18:05:17.705852] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-15T18:05:18.057893] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-09-15T18:05:18.857893] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-09-15T18:05:18.892226] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-15T18:05:19.057797] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-09-15T18:05:19.492477] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-15T18:05:19.657909] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-09-15T18:05:19.875100] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T18:05:20.457922] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-09-15T18:05:21.257877] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-09-15T18:05:21.413391] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-15T18:05:21.556502] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-15T18:05:22.057942] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-09-15T18:05:22.857898] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-09-15T18:05:22.978403] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-15T18:05:23.000814] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-15T18:05:23.002547] [INFO ] [REMOTE ] DIAX: Full fetch complete (12969 records). [2025-09-15T18:05:23.002615] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-09-15T18:05:23.003056] [FATAL] [VALIDATOR ] DIAX: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:05:23.003138] [FATAL] [MAIN ] DIAX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:05:23.003174] [WARN ] [MAIN ] DIAX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:05:23.003213] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-09-15T18:05:23.003285] [DEBUG] [LOCAL ] DIAX: No primary data file found to delete. [2025-09-15T18:05:23.003324] [INFO ] [LOCAL ] DIAX: Starting deletion of derivative data. [2025-09-15T18:05:23.003634] [DEBUG] [LOCAL ] DIAX: Deleted derivative data file. [2025-09-15T18:05:23.003735] [INFO ] [MAIN ] Update Progress: 620/2369 symbols completed. DIAX took 21.7s. Estimated remaining: 3h 4m 17s. Rate: 9.5 symbols/min [2025-09-15T18:05:23.174537] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:05:23.174782] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-09-15T18:05:23.174821] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-09-15T18:05:23.174939] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-09-15T18:05:23.174978] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-15T18:05:23.175018] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-15T18:05:23.175049] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-09-15T18:05:23.526052] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:05:23.657879] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-09-15T18:05:24.457874] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-09-15T18:05:24.689490] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-15T18:05:24.869720] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-15T18:05:25.257873] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-09-15T18:05:25.398446] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-15T18:05:26.057885] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-09-15T18:05:26.857877] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-09-15T18:05:27.069941] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-15T18:05:27.642898] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T18:05:27.657847] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-09-15T18:05:27.911913] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-15T18:05:28.457865] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-09-15T18:05:29.257876] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-09-15T18:05:29.395841] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-15T18:05:29.486934] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-15T18:05:29.491612] [INFO ] [REMOTE ] DIN: Full fetch complete (40640 records). [2025-09-15T18:05:29.491797] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-09-15T18:05:29.870691] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-09-15T18:05:29.870780] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-09-15T18:05:29.871358] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-09-15T18:05:29.871412] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-09-15T18:05:29.872491] [DEBUG] [LOCAL ] DIN: Trimmed 40640 records to 26800 (keeping 150 days of data) [2025-09-15T18:05:30.040560] [DEBUG] [LOCAL ] DIN: Primary data saved (26800 records). [2025-09-15T18:05:30.040712] [INFO ] [MAIN ] DIN: Full history saved. [2025-09-15T18:05:30.040799] [INFO ] [MAIN ] Update Progress: 621/2369 symbols completed. DIN took 23.8s. Estimated remaining: 3h 4m 13s. Rate: 9.5 symbols/min [2025-09-15T18:05:30.063018] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-09-15T18:05:30.216074] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:05:30.251937] [DEBUG] [LOCAL ] DK: Loaded 37241 existing records from primary storage. [2025-09-15T18:05:30.252100] [INFO ] [MAIN ] DK: Loaded 37241 existing records. [2025-09-15T18:05:30.425864] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:05:30.426134] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-09-15T18:05:30.426186] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-09-15T18:05:30.427100] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-09-15T18:05:30.427151] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-09-15T18:05:30.695052] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-15T18:05:30.793178] [INFO ] [REMOTE ] DK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:05:30.857826] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-09-15T18:05:31.430783] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-15T18:05:31.657869] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-09-15T18:05:31.850351] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-15T18:05:32.457901] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-09-15T18:05:33.257871] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-09-15T18:05:33.553570] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-15T18:05:33.631905] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-15T18:05:34.057923] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-09-15T18:05:34.375699] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-15T18:05:34.857871] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-09-15T18:05:35.657850] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-09-15T18:05:35.891544] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-15T18:05:35.897366] [INFO ] [REMOTE ] DINO: Full fetch complete (57626 records). [2025-09-15T18:05:35.897462] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-09-15T18:05:36.122902] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-15T18:05:36.281133] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-09-15T18:05:36.281208] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-09-15T18:05:36.281920] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-09-15T18:05:36.281964] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-09-15T18:05:36.283137] [DEBUG] [LOCAL ] DINO: Trimmed 57626 records to 39092 (keeping 150 days of data) [2025-09-15T18:05:36.470985] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-09-15T18:05:36.531851] [DEBUG] [LOCAL ] DINO: Primary data saved (39092 records). [2025-09-15T18:05:36.531966] [INFO ] [MAIN ] DINO: Full history saved. [2025-09-15T18:05:36.533385] [INFO ] [MAIN ] Update Progress: 622/2369 symbols completed. DINO took 27.7s. Estimated remaining: 3h 4m 7s. Rate: 9.5 symbols/min [2025-09-15T18:05:36.703912] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:05:36.732065] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-15T18:05:36.753749] [DEBUG] [LOCAL ] DKL: Loaded 13168 existing records from primary storage. [2025-09-15T18:05:36.755871] [INFO ] [MAIN ] DKL: Loaded 13168 existing records. [2025-09-15T18:05:36.755980] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-15T18:05:36.928634] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:05:36.928872] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-09-15T18:05:36.928925] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-09-15T18:05:36.929328] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-09-15T18:05:36.929390] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-09-15T18:05:37.268738] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-09-15T18:05:37.273599] [INFO ] [REMOTE ] DKL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:05:37.545296] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-15T18:05:38.057898] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-09-15T18:05:38.857871] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-09-15T18:05:39.364044] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-15T18:05:39.657888] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-09-15T18:05:40.341295] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T18:05:40.457862] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-09-15T18:05:40.995587] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T18:05:41.257884] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-09-15T18:05:42.031806] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T18:05:42.057816] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-09-15T18:05:42.857892] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-09-15T18:05:43.495571] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T18:05:43.615523] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-15T18:05:43.657811] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-09-15T18:05:43.816851] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-15T18:05:44.457869] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-09-15T18:05:44.788889] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-15T18:05:45.257876] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-09-15T18:05:45.665002] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-15T18:05:45.665741] [INFO ] [REMOTE ] DIVY: Full fetch complete (1278 records). [2025-09-15T18:05:45.665811] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-09-15T18:05:45.850332] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-15T18:05:45.850616] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:05:45.850756] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:05:45.850833] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-15T18:05:45.850937] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-15T18:05:45.850979] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-09-15T18:05:45.851031] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-09-15T18:05:45.851152] [INFO ] [MAIN ] Update Progress: 623/2369 symbols completed. DIVY took 22.8s. Estimated remaining: 3h 4m 9s. Rate: 9.5 symbols/min [2025-09-15T18:05:46.030947] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:05:46.047938] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-15T18:05:46.054714] [INFO ] [REMOTE ] DIS: Full fetch complete (58468 records). [2025-09-15T18:05:46.054990] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-09-15T18:05:46.067354] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-09-15T18:05:46.339421] [DEBUG] [LOCAL ] DKS: Loaded 37372 existing records from primary storage. [2025-09-15T18:05:46.378972] [INFO ] [MAIN ] DKS: Loaded 37372 existing records. [2025-09-15T18:05:46.666819] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-09-15T18:05:46.683109] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-09-15T18:05:46.687056] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-09-15T18:05:46.687124] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-09-15T18:05:46.687233] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:05:46.687824] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-09-15T18:05:46.688136] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-09-15T18:05:46.688758] [DEBUG] [LOCAL ] DIS: Trimmed 58468 records to 39748 (keeping 150 days of data) [2025-09-15T18:05:46.689192] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-09-15T18:05:46.689512] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-09-15T18:05:46.860617] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-09-15T18:05:47.172019] [INFO ] [REMOTE ] DKS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:05:47.309954] [DEBUG] [LOCAL ] DIS: Primary data saved (39748 records). [2025-09-15T18:05:47.310089] [INFO ] [MAIN ] DIS: Full history saved. [2025-09-15T18:05:47.311186] [INFO ] [MAIN ] Update Progress: 624/2369 symbols completed. DIS took 32.4s. Estimated remaining: 3h 3m 49s. Rate: 9.5 symbols/min [2025-09-15T18:05:47.488840] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:05:47.514882] [DEBUG] [LOCAL ] DLB: Loaded 23969 existing records from primary storage. [2025-09-15T18:05:47.515041] [INFO ] [MAIN ] DLB: Loaded 23969 existing records. [2025-09-15T18:05:47.659782] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-09-15T18:05:47.727349] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:05:47.727896] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-09-15T18:05:47.727978] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-09-15T18:05:47.745027] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-09-15T18:05:47.759470] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-09-15T18:05:47.784422] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-15T18:05:47.920174] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-15T18:05:48.150380] [INFO ] [REMOTE ] DLB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:05:48.457909] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-09-15T18:05:49.257912] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-09-15T18:05:49.359394] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T18:05:49.956876] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-15T18:05:49.990848] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-15T18:05:50.057920] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-09-15T18:05:50.857886] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-09-15T18:05:51.026064] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-15T18:05:51.657891] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-09-15T18:05:52.457944] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-09-15T18:05:52.528789] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-15T18:05:52.534972] [INFO ] [REMOTE ] DK: Full fetch complete (53730 records). [2025-09-15T18:05:52.535142] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-09-15T18:05:52.908212] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-09-15T18:05:52.908292] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-09-15T18:05:52.908987] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-09-15T18:05:52.909031] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-09-15T18:05:52.910093] [DEBUG] [LOCAL ] DK: Trimmed 53730 records to 36616 (keeping 150 days of data) [2025-09-15T18:05:53.140321] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-15T18:05:53.156214] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-15T18:05:53.182332] [DEBUG] [LOCAL ] DK: Primary data saved (36616 records). [2025-09-15T18:05:53.182460] [INFO ] [MAIN ] DK: Full history saved. [2025-09-15T18:05:53.182539] [INFO ] [MAIN ] Update Progress: 625/2369 symbols completed. DK took 23.1s. Estimated remaining: 3h 3m 42s. Rate: 9.5 symbols/min [2025-09-15T18:05:53.262986] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-09-15T18:05:53.353346] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:05:53.358980] [DEBUG] [LOCAL ] DLNG: Loaded 4441 existing records from primary storage. [2025-09-15T18:05:53.359062] [INFO ] [MAIN ] DLNG: Loaded 4441 existing records. [2025-09-15T18:05:53.533759] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:05:53.534014] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-09-15T18:05:53.534064] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-09-15T18:05:53.534354] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-09-15T18:05:53.534399] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-09-15T18:05:53.898393] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:05:54.057858] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-09-15T18:05:54.857910] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-09-15T18:05:55.040361] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-15T18:05:55.411802] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T18:05:55.657910] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-09-15T18:05:55.831384] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-15T18:05:56.301475] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-15T18:05:56.457864] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-09-15T18:05:57.257919] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-09-15T18:05:57.258309] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-15T18:05:57.261810] [INFO ] [REMOTE ] DKL: Full fetch complete (22139 records). [2025-09-15T18:05:57.261901] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-09-15T18:05:57.635532] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-09-15T18:05:57.635668] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-09-15T18:05:57.636121] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-09-15T18:05:57.636164] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-09-15T18:05:57.636815] [DEBUG] [LOCAL ] DKL: Trimmed 22139 records to 12610 (keeping 150 days of data) [2025-09-15T18:05:57.715334] [DEBUG] [LOCAL ] DKL: Primary data saved (12610 records). [2025-09-15T18:05:57.715482] [INFO ] [MAIN ] DKL: Full history saved. [2025-09-15T18:05:57.715586] [INFO ] [MAIN ] Update Progress: 626/2369 symbols completed. DKL took 21.2s. Estimated remaining: 3h 3m 30s. Rate: 9.5 symbols/min [2025-09-15T18:05:57.883468] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:05:57.930468] [DEBUG] [LOCAL ] DLR: Loaded 38217 existing records from primary storage. [2025-09-15T18:05:57.930630] [INFO ] [MAIN ] DLR: Loaded 38217 existing records. [2025-09-15T18:05:58.073248] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-09-15T18:05:58.111859] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:05:58.112071] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-09-15T18:05:58.112144] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-09-15T18:05:58.113175] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-09-15T18:05:58.113248] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-09-15T18:05:58.460676] [INFO ] [REMOTE ] DLR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:05:58.857872] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-09-15T18:05:59.095210] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-15T18:05:59.164830] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-15T18:05:59.234188] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-15T18:05:59.657870] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-09-15T18:06:00.457984] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-09-15T18:06:00.893919] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-15T18:06:01.257921] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-09-15T18:06:02.057931] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-09-15T18:06:02.489734] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-15T18:06:02.771561] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T18:06:02.857848] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-09-15T18:06:03.657865] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-09-15T18:06:03.707994] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T18:06:04.457872] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-09-15T18:06:04.988584] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-15T18:06:05.046347] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-15T18:06:05.257920] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-09-15T18:06:05.858708] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-15T18:06:06.057907] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-09-15T18:06:06.857864] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-09-15T18:06:06.908982] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-15T18:06:07.594427] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-15T18:06:07.657935] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-09-15T18:06:07.924155] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-15T18:06:08.457896] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-09-15T18:06:09.232416] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T18:06:09.257820] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-09-15T18:06:10.057860] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-09-15T18:06:10.423406] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-15T18:06:10.857882] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-09-15T18:06:11.147291] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-15T18:06:11.228763] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-15T18:06:11.232675] [INFO ] [REMOTE ] DLB: Full fetch complete (35114 records). [2025-09-15T18:06:11.232789] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-09-15T18:06:11.351394] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-15T18:06:11.624309] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-09-15T18:06:11.624409] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-09-15T18:06:11.625024] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-09-15T18:06:11.625067] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-09-15T18:06:11.625976] [DEBUG] [LOCAL ] DLB: Trimmed 35114 records to 23670 (keeping 150 days of data) [2025-09-15T18:06:11.682896] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-09-15T18:06:11.776496] [DEBUG] [LOCAL ] DLB: Primary data saved (23670 records). [2025-09-15T18:06:11.776630] [INFO ] [MAIN ] DLB: Full history saved. [2025-09-15T18:06:11.776748] [INFO ] [MAIN ] Update Progress: 627/2369 symbols completed. DLB took 24.5s. Estimated remaining: 3h 3m 46s. Rate: 9.5 symbols/min [2025-09-15T18:06:11.950130] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:06:11.971987] [DEBUG] [LOCAL ] DLX: Loaded 21803 existing records from primary storage. [2025-09-15T18:06:11.972113] [INFO ] [MAIN ] DLX: Loaded 21803 existing records. [2025-09-15T18:06:12.146015] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:06:12.146262] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-09-15T18:06:12.146308] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-09-15T18:06:12.146911] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-09-15T18:06:12.146963] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-09-15T18:06:12.425937] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-15T18:06:12.467494] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-09-15T18:06:12.506412] [INFO ] [REMOTE ] DLX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:06:13.136340] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-15T18:06:13.137483] [INFO ] [REMOTE ] DLNG: Full fetch complete (7348 records). [2025-09-15T18:06:13.137552] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-09-15T18:06:13.263027] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-09-15T18:06:13.490358] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-09-15T18:06:13.490435] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-09-15T18:06:13.490609] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-09-15T18:06:13.490663] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-09-15T18:06:13.491054] [DEBUG] [LOCAL ] DLNG: Trimmed 7348 records to 4259 (keeping 150 days of data) [2025-09-15T18:06:13.515802] [DEBUG] [LOCAL ] DLNG: Primary data saved (4259 records). [2025-09-15T18:06:13.515878] [INFO ] [MAIN ] DLNG: Full history saved. [2025-09-15T18:06:13.515959] [INFO ] [MAIN ] Update Progress: 628/2369 symbols completed. DLNG took 20.3s. Estimated remaining: 3h 3m 27s. Rate: 9.5 symbols/min [2025-09-15T18:06:13.682357] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:06:13.696614] [DEBUG] [LOCAL ] DLY: Loaded 13869 existing records from primary storage. [2025-09-15T18:06:13.696745] [INFO ] [MAIN ] DLY: Loaded 13869 existing records. [2025-09-15T18:06:13.875604] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:06:13.875896] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-09-15T18:06:13.875943] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-09-15T18:06:13.876457] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-09-15T18:06:13.876506] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-09-15T18:06:14.067690] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-09-15T18:06:14.223098] [INFO ] [REMOTE ] DLY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:06:14.857875] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-09-15T18:06:15.657905] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-09-15T18:06:15.887193] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-09-15T18:06:16.457853] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-09-15T18:06:16.563604] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-09-15T18:06:16.614498] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-15T18:06:16.772190] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-15T18:06:17.257890] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-09-15T18:06:17.900323] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-15T18:06:18.057933] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-09-15T18:06:18.446676] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-15T18:06:18.452230] [INFO ] [REMOTE ] DKS: Full fetch complete (54213 records). [2025-09-15T18:06:18.452339] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-09-15T18:06:18.831183] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-09-15T18:06:18.831278] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-09-15T18:06:18.831989] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-09-15T18:06:18.832036] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-09-15T18:06:18.833246] [DEBUG] [LOCAL ] DKS: Trimmed 54213 records to 36782 (keeping 150 days of data) [2025-09-15T18:06:18.895067] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-09-15T18:06:19.080452] [DEBUG] [LOCAL ] DKS: Primary data saved (36782 records). [2025-09-15T18:06:19.080615] [INFO ] [MAIN ] DKS: Full history saved. [2025-09-15T18:06:19.081521] [INFO ] [MAIN ] Update Progress: 629/2369 symbols completed. DKS took 33.2s. Estimated remaining: 3h 3m 18s. Rate: 9.5 symbols/min [2025-09-15T18:06:19.254230] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:06:19.260432] [DEBUG] [LOCAL ] DMA: Loaded 3632 existing records from primary storage. [2025-09-15T18:06:19.260555] [INFO ] [MAIN ] DMA: Loaded 3632 existing records. [2025-09-15T18:06:19.438105] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:06:19.438371] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-09-15T18:06:19.438416] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-09-15T18:06:19.438633] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-09-15T18:06:19.438709] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-09-15T18:06:19.664164] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-09-15T18:06:19.831831] [INFO ] [REMOTE ] DMA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:06:19.871503] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-15T18:06:20.127542] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-15T18:06:20.457909] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-09-15T18:06:20.646925] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-15T18:06:21.146153] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-15T18:06:21.257934] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-09-15T18:06:22.057965] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-09-15T18:06:22.532818] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-15T18:06:22.575834] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-15T18:06:22.857879] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-09-15T18:06:23.657936] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-09-15T18:06:23.723794] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-15T18:06:24.457895] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-09-15T18:06:24.704278] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-15T18:06:25.257870] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-09-15T18:06:25.763706] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-15T18:06:26.007543] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T18:06:26.057913] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-09-15T18:06:26.857906] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-09-15T18:06:27.284267] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T18:06:27.657865] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-09-15T18:06:28.284373] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T18:06:28.290112] [INFO ] [REMOTE ] DLR: Full fetch complete (55861 records). [2025-09-15T18:06:28.290258] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-09-15T18:06:28.469744] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-09-15T18:06:28.680214] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-09-15T18:06:28.680305] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-09-15T18:06:28.681024] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-09-15T18:06:28.681080] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-09-15T18:06:28.682389] [DEBUG] [LOCAL ] DLR: Trimmed 55861 records to 37449 (keeping 150 days of data) [2025-09-15T18:06:28.821835] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-15T18:06:28.930244] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-15T18:06:28.960627] [DEBUG] [LOCAL ] DLR: Primary data saved (37449 records). [2025-09-15T18:06:28.960794] [INFO ] [MAIN ] DLR: Full history saved. [2025-09-15T18:06:28.961972] [INFO ] [MAIN ] Update Progress: 630/2369 symbols completed. DLR took 31.2s. Estimated remaining: 3h 3m 22s. Rate: 9.5 symbols/min [2025-09-15T18:06:29.139838] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:06:29.151226] [DEBUG] [LOCAL ] DMB: Loaded 8087 existing records from primary storage. [2025-09-15T18:06:29.151369] [INFO ] [MAIN ] DMB: Loaded 8087 existing records. [2025-09-15T18:06:29.263029] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-09-15T18:06:29.331164] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:06:29.331450] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-09-15T18:06:29.331498] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-09-15T18:06:29.331903] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-09-15T18:06:29.331954] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-09-15T18:06:29.686058] [INFO ] [REMOTE ] DMB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:06:30.057868] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-09-15T18:06:30.293739] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-15T18:06:30.514254] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-15T18:06:30.857878] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-09-15T18:06:31.561686] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T18:06:31.564490] [INFO ] [REMOTE ] DLY: Full fetch complete (20213 records). [2025-09-15T18:06:31.564566] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-09-15T18:06:31.565087] [FATAL] [VALIDATOR ] DLY: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:06:31.565172] [FATAL] [MAIN ] DLY: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:06:31.565208] [WARN ] [MAIN ] DLY: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:06:31.565245] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-09-15T18:06:31.565301] [DEBUG] [LOCAL ] DLY: No primary data file found to delete. [2025-09-15T18:06:31.565420] [INFO ] [LOCAL ] DLY: Starting deletion of derivative data. [2025-09-15T18:06:31.565804] [DEBUG] [LOCAL ] DLY: Deleted derivative data file. [2025-09-15T18:06:31.565897] [INFO ] [MAIN ] Update Progress: 631/2369 symbols completed. DLY took 18.0s. Estimated remaining: 3h 3m 5s. Rate: 9.5 symbols/min [2025-09-15T18:06:31.663517] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-09-15T18:06:31.739727] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:06:31.748175] [DEBUG] [LOCAL ] DMO: Loaded 7071 existing records from primary storage. [2025-09-15T18:06:31.748258] [INFO ] [MAIN ] DMO: Loaded 7071 existing records. [2025-09-15T18:06:31.923010] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:06:31.923227] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-09-15T18:06:31.923280] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-09-15T18:06:31.923673] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-09-15T18:06:31.923723] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-09-15T18:06:32.279005] [INFO ] [REMOTE ] DMO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:06:32.457882] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-09-15T18:06:32.504252] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-15T18:06:33.204076] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-15T18:06:33.257885] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-09-15T18:06:34.058062] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-09-15T18:06:34.059892] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-15T18:06:34.579613] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-15T18:06:34.857892] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-09-15T18:06:35.657869] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-09-15T18:06:35.904350] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-15T18:06:36.457869] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-09-15T18:06:36.463726] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T18:06:36.465008] [INFO ] [REMOTE ] DMA: Full fetch complete (5026 records). [2025-09-15T18:06:36.465080] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-09-15T18:06:36.829981] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-09-15T18:06:36.830068] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-09-15T18:06:36.830240] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-09-15T18:06:36.830283] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-09-15T18:06:36.830692] [DEBUG] [LOCAL ] DMA: Trimmed 5026 records to 3612 (keeping 150 days of data) [2025-09-15T18:06:36.854592] [DEBUG] [LOCAL ] DMA: Primary data saved (3612 records). [2025-09-15T18:06:36.854766] [INFO ] [MAIN ] DMA: Full history saved. [2025-09-15T18:06:36.854873] [INFO ] [MAIN ] Update Progress: 632/2369 symbols completed. DMA took 17.8s. Estimated remaining: 3h 2m 56s. Rate: 9.5 symbols/min [2025-09-15T18:06:37.033437] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:06:37.076589] [DEBUG] [LOCAL ] DNA: Loaded 36266 existing records from primary storage. [2025-09-15T18:06:37.076763] [INFO ] [MAIN ] DNA: Loaded 36266 existing records. [2025-09-15T18:06:37.250046] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:06:37.250321] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-09-15T18:06:37.250366] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-09-15T18:06:37.251081] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-09-15T18:06:37.251137] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-09-15T18:06:37.263748] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-09-15T18:06:37.604425] [INFO ] [REMOTE ] DNA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:06:37.817305] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-15T18:06:37.852965] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-15T18:06:38.057856] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-09-15T18:06:38.546725] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-15T18:06:38.857921] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-09-15T18:06:39.578876] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-15T18:06:39.657832] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-09-15T18:06:40.453309] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-15T18:06:40.457802] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-09-15T18:06:41.150810] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-15T18:06:41.257867] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-09-15T18:06:41.738266] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-15T18:06:42.057902] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-09-15T18:06:42.857882] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-09-15T18:06:42.924045] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-15T18:06:43.359692] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-15T18:06:43.657926] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-09-15T18:06:44.457838] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-09-15T18:06:44.769316] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-15T18:06:44.772523] [INFO ] [REMOTE ] DLX: Full fetch complete (32410 records). [2025-09-15T18:06:44.772632] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-09-15T18:06:45.165689] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-09-15T18:06:45.165769] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-09-15T18:06:45.166294] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-09-15T18:06:45.166333] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-09-15T18:06:45.167061] [DEBUG] [LOCAL ] DLX: Trimmed 32410 records to 21432 (keeping 150 days of data) [2025-09-15T18:06:45.258870] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-09-15T18:06:45.290850] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-15T18:06:45.312693] [DEBUG] [LOCAL ] DLX: Primary data saved (21432 records). [2025-09-15T18:06:45.312795] [INFO ] [MAIN ] DLX: Full history saved. [2025-09-15T18:06:45.312869] [INFO ] [MAIN ] Update Progress: 633/2369 symbols completed. DLX took 33.5s. Estimated remaining: 3h 2m 55s. Rate: 9.5 symbols/min [2025-09-15T18:06:45.481481] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:06:45.513497] [DEBUG] [LOCAL ] DNOW: Loaded 32346 existing records from primary storage. [2025-09-15T18:06:45.513631] [INFO ] [MAIN ] DNOW: Loaded 32346 existing records. [2025-09-15T18:06:45.688513] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:06:45.688750] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-09-15T18:06:45.688795] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-09-15T18:06:45.689445] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-09-15T18:06:45.689493] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-09-15T18:06:46.038906] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:06:46.045266] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-15T18:06:46.057807] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-09-15T18:06:46.787296] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-15T18:06:46.857878] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-09-15T18:06:47.651567] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-15T18:06:47.657810] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-09-15T18:06:48.409376] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-15T18:06:48.457841] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-09-15T18:06:49.155288] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T18:06:49.157281] [INFO ] [REMOTE ] DMB: Full fetch complete (10777 records). [2025-09-15T18:06:49.157364] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-09-15T18:06:49.262943] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-09-15T18:06:49.521810] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-09-15T18:06:49.521896] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-09-15T18:06:49.522171] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-09-15T18:06:49.522245] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-09-15T18:06:49.522806] [DEBUG] [LOCAL ] DMB: Trimmed 10777 records to 7871 (keeping 150 days of data) [2025-09-15T18:06:49.571910] [DEBUG] [LOCAL ] DMB: Primary data saved (7871 records). [2025-09-15T18:06:49.572045] [INFO ] [MAIN ] DMB: Full history saved. [2025-09-15T18:06:49.572130] [INFO ] [MAIN ] Update Progress: 634/2369 symbols completed. DMB took 20.6s. Estimated remaining: 3h 2m 43s. Rate: 9.5 symbols/min [2025-09-15T18:06:49.741038] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:06:49.765908] [DEBUG] [LOCAL ] DNP: Loaded 24884 existing records from primary storage. [2025-09-15T18:06:49.766052] [INFO ] [MAIN ] DNP: Loaded 24884 existing records. [2025-09-15T18:06:49.948275] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:06:49.948569] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-09-15T18:06:49.948618] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-09-15T18:06:49.949281] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-09-15T18:06:49.949333] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-09-15T18:06:50.062960] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-09-15T18:06:50.304819] [INFO ] [REMOTE ] DNP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:06:50.857873] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-09-15T18:06:51.265654] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-15T18:06:51.338969] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T18:06:51.387546] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-15T18:06:51.389414] [INFO ] [REMOTE ] DMO: Full fetch complete (10445 records). [2025-09-15T18:06:51.389502] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-09-15T18:06:51.663025] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-09-15T18:06:51.755628] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-09-15T18:06:51.755726] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-09-15T18:06:51.755991] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-09-15T18:06:51.756030] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-09-15T18:06:51.756511] [DEBUG] [LOCAL ] DMO: Trimmed 10445 records to 6850 (keeping 150 days of data) [2025-09-15T18:06:51.800561] [DEBUG] [LOCAL ] DMO: Primary data saved (6850 records). [2025-09-15T18:06:51.800686] [INFO ] [MAIN ] DMO: Full history saved. [2025-09-15T18:06:51.800789] [INFO ] [MAIN ] Update Progress: 635/2369 symbols completed. DMO took 20.2s. Estimated remaining: 3h 2m 26s. Rate: 9.5 symbols/min [2025-09-15T18:06:51.985113] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:06:52.028624] [DEBUG] [LOCAL ] DOC: Loaded 40314 existing records from primary storage. [2025-09-15T18:06:52.028788] [INFO ] [MAIN ] DOC: Loaded 40314 existing records. [2025-09-15T18:06:52.206095] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:06:52.206353] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-09-15T18:06:52.206399] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-09-15T18:06:52.207269] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-09-15T18:06:52.207322] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-09-15T18:06:52.463034] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-09-15T18:06:52.573880] [INFO ] [REMOTE ] DOC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:06:53.052408] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-15T18:06:53.257929] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-09-15T18:06:53.935348] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T18:06:54.057850] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-09-15T18:06:54.729632] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T18:06:54.857872] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-09-15T18:06:55.578157] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-15T18:06:55.657820] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-09-15T18:06:56.453727] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T18:06:56.463123] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-09-15T18:06:56.980892] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T18:06:57.257882] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-09-15T18:06:57.959748] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T18:06:58.057827] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-09-15T18:06:58.857860] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-09-15T18:06:58.939887] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-15T18:06:59.394301] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-15T18:06:59.657884] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-09-15T18:06:59.832986] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-15T18:07:00.458065] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-09-15T18:07:01.257965] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-09-15T18:07:01.441857] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-15T18:07:01.732866] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-15T18:07:02.057911] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-09-15T18:07:02.857917] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-09-15T18:07:03.178717] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-15T18:07:03.657834] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-09-15T18:07:03.695321] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-15T18:07:04.206234] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T18:07:04.457917] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-09-15T18:07:05.257895] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-09-15T18:07:05.506699] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-15T18:07:05.544241] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-15T18:07:06.057873] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-09-15T18:07:06.857882] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-09-15T18:07:07.286190] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-15T18:07:07.324832] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-15T18:07:07.657918] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-09-15T18:07:08.457894] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-09-15T18:07:08.490718] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T18:07:08.960626] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-15T18:07:09.257912] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-09-15T18:07:09.531888] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-15T18:07:09.536942] [INFO ] [REMOTE ] DNOW: Full fetch complete (47184 records). [2025-09-15T18:07:09.537052] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-09-15T18:07:09.537741] [FATAL] [VALIDATOR ] DNOW: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:07:09.537823] [FATAL] [MAIN ] DNOW: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:07:09.537870] [WARN ] [MAIN ] DNOW: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:07:09.537912] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-09-15T18:07:09.537996] [DEBUG] [LOCAL ] DNOW: No primary data file found to delete. [2025-09-15T18:07:09.538059] [INFO ] [LOCAL ] DNOW: Starting deletion of derivative data. [2025-09-15T18:07:09.538391] [DEBUG] [LOCAL ] DNOW: Deleted derivative data file. [2025-09-15T18:07:09.538526] [INFO ] [MAIN ] Update Progress: 636/2369 symbols completed. DNOW took 24.2s. Estimated remaining: 3h 2m 51s. Rate: 9.5 symbols/min [2025-09-15T18:07:09.706892] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:07:09.751601] [DEBUG] [LOCAL ] DOCN: Loaded 38164 existing records from primary storage. [2025-09-15T18:07:09.751768] [INFO ] [MAIN ] DOCN: Loaded 38164 existing records. [2025-09-15T18:07:09.929134] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:07:09.929454] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-09-15T18:07:09.929532] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-09-15T18:07:09.930328] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-09-15T18:07:09.930383] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-09-15T18:07:10.068416] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-09-15T18:07:10.280093] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:07:10.541673] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-15T18:07:10.857831] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-09-15T18:07:11.248337] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-15T18:07:11.657937] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-09-15T18:07:12.457860] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-09-15T18:07:12.724351] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-15T18:07:13.267078] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-09-15T18:07:13.268913] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-15T18:07:13.274353] [INFO ] [REMOTE ] DNA: Full fetch complete (53163 records). [2025-09-15T18:07:13.274439] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-09-15T18:07:13.670739] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-09-15T18:07:13.670955] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-09-15T18:07:13.672103] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-09-15T18:07:13.672179] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-09-15T18:07:13.673936] [DEBUG] [LOCAL ] DNA: Trimmed 53163 records to 35541 (keeping 150 days of data) [2025-09-15T18:07:13.801514] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-15T18:07:13.948431] [DEBUG] [LOCAL ] DNA: Primary data saved (35541 records). [2025-09-15T18:07:13.948684] [INFO ] [MAIN ] DNA: Full history saved. [2025-09-15T18:07:13.949398] [INFO ] [MAIN ] Update Progress: 637/2369 symbols completed. DNA took 37.1s. Estimated remaining: 3h 2m 39s. Rate: 9.5 symbols/min [2025-09-15T18:07:14.057908] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-09-15T18:07:14.527809] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T18:07:14.531930] [INFO ] [REMOTE ] DNP: Full fetch complete (36436 records). [2025-09-15T18:07:14.532031] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-09-15T18:07:14.865392] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-09-15T18:07:14.913472] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-09-15T18:07:14.913568] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-09-15T18:07:14.914178] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-09-15T18:07:14.914234] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-09-15T18:07:14.915465] [DEBUG] [LOCAL ] DNP: Trimmed 36436 records to 24357 (keeping 150 days of data) [2025-09-15T18:07:15.080608] [DEBUG] [LOCAL ] DNP: Primary data saved (24357 records). [2025-09-15T18:07:15.080800] [INFO ] [MAIN ] DNP: Full history saved. [2025-09-15T18:07:15.080910] [INFO ] [MAIN ] Update Progress: 638/2369 symbols completed. DNP took 25.5s. Estimated remaining: 3h 2m 19s. Rate: 9.5 symbols/min [2025-09-15T18:07:16.244430] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-15T18:07:16.256108] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-09-15T18:07:16.419168] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T18:07:16.457861] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-09-15T18:07:17.646842] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-15T18:07:17.659051] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-09-15T18:07:17.722609] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-15T18:07:18.057983] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-09-15T18:07:18.851614] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-15T18:07:18.857976] [INFO ] [REMOTE ] DOC: Full fetch complete (58180 records). [2025-09-15T18:07:18.858160] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-09-15T18:07:19.249731] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-09-15T18:07:19.249917] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-09-15T18:07:19.250719] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-09-15T18:07:19.250788] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-09-15T18:07:19.252131] [DEBUG] [LOCAL ] DOC: Trimmed 58180 records to 39535 (keeping 150 days of data) [2025-09-15T18:07:19.502889] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-15T18:07:19.519283] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-09-15T18:07:19.547360] [DEBUG] [LOCAL ] DOC: Primary data saved (39535 records). [2025-09-15T18:07:19.547492] [INFO ] [MAIN ] DOC: Full history saved. [2025-09-15T18:07:19.547576] [INFO ] [MAIN ] Update Progress: 639/2369 symbols completed. DOC took 27.7s. Estimated remaining: 3h 2m 7s. Rate: 9.5 symbols/min [2025-09-15T18:07:21.118844] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-15T18:07:21.134077] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-09-15T18:07:22.510605] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-15T18:07:22.521690] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-09-15T18:07:24.419030] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-15T18:07:24.430094] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-09-15T18:07:26.039350] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-15T18:07:26.050356] [INFO ] [REMOTE ] DOCN: Full fetch complete (54683 records). [2025-09-15T18:07:26.050525] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-09-15T18:07:26.448812] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-09-15T18:07:26.448913] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-09-15T18:07:26.449622] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-09-15T18:07:26.449687] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-09-15T18:07:26.451017] [DEBUG] [LOCAL ] DOCN: Trimmed 54683 records to 37526 (keeping 150 days of data) [2025-09-15T18:07:26.686587] [DEBUG] [LOCAL ] DOCN: Primary data saved (37526 records). [2025-09-15T18:07:26.686756] [INFO ] [MAIN ] DOCN: Full history saved. [2025-09-15T18:07:26.687376] [INFO ] [MAIN ] Update Progress: 640/2369 symbols completed. DOCN took 17.1s. Estimated remaining: 3h 2m 3s. Rate: 9.5 symbols/min [2025-09-15T18:07:27.327786] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:07:27.359400] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:07:27.365005] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:07:27.399110] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:07:27.466279] [DEBUG] [LOCAL ] DOUG: Loaded 26246 existing records from primary storage. [2025-09-15T18:07:27.477910] [INFO ] [MAIN ] DOUG: Loaded 26246 existing records. [2025-09-15T18:07:27.501690] [DEBUG] [LOCAL ] DOLE: Loaded 28724 existing records from primary storage. [2025-09-15T18:07:27.520693] [DEBUG] [LOCAL ] DOV: Loaded 33991 existing records from primary storage. [2025-09-15T18:07:27.536934] [DEBUG] [LOCAL ] DOCS: Loaded 38355 existing records from primary storage. [2025-09-15T18:07:27.536267] [INFO ] [MAIN ] DOV: Loaded 33991 existing records. [2025-09-15T18:07:27.536331] [INFO ] [MAIN ] DOLE: Loaded 28724 existing records. [2025-09-15T18:07:27.560385] [INFO ] [MAIN ] DOCS: Loaded 38355 existing records. [2025-09-15T18:07:28.116137] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:07:28.214569] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:07:28.251732] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-09-15T18:07:28.247994] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:07:28.255925] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-09-15T18:07:28.255625] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:07:28.256324] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-09-15T18:07:28.256021] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-09-15T18:07:28.256504] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-09-15T18:07:28.256660] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-09-15T18:07:28.256566] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-09-15T18:07:28.256853] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-09-15T18:07:28.257397] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-09-15T18:07:28.257451] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-09-15T18:07:28.262788] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-09-15T18:07:28.262908] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-09-15T18:07:28.292841] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-09-15T18:07:28.262855] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-09-15T18:07:28.292940] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-09-15T18:07:28.322267] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-09-15T18:07:29.557061] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:07:29.513724] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:07:29.598617] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-09-15T18:07:29.614368] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-09-15T18:07:29.679886] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:07:29.705954] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-09-15T18:07:29.710742] [INFO ] [REMOTE ] DOV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:07:29.711799] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-09-15T18:07:30.744522] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-15T18:07:30.750833] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-09-15T18:07:31.037241] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-15T18:07:31.044217] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-09-15T18:07:31.258291] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-15T18:07:31.266597] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-09-15T18:07:31.399963] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-15T18:07:31.409908] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-09-15T18:07:31.644159] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-15T18:07:31.652990] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-09-15T18:07:32.268834] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T18:07:32.279421] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-09-15T18:07:32.610751] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T18:07:32.621189] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-09-15T18:07:32.700627] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-15T18:07:32.711676] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-09-15T18:07:32.797513] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-15T18:07:32.805817] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-09-15T18:07:33.491991] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-15T18:07:33.499389] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-09-15T18:07:33.981820] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-15T18:07:33.990750] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-09-15T18:07:34.021678] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T18:07:34.058180] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-09-15T18:07:34.063484] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T18:07:34.614188] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T18:07:34.857914] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-09-15T18:07:35.180855] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-15T18:07:35.211346] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-15T18:07:35.657870] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-09-15T18:07:36.457895] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-09-15T18:07:36.640839] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-15T18:07:36.741462] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-15T18:07:37.257846] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-09-15T18:07:37.366474] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-15T18:07:38.057821] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-09-15T18:07:38.237414] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-15T18:07:38.857883] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-09-15T18:07:39.400734] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-15T18:07:39.657883] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-09-15T18:07:40.457867] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-09-15T18:07:40.555167] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-15T18:07:41.236268] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-15T18:07:41.257815] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-09-15T18:07:41.568013] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-15T18:07:41.573333] [INFO ] [REMOTE ] DOLE: Full fetch complete (40473 records). [2025-09-15T18:07:41.573439] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-09-15T18:07:41.945758] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-09-15T18:07:41.945843] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-09-15T18:07:41.946469] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-09-15T18:07:41.946509] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-09-15T18:07:41.947463] [DEBUG] [LOCAL ] DOLE: Trimmed 40473 records to 28240 (keeping 150 days of data) [2025-09-15T18:07:42.061184] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-09-15T18:07:42.119471] [DEBUG] [LOCAL ] DOLE: Primary data saved (28240 records). [2025-09-15T18:07:42.119781] [INFO ] [MAIN ] DOLE: Full history saved. [2025-09-15T18:07:42.119872] [INFO ] [MAIN ] Update Progress: 641/2369 symbols completed. DOLE took 15.4s. Estimated remaining: 3h 2m 22s. Rate: 9.5 symbols/min [2025-09-15T18:07:42.290206] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:07:42.328619] [DEBUG] [LOCAL ] DOW: Loaded 40473 existing records from primary storage. [2025-09-15T18:07:42.328800] [INFO ] [MAIN ] DOW: Loaded 40473 existing records. [2025-09-15T18:07:42.515443] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:07:42.515741] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-09-15T18:07:42.515789] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-09-15T18:07:42.516823] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-09-15T18:07:42.516881] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-09-15T18:07:42.867846] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-09-15T18:07:42.906398] [INFO ] [REMOTE ] DOW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:07:43.112592] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-15T18:07:43.485099] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T18:07:43.657870] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-09-15T18:07:44.457901] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-09-15T18:07:44.580790] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-15T18:07:44.945372] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T18:07:45.257937] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-09-15T18:07:45.947788] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-15T18:07:45.952376] [INFO ] [REMOTE ] DOV: Full fetch complete (49278 records). [2025-09-15T18:07:45.952469] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-09-15T18:07:45.953123] [FATAL] [VALIDATOR ] DOV: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:07:45.953206] [FATAL] [MAIN ] DOV: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:07:45.953253] [WARN ] [MAIN ] DOV: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:07:45.953316] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-09-15T18:07:45.953385] [DEBUG] [LOCAL ] DOV: No primary data file found to delete. [2025-09-15T18:07:45.953424] [INFO ] [LOCAL ] DOV: Starting deletion of derivative data. [2025-09-15T18:07:45.953796] [DEBUG] [LOCAL ] DOV: Deleted derivative data file. [2025-09-15T18:07:45.953882] [INFO ] [MAIN ] Update Progress: 642/2369 symbols completed. DOV took 19.3s. Estimated remaining: 3h 2m 9s. Rate: 9.5 symbols/min [2025-09-15T18:07:46.063021] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-09-15T18:07:46.128097] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:07:46.138757] [DEBUG] [LOCAL ] DPG: Loaded 9966 existing records from primary storage. [2025-09-15T18:07:46.138869] [INFO ] [MAIN ] DPG: Loaded 9966 existing records. [2025-09-15T18:07:46.319909] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:07:46.320165] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-09-15T18:07:46.320211] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-09-15T18:07:46.320545] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-09-15T18:07:46.320591] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-09-15T18:07:46.675612] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-15T18:07:46.678883] [INFO ] [REMOTE ] DPG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:07:46.682759] [INFO ] [REMOTE ] DOUG: Full fetch complete (37985 records). [2025-09-15T18:07:46.682834] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-09-15T18:07:46.858260] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-09-15T18:07:47.055026] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-09-15T18:07:47.055123] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-09-15T18:07:47.055824] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-09-15T18:07:47.055879] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-09-15T18:07:47.057274] [DEBUG] [LOCAL ] DOUG: Trimmed 37985 records to 25700 (keeping 150 days of data) [2025-09-15T18:07:47.207340] [DEBUG] [LOCAL ] DOUG: Primary data saved (25700 records). [2025-09-15T18:07:47.207508] [INFO ] [MAIN ] DOUG: Full history saved. [2025-09-15T18:07:47.207606] [INFO ] [MAIN ] Update Progress: 643/2369 symbols completed. DOUG took 20.5s. Estimated remaining: 3h 1m 49s. Rate: 9.5 symbols/min [2025-09-15T18:07:47.381853] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:07:47.414728] [DEBUG] [LOCAL ] DQ: Loaded 31915 existing records from primary storage. [2025-09-15T18:07:47.414899] [INFO ] [MAIN ] DQ: Loaded 31915 existing records. [2025-09-15T18:07:47.598599] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:07:47.598968] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-09-15T18:07:47.599122] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-09-15T18:07:47.600005] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-09-15T18:07:47.600066] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-09-15T18:07:47.658896] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-09-15T18:07:47.832627] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-15T18:07:48.036577] [INFO ] [REMOTE ] DQ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:07:48.043967] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T18:07:48.457867] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-09-15T18:07:49.175393] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-15T18:07:49.257867] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-09-15T18:07:49.856520] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T18:07:50.057876] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-09-15T18:07:50.831455] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-15T18:07:50.857826] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-09-15T18:07:51.087316] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-15T18:07:51.478159] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-15T18:07:51.657930] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-09-15T18:07:52.457895] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-09-15T18:07:53.257904] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-09-15T18:07:53.326717] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-15T18:07:53.559530] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-15T18:07:54.057921] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-09-15T18:07:54.327629] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-15T18:07:54.857902] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-09-15T18:07:55.473208] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-15T18:07:55.478481] [INFO ] [REMOTE ] DOCS: Full fetch complete (56115 records). [2025-09-15T18:07:55.478592] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-09-15T18:07:55.663316] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-09-15T18:07:55.852811] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-09-15T18:07:55.852886] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-09-15T18:07:55.853578] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-09-15T18:07:55.853692] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-09-15T18:07:55.854843] [DEBUG] [LOCAL ] DOCS: Trimmed 56115 records to 37582 (keeping 150 days of data) [2025-09-15T18:07:56.082350] [DEBUG] [LOCAL ] DOCS: Primary data saved (37582 records). [2025-09-15T18:07:56.082785] [INFO ] [MAIN ] DOCS: Full history saved. [2025-09-15T18:07:56.082960] [INFO ] [MAIN ] Update Progress: 644/2369 symbols completed. DOCS took 29.4s. Estimated remaining: 3h 1m 49s. Rate: 9.5 symbols/min [2025-09-15T18:07:56.255157] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:07:56.282883] [DEBUG] [LOCAL ] DRD: Loaded 26676 existing records from primary storage. [2025-09-15T18:07:56.283055] [INFO ] [MAIN ] DRD: Loaded 26676 existing records. [2025-09-15T18:07:56.405985] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-15T18:07:56.458392] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-09-15T18:07:56.477765] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:07:56.478003] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-09-15T18:07:56.478061] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-09-15T18:07:56.478960] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-09-15T18:07:56.479017] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-09-15T18:07:56.802555] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-15T18:07:56.886056] [INFO ] [REMOTE ] DRD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:07:57.257921] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-09-15T18:07:57.971495] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-15T18:07:58.057915] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-09-15T18:07:58.373094] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-15T18:07:58.857897] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-09-15T18:07:59.057849] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-15T18:07:59.657924] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-09-15T18:08:00.213071] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T18:08:00.428633] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-15T18:08:00.457878] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-09-15T18:08:01.257880] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-09-15T18:08:01.693719] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-15T18:08:02.057911] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-09-15T18:08:02.076680] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-15T18:08:02.857912] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-09-15T18:08:03.067185] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-15T18:08:03.657922] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-09-15T18:08:03.779812] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-15T18:08:04.457875] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-09-15T18:08:05.257851] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-09-15T18:08:05.662751] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-15T18:08:05.938832] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T18:08:06.057899] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-09-15T18:08:06.207042] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-15T18:08:06.857880] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-09-15T18:08:07.657897] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-09-15T18:08:08.033727] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-15T18:08:08.340329] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-15T18:08:08.460022] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-09-15T18:08:08.460857] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-15T18:08:08.463608] [INFO ] [REMOTE ] DPG: Full fetch complete (14319 records). [2025-09-15T18:08:08.463705] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-09-15T18:08:08.838856] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-09-15T18:08:08.839118] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-09-15T18:08:08.839667] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-09-15T18:08:08.839739] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-09-15T18:08:08.840278] [DEBUG] [LOCAL ] DPG: Trimmed 14319 records to 9724 (keeping 150 days of data) [2025-09-15T18:08:08.902625] [DEBUG] [LOCAL ] DPG: Primary data saved (9724 records). [2025-09-15T18:08:08.902774] [INFO ] [MAIN ] DPG: Full history saved. [2025-09-15T18:08:08.902893] [INFO ] [MAIN ] Update Progress: 645/2369 symbols completed. DPG took 22.9s. Estimated remaining: 3h 2m 0s. Rate: 9.5 symbols/min [2025-09-15T18:08:09.075842] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:08:09.116196] [DEBUG] [LOCAL ] DRH: Loaded 37808 existing records from primary storage. [2025-09-15T18:08:09.116344] [INFO ] [MAIN ] DRH: Loaded 37808 existing records. [2025-09-15T18:08:09.263110] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-09-15T18:08:09.298958] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:08:09.299234] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-09-15T18:08:09.299280] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-09-15T18:08:09.300193] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-09-15T18:08:09.300252] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-09-15T18:08:09.651843] [INFO ] [REMOTE ] DRH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:08:09.842337] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-15T18:08:09.847707] [INFO ] [REMOTE ] DQ: Full fetch complete (47257 records). [2025-09-15T18:08:09.847805] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-09-15T18:08:10.063087] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-09-15T18:08:10.218903] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-09-15T18:08:10.218987] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-09-15T18:08:10.219832] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-09-15T18:08:10.219888] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-09-15T18:08:10.220947] [DEBUG] [LOCAL ] DQ: Trimmed 47257 records to 31306 (keeping 150 days of data) [2025-09-15T18:08:10.405407] [DEBUG] [LOCAL ] DQ: Primary data saved (31306 records). [2025-09-15T18:08:10.405549] [INFO ] [MAIN ] DQ: Full history saved. [2025-09-15T18:08:10.405633] [INFO ] [MAIN ] Update Progress: 646/2369 symbols completed. DQ took 23.2s. Estimated remaining: 3h 1m 41s. Rate: 9.5 symbols/min [2025-09-15T18:08:10.571868] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:08:10.604933] [DEBUG] [LOCAL ] DRI: Loaded 35431 existing records from primary storage. [2025-09-15T18:08:10.605073] [INFO ] [MAIN ] DRI: Loaded 35431 existing records. [2025-09-15T18:08:10.777665] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:08:10.777950] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-09-15T18:08:10.778000] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-09-15T18:08:10.778870] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-09-15T18:08:10.778918] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-09-15T18:08:10.871630] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-09-15T18:08:11.132702] [INFO ] [REMOTE ] DRI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:08:11.433775] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-15T18:08:11.580827] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-15T18:08:11.657816] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-09-15T18:08:12.457915] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-09-15T18:08:12.609097] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-15T18:08:12.978346] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T18:08:13.257946] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-09-15T18:08:14.006594] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-15T18:08:14.016580] [INFO ] [REMOTE ] DOW: Full fetch complete (58411 records). [2025-09-15T18:08:14.016890] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-09-15T18:08:14.063175] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-09-15T18:08:14.445352] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-09-15T18:08:14.445482] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-09-15T18:08:14.446725] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-09-15T18:08:14.446793] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-09-15T18:08:14.448979] [DEBUG] [LOCAL ] DOW: Trimmed 58411 records to 39693 (keeping 150 days of data) [2025-09-15T18:08:14.739702] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-15T18:08:14.767270] [DEBUG] [LOCAL ] DOW: Primary data saved (39693 records). [2025-09-15T18:08:14.767427] [INFO ] [MAIN ] DOW: Full history saved. [2025-09-15T18:08:14.768950] [INFO ] [MAIN ] Update Progress: 647/2369 symbols completed. DOW took 32.6s. Estimated remaining: 3h 1m 29s. Rate: 9.5 symbols/min [2025-09-15T18:08:14.864874] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-09-15T18:08:14.951882] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:08:14.961500] [DEBUG] [LOCAL ] DRLL: Loaded 6601 existing records from primary storage. [2025-09-15T18:08:14.961633] [INFO ] [MAIN ] DRLL: Loaded 6601 existing records. [2025-09-15T18:08:15.141249] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:08:15.141537] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-09-15T18:08:15.141587] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-09-15T18:08:15.141860] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-09-15T18:08:15.141909] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-09-15T18:08:15.507556] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:08:15.634056] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T18:08:15.639146] [INFO ] [REMOTE ] DRD: Full fetch complete (38617 records). [2025-09-15T18:08:15.639232] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-09-15T18:08:15.663030] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-09-15T18:08:16.029583] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-09-15T18:08:16.029693] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-09-15T18:08:16.030335] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-09-15T18:08:16.030379] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-09-15T18:08:16.031315] [DEBUG] [LOCAL ] DRD: Trimmed 38617 records to 26240 (keeping 150 days of data) [2025-09-15T18:08:16.202539] [DEBUG] [LOCAL ] DRD: Primary data saved (26240 records). [2025-09-15T18:08:16.202719] [INFO ] [MAIN ] DRD: Full history saved. [2025-09-15T18:08:16.202836] [INFO ] [MAIN ] Update Progress: 648/2369 symbols completed. DRD took 20.1s. Estimated remaining: 3h 1m 10s. Rate: 9.5 symbols/min [2025-09-15T18:08:16.376907] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:08:16.412970] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-15T18:08:16.430743] [DEBUG] [LOCAL ] DSL: Loaded 20334 existing records from primary storage. [2025-09-15T18:08:16.430893] [INFO ] [MAIN ] DSL: Loaded 20334 existing records. [2025-09-15T18:08:16.462990] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-09-15T18:08:16.629735] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:08:16.629988] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-09-15T18:08:16.630038] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-09-15T18:08:16.630690] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-09-15T18:08:16.630750] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-09-15T18:08:17.015493] [INFO ] [REMOTE ] DSL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:08:17.086417] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-15T18:08:17.257915] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-09-15T18:08:18.059199] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-09-15T18:08:18.064883] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-15T18:08:18.537004] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T18:08:18.857887] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-09-15T18:08:19.405979] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T18:08:19.657880] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-09-15T18:08:20.457898] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-09-15T18:08:20.570126] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-15T18:08:21.215941] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-15T18:08:21.257873] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-09-15T18:08:21.772698] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T18:08:22.057862] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-09-15T18:08:22.786204] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-15T18:08:22.857847] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-09-15T18:08:23.029881] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-15T18:08:23.657884] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-09-15T18:08:23.975764] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-15T18:08:24.457885] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-09-15T18:08:24.497766] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-15T18:08:25.257895] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-09-15T18:08:26.057875] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-09-15T18:08:26.176168] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-15T18:08:26.359995] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-15T18:08:26.365830] [INFO ] [REMOTE ] DRH: Full fetch complete (54470 records). [2025-09-15T18:08:26.365946] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-09-15T18:08:26.746121] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-09-15T18:08:26.746202] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-09-15T18:08:26.746935] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-09-15T18:08:26.746986] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-09-15T18:08:26.748153] [DEBUG] [LOCAL ] DRH: Trimmed 54470 records to 37030 (keeping 150 days of data) [2025-09-15T18:08:26.857965] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-09-15T18:08:26.984854] [DEBUG] [LOCAL ] DRH: Primary data saved (37030 records). [2025-09-15T18:08:26.985036] [INFO ] [MAIN ] DRH: Full history saved. [2025-09-15T18:08:26.986051] [INFO ] [MAIN ] Update Progress: 649/2369 symbols completed. DRH took 18.1s. Estimated remaining: 3h 1m 16s. Rate: 9.5 symbols/min [2025-09-15T18:08:27.158298] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:08:27.176226] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-15T18:08:27.190481] [DEBUG] [LOCAL ] DSM: Loaded 10547 existing records from primary storage. [2025-09-15T18:08:27.190616] [INFO ] [MAIN ] DSM: Loaded 10547 existing records. [2025-09-15T18:08:27.371308] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:08:27.371595] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-09-15T18:08:27.371682] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-09-15T18:08:27.372065] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-09-15T18:08:27.372134] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-09-15T18:08:27.663135] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-09-15T18:08:27.725892] [INFO ] [REMOTE ] DSM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:08:27.734897] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-15T18:08:28.457941] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-09-15T18:08:29.063066] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T18:08:29.257854] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-09-15T18:08:29.666837] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T18:08:30.057876] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-09-15T18:08:30.815888] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-15T18:08:30.857834] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-09-15T18:08:31.113205] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T18:08:31.657883] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-09-15T18:08:32.465123] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-09-15T18:08:32.470376] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T18:08:32.755388] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-15T18:08:32.758546] [INFO ] [REMOTE ] DSL: Full fetch complete (30724 records). [2025-09-15T18:08:32.758621] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-09-15T18:08:33.129605] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-09-15T18:08:33.129775] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-09-15T18:08:33.130345] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-09-15T18:08:33.130397] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-09-15T18:08:33.143507] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-15T18:08:33.143149] [DEBUG] [LOCAL ] DSL: Trimmed 30724 records to 19964 (keeping 150 days of data) [2025-09-15T18:08:33.260690] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-09-15T18:08:33.275130] [DEBUG] [LOCAL ] DSL: Primary data saved (19964 records). [2025-09-15T18:08:33.275253] [INFO ] [MAIN ] DSL: Full history saved. [2025-09-15T18:08:33.275352] [INFO ] [MAIN ] Update Progress: 650/2369 symbols completed. DSL took 17.1s. Estimated remaining: 3h 1m 9s. Rate: 9.5 symbols/min [2025-09-15T18:08:33.447358] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:08:33.450366] [DEBUG] [LOCAL ] DSMC: Loaded 1241 existing records from primary storage. [2025-09-15T18:08:33.450446] [INFO ] [MAIN ] DSMC: Loaded 1241 existing records. [2025-09-15T18:08:33.660079] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:08:33.660363] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-09-15T18:08:33.660410] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-09-15T18:08:33.660603] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-09-15T18:08:33.660682] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-09-15T18:08:34.016281] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:08:34.057833] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-09-15T18:08:34.424988] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-15T18:08:34.491620] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-15T18:08:34.857866] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-09-15T18:08:35.657875] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-09-15T18:08:36.133749] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-15T18:08:36.457876] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-09-15T18:08:36.561047] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-15T18:08:36.566268] [INFO ] [REMOTE ] DRI: Full fetch complete (52021 records). [2025-09-15T18:08:36.566395] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-09-15T18:08:36.959476] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-09-15T18:08:36.959557] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-09-15T18:08:36.960247] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-09-15T18:08:36.960324] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-09-15T18:08:36.961543] [DEBUG] [LOCAL ] DRI: Trimmed 52021 records to 34727 (keeping 150 days of data) [2025-09-15T18:08:37.077191] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-15T18:08:37.198607] [DEBUG] [LOCAL ] DRI: Primary data saved (34727 records). [2025-09-15T18:08:37.198798] [INFO ] [MAIN ] DRI: Full history saved. [2025-09-15T18:08:37.198886] [INFO ] [MAIN ] Update Progress: 651/2369 symbols completed. DRI took 26.8s. Estimated remaining: 3h 0m 57s. Rate: 9.5 symbols/min [2025-09-15T18:08:37.262949] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-09-15T18:08:37.370996] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:08:37.387551] [DEBUG] [LOCAL ] DSU: Loaded 15655 existing records from primary storage. [2025-09-15T18:08:37.387705] [INFO ] [MAIN ] DSU: Loaded 15655 existing records. [2025-09-15T18:08:37.565863] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:08:37.566130] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-09-15T18:08:37.566176] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-09-15T18:08:37.566759] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-09-15T18:08:37.566821] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-09-15T18:08:37.919978] [INFO ] [REMOTE ] DSU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:08:38.009466] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-15T18:08:38.057885] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-09-15T18:08:38.857873] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-09-15T18:08:38.902481] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-15T18:08:39.643250] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-15T18:08:39.657814] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-09-15T18:08:40.185035] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-15T18:08:40.457870] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-09-15T18:08:40.912938] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-15T18:08:41.257879] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-09-15T18:08:41.591890] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-15T18:08:42.057901] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-09-15T18:08:42.398150] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-15T18:08:42.857859] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-09-15T18:08:43.154706] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-15T18:08:43.657876] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-09-15T18:08:44.093050] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-15T18:08:44.457882] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-09-15T18:08:45.257917] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-09-15T18:08:45.817147] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-15T18:08:45.954904] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-15T18:08:46.057886] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-09-15T18:08:46.713627] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-15T18:08:46.857920] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-09-15T18:08:47.398531] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-15T18:08:47.657903] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-09-15T18:08:48.457922] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-09-15T18:08:48.676627] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T18:08:48.980079] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-15T18:08:48.980954] [INFO ] [REMOTE ] DSMC: Full fetch complete (2234 records). [2025-09-15T18:08:48.981022] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-09-15T18:08:49.262963] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-09-15T18:08:49.345897] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-09-15T18:08:49.345973] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-09-15T18:08:49.346058] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-09-15T18:08:49.346096] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-09-15T18:08:49.346431] [DEBUG] [LOCAL ] DSMC: Trimmed 2234 records to 1215 (keeping 150 days of data) [2025-09-15T18:08:49.354307] [DEBUG] [LOCAL ] DSMC: Primary data saved (1215 records). [2025-09-15T18:08:49.354389] [INFO ] [MAIN ] DSMC: Full history saved. [2025-09-15T18:08:49.354461] [INFO ] [MAIN ] Update Progress: 652/2369 symbols completed. DSMC took 16.1s. Estimated remaining: 3h 1m 6s. Rate: 9.5 symbols/min [2025-09-15T18:08:49.524871] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:08:49.542145] [DEBUG] [LOCAL ] DSX: Loaded 17812 existing records from primary storage. [2025-09-15T18:08:49.542265] [INFO ] [MAIN ] DSX: Loaded 17812 existing records. [2025-09-15T18:08:49.726437] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:08:49.726759] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-09-15T18:08:49.726815] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-09-15T18:08:49.727312] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-09-15T18:08:49.727379] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-09-15T18:08:50.061030] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-09-15T18:08:50.082170] [INFO ] [REMOTE ] DSX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:08:50.316037] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-15T18:08:50.857874] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-09-15T18:08:50.879394] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-15T18:08:50.881135] [INFO ] [REMOTE ] DRLL: Full fetch complete (11147 records). [2025-09-15T18:08:50.881263] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-09-15T18:08:51.239903] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-09-15T18:08:51.239985] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-09-15T18:08:51.240232] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-09-15T18:08:51.240272] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-09-15T18:08:51.240783] [DEBUG] [LOCAL ] DRLL: Trimmed 11147 records to 6438 (keeping 150 days of data) [2025-09-15T18:08:51.286817] [DEBUG] [LOCAL ] DRLL: Primary data saved (6438 records). [2025-09-15T18:08:51.287055] [INFO ] [MAIN ] DRLL: Full history saved. [2025-09-15T18:08:51.287177] [INFO ] [MAIN ] Update Progress: 653/2369 symbols completed. DRLL took 36.5s. Estimated remaining: 3h 0m 48s. Rate: 9.5 symbols/min [2025-09-15T18:08:51.455758] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:08:51.500480] [DEBUG] [LOCAL ] DT: Loaded 39809 existing records from primary storage. [2025-09-15T18:08:51.500660] [INFO ] [MAIN ] DT: Loaded 39809 existing records. [2025-09-15T18:08:51.657974] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-09-15T18:08:51.678771] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:08:51.679017] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-09-15T18:08:51.679065] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-09-15T18:08:51.679970] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-09-15T18:08:51.680037] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-09-15T18:08:52.035763] [INFO ] [REMOTE ] DT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:08:52.282861] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T18:08:52.457884] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-09-15T18:08:53.257915] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-09-15T18:08:54.057889] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-09-15T18:08:54.229254] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-09-15T18:08:54.786194] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-15T18:08:54.857815] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-09-15T18:08:54.945521] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T18:08:55.189149] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (2.73 seconds). [2025-09-15T18:08:55.657886] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-09-15T18:08:55.673858] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-15T18:08:56.457888] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-09-15T18:08:57.035045] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T18:08:57.257824] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-09-15T18:08:57.659178] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T18:08:57.888312] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-15T18:08:57.890426] [INFO ] [REMOTE ] DSM: Full fetch complete (17935 records). [2025-09-15T18:08:57.890506] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-09-15T18:08:58.059005] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-09-15T18:08:58.255891] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-09-15T18:08:58.255962] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-09-15T18:08:58.256329] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-09-15T18:08:58.256367] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-09-15T18:08:58.256949] [DEBUG] [LOCAL ] DSM: Trimmed 17935 records to 10060 (keeping 150 days of data) [2025-09-15T18:08:58.316290] [DEBUG] [LOCAL ] DSM: Primary data saved (10060 records). [2025-09-15T18:08:58.316411] [INFO ] [MAIN ] DSM: Full history saved. [2025-09-15T18:08:58.316533] [INFO ] [MAIN ] Update Progress: 654/2369 symbols completed. DSM took 31.3s. Estimated remaining: 3h 0m 43s. Rate: 9.5 symbols/min [2025-09-15T18:08:58.502397] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:08:58.510198] [DEBUG] [LOCAL ] DTB: Loaded 3720 existing records from primary storage. [2025-09-15T18:08:58.510393] [INFO ] [MAIN ] DTB: Loaded 3720 existing records. [2025-09-15T18:08:58.698933] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:08:58.699289] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-09-15T18:08:58.699339] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-09-15T18:08:58.699613] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-09-15T18:08:58.699710] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-09-15T18:08:58.862867] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-09-15T18:08:59.073811] [INFO ] [REMOTE ] DTB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:08:59.413388] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T18:08:59.657889] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-09-15T18:08:59.914161] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-15T18:09:00.287619] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-15T18:09:00.457918] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-09-15T18:09:01.257875] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-09-15T18:09:01.551163] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-15T18:09:01.799462] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-15T18:09:02.057894] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-09-15T18:09:02.857869] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-09-15T18:09:03.348147] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-15T18:09:03.657909] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-09-15T18:09:04.457885] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-09-15T18:09:04.771488] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-15T18:09:05.257870] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-09-15T18:09:05.360209] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-15T18:09:05.612480] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-15T18:09:06.058011] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-09-15T18:09:06.475703] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-15T18:09:06.838392] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-15T18:09:06.857964] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-09-15T18:09:07.657882] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-09-15T18:09:08.457896] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-09-15T18:09:08.657660] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-15T18:09:08.888091] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-15T18:09:09.043827] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-15T18:09:09.257922] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-09-15T18:09:09.620854] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-15T18:09:10.057886] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-09-15T18:09:10.857839] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-09-15T18:09:10.966439] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-15T18:09:11.657875] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-09-15T18:09:12.242839] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-15T18:09:12.261860] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-15T18:09:12.263195] [INFO ] [REMOTE ] DTB: Full fetch complete (4980 records). [2025-09-15T18:09:12.263266] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-09-15T18:09:12.463980] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-09-15T18:09:12.636577] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-09-15T18:09:12.636713] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-09-15T18:09:12.636901] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-09-15T18:09:12.636945] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-09-15T18:09:12.637439] [DEBUG] [LOCAL ] DTB: Trimmed 4980 records to 3739 (keeping 150 days of data) [2025-09-15T18:09:12.661636] [DEBUG] [LOCAL ] DTB: Primary data saved (3739 records). [2025-09-15T18:09:12.661800] [INFO ] [MAIN ] DTB: Full history saved. [2025-09-15T18:09:12.661903] [INFO ] [MAIN ] Update Progress: 655/2369 symbols completed. DTB took 14.3s. Estimated remaining: 3h 0m 58s. Rate: 9.5 symbols/min [2025-09-15T18:09:12.836354] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:09:12.883160] [DEBUG] [LOCAL ] DTE: Loaded 35858 existing records from primary storage. [2025-09-15T18:09:12.883301] [INFO ] [MAIN ] DTE: Loaded 35858 existing records. [2025-09-15T18:09:13.061842] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:09:13.062124] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-09-15T18:09:13.062180] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-09-15T18:09:13.063068] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-09-15T18:09:13.063131] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-09-15T18:09:13.263045] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-09-15T18:09:13.425689] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T18:09:13.445874] [INFO ] [REMOTE ] DTE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:09:14.057864] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-09-15T18:09:14.783412] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-15T18:09:14.786115] [INFO ] [REMOTE ] DSU: Full fetch complete (23001 records). [2025-09-15T18:09:14.786190] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-09-15T18:09:14.786702] [FATAL] [VALIDATOR ] DSU: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:09:14.786775] [FATAL] [MAIN ] DSU: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:09:14.786822] [WARN ] [MAIN ] DSU: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:09:14.786865] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-09-15T18:09:14.786929] [DEBUG] [LOCAL ] DSU: No primary data file found to delete. [2025-09-15T18:09:14.786967] [INFO ] [LOCAL ] DSU: Starting deletion of derivative data. [2025-09-15T18:09:14.787299] [DEBUG] [LOCAL ] DSU: Deleted derivative data file. [2025-09-15T18:09:14.787391] [INFO ] [MAIN ] Update Progress: 656/2369 symbols completed. DSU took 37.6s. Estimated remaining: 3h 0m 41s. Rate: 9.5 symbols/min [2025-09-15T18:09:14.863003] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-09-15T18:09:14.961030] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:09:14.961330] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-09-15T18:09:14.961385] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-09-15T18:09:14.961556] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-09-15T18:09:14.961704] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-15T18:09:14.961777] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-15T18:09:14.961824] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-09-15T18:09:15.359734] [INFO ] [REMOTE ] DTF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:09:15.364829] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-15T18:09:15.657878] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-09-15T18:09:16.078387] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-15T18:09:16.139792] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-15T18:09:16.142979] [INFO ] [REMOTE ] DSX: Full fetch complete (27465 records). [2025-09-15T18:09:16.143063] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-09-15T18:09:16.468365] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-09-15T18:09:16.515329] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-09-15T18:09:16.515431] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-09-15T18:09:16.516000] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-09-15T18:09:16.516070] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-09-15T18:09:16.517094] [DEBUG] [LOCAL ] DSX: Trimmed 27465 records to 17629 (keeping 150 days of data) [2025-09-15T18:09:16.629577] [DEBUG] [LOCAL ] DSX: Primary data saved (17629 records). [2025-09-15T18:09:16.629751] [INFO ] [MAIN ] DSX: Full history saved. [2025-09-15T18:09:16.629869] [INFO ] [MAIN ] Update Progress: 657/2369 symbols completed. DSX took 27.3s. Estimated remaining: 3h 0m 23s. Rate: 9.5 symbols/min [2025-09-15T18:09:16.802953] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:09:16.810817] [DEBUG] [LOCAL ] DTG: Loaded 4209 existing records from primary storage. [2025-09-15T18:09:16.810934] [INFO ] [MAIN ] DTG: Loaded 4209 existing records. [2025-09-15T18:09:16.982706] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-15T18:09:17.006565] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:09:17.006987] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-09-15T18:09:17.007046] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-09-15T18:09:17.007522] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-09-15T18:09:17.007580] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-09-15T18:09:17.263228] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-09-15T18:09:17.381722] [INFO ] [REMOTE ] DTG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:09:18.057888] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-09-15T18:09:18.497240] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-15T18:09:18.857889] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-09-15T18:09:18.967236] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T18:09:19.278794] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-15T18:09:19.657877] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-09-15T18:09:20.457876] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-09-15T18:09:21.257968] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-09-15T18:09:21.429688] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-15T18:09:22.020683] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-15T18:09:22.057907] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-09-15T18:09:22.186098] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-15T18:09:22.677975] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-15T18:09:22.857890] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-09-15T18:09:23.657892] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-09-15T18:09:24.417863] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-15T18:09:24.423597] [INFO ] [REMOTE ] DT: Full fetch complete (57574 records). [2025-09-15T18:09:24.423722] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-09-15T18:09:24.468355] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-09-15T18:09:24.804437] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-09-15T18:09:24.804515] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-09-15T18:09:24.805284] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-09-15T18:09:24.805329] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-09-15T18:09:24.806495] [DEBUG] [LOCAL ] DT: Trimmed 57574 records to 39040 (keeping 150 days of data) [2025-09-15T18:09:24.904740] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-15T18:09:25.051850] [DEBUG] [LOCAL ] DT: Primary data saved (39040 records). [2025-09-15T18:09:25.052000] [INFO ] [MAIN ] DT: Full history saved. [2025-09-15T18:09:25.053358] [INFO ] [MAIN ] Update Progress: 658/2369 symbols completed. DT took 33.8s. Estimated remaining: 3h 0m 22s. Rate: 9.5 symbols/min [2025-09-15T18:09:25.222028] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:09:25.261077] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-09-15T18:09:25.263275] [DEBUG] [LOCAL ] DTM: Loaded 32519 existing records from primary storage. [2025-09-15T18:09:25.263562] [INFO ] [MAIN ] DTM: Loaded 32519 existing records. [2025-09-15T18:09:25.442810] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:09:25.443106] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-09-15T18:09:25.443352] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-09-15T18:09:25.455411] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-09-15T18:09:25.465721] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-09-15T18:09:25.586089] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-15T18:09:25.786323] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-15T18:09:25.848218] [INFO ] [REMOTE ] DTM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:09:26.057837] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-09-15T18:09:26.857932] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-09-15T18:09:27.339739] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T18:09:27.657913] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-09-15T18:09:28.043840] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-15T18:09:28.153753] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-15T18:09:28.457912] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-09-15T18:09:28.868610] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-15T18:09:28.869747] [INFO ] [REMOTE ] DTF: Full fetch complete (1336 records). [2025-09-15T18:09:28.869820] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-09-15T18:09:29.054432] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-15T18:09:29.054720] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:09:29.054803] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:09:29.054854] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-15T18:09:29.054938] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-15T18:09:29.054978] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-09-15T18:09:29.055095] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-09-15T18:09:29.055190] [INFO ] [MAIN ] Update Progress: 659/2369 symbols completed. DTF took 14.3s. Estimated remaining: 3h 0m 9s. Rate: 9.5 symbols/min [2025-09-15T18:09:29.231209] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:09:29.237434] [DEBUG] [LOCAL ] DTW: Loaded 3562 existing records from primary storage. [2025-09-15T18:09:29.237571] [INFO ] [MAIN ] DTW: Loaded 3562 existing records. [2025-09-15T18:09:29.267474] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-09-15T18:09:29.429432] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:09:29.429803] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-09-15T18:09:29.429862] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-09-15T18:09:29.430219] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-09-15T18:09:29.430270] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-09-15T18:09:29.815590] [INFO ] [REMOTE ] DTW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:09:30.057884] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-09-15T18:09:30.857931] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-09-15T18:09:31.032469] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-15T18:09:31.402049] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T18:09:31.470372] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-15T18:09:31.657907] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-09-15T18:09:32.175693] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-15T18:09:32.457896] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-09-15T18:09:33.257887] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-09-15T18:09:34.041896] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T18:09:34.057829] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-09-15T18:09:34.856889] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-15T18:09:34.866512] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-09-15T18:09:35.098518] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-15T18:09:35.237545] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-15T18:09:35.657861] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-09-15T18:09:36.457881] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-09-15T18:09:36.841220] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-15T18:09:36.949717] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T18:09:37.257862] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-09-15T18:09:37.868017] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-15T18:09:38.057857] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-09-15T18:09:38.614435] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-15T18:09:38.857865] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-09-15T18:09:39.657928] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-09-15T18:09:40.224754] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-15T18:09:40.339285] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T18:09:40.344874] [INFO ] [REMOTE ] DTE: Full fetch complete (52195 records). [2025-09-15T18:09:40.345008] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-09-15T18:09:40.462984] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-09-15T18:09:40.725705] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-09-15T18:09:40.725784] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-09-15T18:09:40.726472] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-09-15T18:09:40.726519] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-09-15T18:09:40.727618] [DEBUG] [LOCAL ] DTE: Trimmed 52195 records to 35164 (keeping 150 days of data) [2025-09-15T18:09:40.954813] [DEBUG] [LOCAL ] DTE: Primary data saved (35164 records). [2025-09-15T18:09:40.954961] [INFO ] [MAIN ] DTE: Full history saved. [2025-09-15T18:09:40.955977] [INFO ] [MAIN ] Update Progress: 660/2369 symbols completed. DTE took 28.3s. Estimated remaining: 3h 0m 18s. Rate: 9.5 symbols/min [2025-09-15T18:09:41.127062] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:09:41.131279] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-15T18:09:41.176419] [DEBUG] [LOCAL ] DUK: Loaded 40227 existing records from primary storage. [2025-09-15T18:09:41.176556] [INFO ] [MAIN ] DUK: Loaded 40227 existing records. [2025-09-15T18:09:41.263058] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-09-15T18:09:41.355097] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:09:41.355323] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-09-15T18:09:41.355368] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-09-15T18:09:41.356334] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-09-15T18:09:41.356385] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-09-15T18:09:41.707986] [INFO ] [REMOTE ] DUK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:09:42.057860] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-09-15T18:09:42.622086] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-15T18:09:42.785415] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-15T18:09:42.857858] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-09-15T18:09:43.657882] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-09-15T18:09:44.135007] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T18:09:44.151805] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-15T18:09:44.457884] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-09-15T18:09:45.027352] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-15T18:09:45.257914] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-09-15T18:09:45.625567] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-15T18:09:46.057891] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-09-15T18:09:46.857886] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-09-15T18:09:47.497998] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-15T18:09:47.499183] [INFO ] [REMOTE ] DTW: Full fetch complete (5200 records). [2025-09-15T18:09:47.499252] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-09-15T18:09:47.658007] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-09-15T18:09:47.865735] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-09-15T18:09:47.865816] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-09-15T18:09:47.865983] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-09-15T18:09:47.866021] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-09-15T18:09:47.866388] [DEBUG] [LOCAL ] DTW: Trimmed 5200 records to 3503 (keeping 150 days of data) [2025-09-15T18:09:47.888156] [DEBUG] [LOCAL ] DTW: Primary data saved (3503 records). [2025-09-15T18:09:47.888247] [INFO ] [MAIN ] DTW: Full history saved. [2025-09-15T18:09:47.888339] [INFO ] [MAIN ] Update Progress: 661/2369 symbols completed. DTW took 18.8s. Estimated remaining: 3h 0m 13s. Rate: 9.5 symbols/min [2025-09-15T18:09:48.059998] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:09:48.066744] [DEBUG] [LOCAL ] DUKB: Loaded 4720 existing records from primary storage. [2025-09-15T18:09:48.066971] [INFO ] [MAIN ] DUKB: Loaded 4720 existing records. [2025-09-15T18:09:48.228995] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-15T18:09:48.305916] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:09:48.306193] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-09-15T18:09:48.306244] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-09-15T18:09:48.306611] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-09-15T18:09:48.306690] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-09-15T18:09:48.469722] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-09-15T18:09:48.506870] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-15T18:09:48.543962] [INFO ] [REMOTE ] DTG: Full fetch complete (6379 records). [2025-09-15T18:09:48.564623] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-09-15T18:09:48.582181] [FATAL] [VALIDATOR ] DTG: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:09:48.590867] [FATAL] [MAIN ] DTG: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:09:48.593188] [WARN ] [MAIN ] DTG: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:09:48.593564] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-09-15T18:09:48.646887] [DEBUG] [LOCAL ] DTG: No primary data file found to delete. [2025-09-15T18:09:48.683980] [INFO ] [LOCAL ] DTG: Starting deletion of derivative data. [2025-09-15T18:09:48.693058] [DEBUG] [LOCAL ] DTG: Deleted derivative data file. [2025-09-15T18:09:48.707093] [INFO ] [MAIN ] Update Progress: 662/2369 symbols completed. DTG took 32.1s. Estimated remaining: 2h 59m 52s. Rate: 9.5 symbols/min [2025-09-15T18:09:48.711815] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:09:48.882078] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:09:48.923170] [DEBUG] [LOCAL ] DV: Loaded 38284 existing records from primary storage. [2025-09-15T18:09:48.923383] [INFO ] [MAIN ] DV: Loaded 38284 existing records. [2025-09-15T18:09:49.121065] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:09:49.121340] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-09-15T18:09:49.121410] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-09-15T18:09:49.122183] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-09-15T18:09:49.122233] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-09-15T18:09:49.263366] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-09-15T18:09:49.486102] [INFO ] [REMOTE ] DV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:09:49.888609] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-15T18:09:50.057938] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-09-15T18:09:50.462347] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-15T18:09:50.857877] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-09-15T18:09:51.474966] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T18:09:51.657867] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-09-15T18:09:52.213572] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-15T18:09:52.457922] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-09-15T18:09:53.188744] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-15T18:09:53.217272] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-15T18:09:53.257833] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-09-15T18:09:54.057961] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-09-15T18:09:54.857919] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-09-15T18:09:54.978953] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-15T18:09:55.243434] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-15T18:09:55.644142] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-15T18:09:55.657819] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-09-15T18:09:56.457883] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-09-15T18:09:57.051704] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-15T18:09:57.257865] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-09-15T18:09:57.398368] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-15T18:09:58.057914] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-09-15T18:09:58.585256] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-15T18:09:58.823685] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T18:09:58.830012] [INFO ] [REMOTE ] DTM: Full fetch complete (48825 records). [2025-09-15T18:09:58.830215] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-09-15T18:09:58.863912] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-09-15T18:09:59.434985] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-09-15T18:09:59.435090] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-09-15T18:09:59.436177] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-09-15T18:09:59.436274] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-09-15T18:09:59.438046] [DEBUG] [LOCAL ] DTM: Trimmed 48825 records to 31775 (keeping 150 days of data) [2025-09-15T18:09:59.696862] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-09-15T18:09:59.770188] [DEBUG] [LOCAL ] DTM: Primary data saved (31775 records). [2025-09-15T18:09:59.770369] [INFO ] [MAIN ] DTM: Full history saved. [2025-09-15T18:09:59.770464] [INFO ] [MAIN ] Update Progress: 663/2369 symbols completed. DTM took 34.7s. Estimated remaining: 2h 59m 58s. Rate: 9.5 symbols/min [2025-09-15T18:09:59.951776] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:09:59.988283] [DEBUG] [LOCAL ] DVA: Loaded 30946 existing records from primary storage. [2025-09-15T18:09:59.988433] [INFO ] [MAIN ] DVA: Loaded 30946 existing records. [2025-09-15T18:10:00.164518] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:10:00.164782] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-09-15T18:10:00.164829] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-09-15T18:10:00.165616] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-09-15T18:10:00.165688] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-09-15T18:10:00.463071] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-09-15T18:10:00.517304] [INFO ] [REMOTE ] DVA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:10:00.551559] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-15T18:10:01.257926] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-09-15T18:10:01.357888] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-15T18:10:01.406431] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-15T18:10:02.057891] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-09-15T18:10:02.450681] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-15T18:10:02.727062] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-15T18:10:02.857845] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-09-15T18:10:03.657898] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-09-15T18:10:04.122322] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-15T18:10:04.457913] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-09-15T18:10:05.266572] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-09-15T18:10:05.272407] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T18:10:06.057888] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-09-15T18:10:06.101628] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T18:10:06.645366] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-15T18:10:06.646528] [INFO ] [REMOTE ] DUKB: Full fetch complete (6925 records). [2025-09-15T18:10:06.646596] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-09-15T18:10:06.863084] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-09-15T18:10:07.022962] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-09-15T18:10:07.023153] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-09-15T18:10:07.023373] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-09-15T18:10:07.023471] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-09-15T18:10:07.034088] [DEBUG] [LOCAL ] DUKB: Trimmed 6925 records to 4653 (keeping 150 days of data) [2025-09-15T18:10:07.054630] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-15T18:10:07.093845] [DEBUG] [LOCAL ] DUKB: Primary data saved (4653 records). [2025-09-15T18:10:07.093976] [INFO ] [MAIN ] DUKB: Full history saved. [2025-09-15T18:10:07.094057] [INFO ] [MAIN ] Update Progress: 664/2369 symbols completed. DUKB took 19.2s. Estimated remaining: 2h 59m 54s. Rate: 9.5 symbols/min [2025-09-15T18:10:07.266284] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:10:07.310559] [DEBUG] [LOCAL ] DVN: Loaded 40439 existing records from primary storage. [2025-09-15T18:10:07.310774] [INFO ] [MAIN ] DVN: Loaded 40439 existing records. [2025-09-15T18:10:07.500742] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:10:07.501121] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-09-15T18:10:07.501169] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-09-15T18:10:07.502014] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-09-15T18:10:07.502074] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-09-15T18:10:07.678570] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-09-15T18:10:07.870540] [INFO ] [REMOTE ] DVN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:10:08.174693] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-15T18:10:08.457914] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-09-15T18:10:09.257899] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-09-15T18:10:09.623885] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-15T18:10:09.666139] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-15T18:10:10.057874] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-09-15T18:10:10.857939] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-09-15T18:10:11.207891] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-15T18:10:11.657931] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-09-15T18:10:11.686977] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-15T18:10:11.692812] [INFO ] [REMOTE ] DUK: Full fetch complete (58149 records). [2025-09-15T18:10:11.692938] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-09-15T18:10:12.097459] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-09-15T18:10:12.097561] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-09-15T18:10:12.098335] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-09-15T18:10:12.098392] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-09-15T18:10:12.099947] [DEBUG] [LOCAL ] DUK: Trimmed 58149 records to 39449 (keeping 150 days of data) [2025-09-15T18:10:12.240748] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-15T18:10:12.386976] [DEBUG] [LOCAL ] DUK: Primary data saved (39449 records). [2025-09-15T18:10:12.387122] [INFO ] [MAIN ] DUK: Full history saved. [2025-09-15T18:10:12.387940] [INFO ] [MAIN ] Update Progress: 665/2369 symbols completed. DUK took 31.4s. Estimated remaining: 2h 59m 45s. Rate: 9.5 symbols/min [2025-09-15T18:10:12.462971] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-09-15T18:10:12.566859] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:10:12.610958] [DEBUG] [LOCAL ] DX: Loaded 39442 existing records from primary storage. [2025-09-15T18:10:12.611269] [INFO ] [MAIN ] DX: Loaded 39442 existing records. [2025-09-15T18:10:12.794025] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:10:12.794351] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-09-15T18:10:12.794403] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-09-15T18:10:12.795604] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-09-15T18:10:12.795697] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-09-15T18:10:13.155759] [INFO ] [REMOTE ] DX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:10:13.257876] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-09-15T18:10:13.524765] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-15T18:10:14.057924] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-09-15T18:10:14.614625] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-15T18:10:14.857878] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-09-15T18:10:15.048311] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-09-15T18:10:15.657835] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-09-15T18:10:15.724505] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T18:10:16.229897] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-15T18:10:16.457943] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-09-15T18:10:16.984527] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-15T18:10:17.257927] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-09-15T18:10:18.057964] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-09-15T18:10:18.325628] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-15T18:10:18.857932] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-09-15T18:10:19.098465] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-15T18:10:19.402126] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-15T18:10:19.406982] [INFO ] [REMOTE ] DVA: Full fetch complete (45955 records). [2025-09-15T18:10:19.407097] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-09-15T18:10:19.665884] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-09-15T18:10:19.792007] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-09-15T18:10:19.792245] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-09-15T18:10:19.792922] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-09-15T18:10:19.792969] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-09-15T18:10:19.794018] [DEBUG] [LOCAL ] DVA: Trimmed 45955 records to 30220 (keeping 150 days of data) [2025-09-15T18:10:19.982517] [DEBUG] [LOCAL ] DVA: Primary data saved (30220 records). [2025-09-15T18:10:19.982672] [INFO ] [MAIN ] DVA: Full history saved. [2025-09-15T18:10:19.982759] [INFO ] [MAIN ] Update Progress: 666/2369 symbols completed. DVA took 20.2s. Estimated remaining: 2h 59m 42s. Rate: 9.5 symbols/min [2025-09-15T18:10:20.155805] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:10:20.194847] [DEBUG] [LOCAL ] DXC: Loaded 37447 existing records from primary storage. [2025-09-15T18:10:20.195026] [INFO ] [MAIN ] DXC: Loaded 37447 existing records. [2025-09-15T18:10:20.385959] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:10:20.386418] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-09-15T18:10:20.386525] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-09-15T18:10:20.387497] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-09-15T18:10:20.387614] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-09-15T18:10:20.471714] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-09-15T18:10:20.524346] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-15T18:10:20.806012] [INFO ] [REMOTE ] DXC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:10:20.890928] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T18:10:21.257876] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-09-15T18:10:22.069392] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-09-15T18:10:22.074995] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-15T18:10:22.857889] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-09-15T18:10:23.036300] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-15T18:10:23.266859] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-15T18:10:23.657883] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-09-15T18:10:24.457885] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-09-15T18:10:24.485937] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-15T18:10:24.491860] [INFO ] [REMOTE ] DV: Full fetch complete (55559 records). [2025-09-15T18:10:24.491988] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-09-15T18:10:24.885985] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-09-15T18:10:24.886077] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-09-15T18:10:24.886869] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-09-15T18:10:24.886926] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-09-15T18:10:24.888083] [DEBUG] [LOCAL ] DV: Trimmed 55559 records to 37587 (keeping 150 days of data) [2025-09-15T18:10:25.115897] [DEBUG] [LOCAL ] DV: Primary data saved (37587 records). [2025-09-15T18:10:25.116052] [INFO ] [MAIN ] DV: Full history saved. [2025-09-15T18:10:25.117175] [INFO ] [MAIN ] Update Progress: 667/2369 symbols completed. DV took 36.4s. Estimated remaining: 2h 59m 33s. Rate: 9.5 symbols/min [2025-09-15T18:10:25.265399] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-09-15T18:10:25.295957] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:10:25.329313] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-15T18:10:25.361228] [DEBUG] [LOCAL ] DXYZ: Loaded 26884 existing records from primary storage. [2025-09-15T18:10:25.361367] [INFO ] [MAIN ] DXYZ: Loaded 26884 existing records. [2025-09-15T18:10:25.550324] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:10:25.550603] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-09-15T18:10:25.550678] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-09-15T18:10:25.551291] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-09-15T18:10:25.551341] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-09-15T18:10:25.903531] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:10:26.057871] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-09-15T18:10:26.309047] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-15T18:10:26.857881] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-09-15T18:10:26.997930] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-15T18:10:27.386866] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-15T18:10:27.657930] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-09-15T18:10:28.457891] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-09-15T18:10:28.523428] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-15T18:10:29.079732] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-15T18:10:29.257879] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-09-15T18:10:30.057886] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-09-15T18:10:30.163096] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-15T18:10:30.674584] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-15T18:10:30.680469] [INFO ] [REMOTE ] DVN: Full fetch complete (58379 records). [2025-09-15T18:10:30.680610] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-09-15T18:10:30.865575] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-09-15T18:10:31.057216] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-09-15T18:10:31.057307] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-09-15T18:10:31.058059] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-09-15T18:10:31.058108] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-09-15T18:10:31.059394] [DEBUG] [LOCAL ] DVN: Trimmed 58379 records to 39659 (keeping 150 days of data) [2025-09-15T18:10:31.308968] [DEBUG] [LOCAL ] DVN: Primary data saved (39659 records). [2025-09-15T18:10:31.309140] [INFO ] [MAIN ] DVN: Full history saved. [2025-09-15T18:10:31.309239] [INFO ] [MAIN ] Update Progress: 668/2369 symbols completed. DVN took 24.2s. Estimated remaining: 2h 59m 26s. Rate: 9.5 symbols/min [2025-09-15T18:10:31.479373] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:10:31.502202] [DEBUG] [LOCAL ] DY: Loaded 21411 existing records from primary storage. [2025-09-15T18:10:31.502345] [INFO ] [MAIN ] DY: Loaded 21411 existing records. [2025-09-15T18:10:31.659476] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-09-15T18:10:31.679514] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:10:31.681493] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-09-15T18:10:31.681692] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-09-15T18:10:31.682384] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-09-15T18:10:31.682584] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-09-15T18:10:31.983486] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-15T18:10:32.082694] [INFO ] [REMOTE ] DY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:10:32.457892] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-09-15T18:10:32.515673] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-15T18:10:33.160583] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T18:10:33.170268] [INFO ] [REMOTE ] DX: Full fetch complete (56968 records). [2025-09-15T18:10:33.170408] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-09-15T18:10:33.268110] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-09-15T18:10:33.556353] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-09-15T18:10:33.556437] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-09-15T18:10:33.557257] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-09-15T18:10:33.557311] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-09-15T18:10:33.558583] [DEBUG] [LOCAL ] DX: Trimmed 56968 records to 38676 (keeping 150 days of data) [2025-09-15T18:10:33.803219] [DEBUG] [LOCAL ] DX: Primary data saved (38676 records). [2025-09-15T18:10:33.803363] [INFO ] [MAIN ] DX: Full history saved. [2025-09-15T18:10:33.804177] [INFO ] [MAIN ] Update Progress: 669/2369 symbols completed. DX took 21.4s. Estimated remaining: 2h 59m 10s. Rate: 9.5 symbols/min [2025-09-15T18:10:34.003340] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:10:34.029778] [DEBUG] [LOCAL ] E: Loaded 25020 existing records from primary storage. [2025-09-15T18:10:34.029953] [INFO ] [MAIN ] E: Loaded 25020 existing records. [2025-09-15T18:10:34.062520] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-09-15T18:10:34.217958] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:10:34.218353] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-09-15T18:10:34.218412] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-09-15T18:10:34.219079] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-09-15T18:10:34.219133] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-09-15T18:10:34.421199] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-15T18:10:34.612441] [INFO ] [REMOTE ] E: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:10:34.710551] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T18:10:34.857851] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-09-15T18:10:35.657879] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-09-15T18:10:35.760099] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T18:10:36.284966] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-15T18:10:36.457892] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-09-15T18:10:36.703252] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-15T18:10:37.257917] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-09-15T18:10:38.059495] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-09-15T18:10:38.062195] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-15T18:10:38.338505] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-15T18:10:38.857885] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-09-15T18:10:39.657872] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-09-15T18:10:39.763276] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T18:10:39.952420] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-15T18:10:40.457862] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-09-15T18:10:41.068583] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T18:10:41.074084] [INFO ] [REMOTE ] DXC: Full fetch complete (53237 records). [2025-09-15T18:10:41.074175] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-09-15T18:10:41.262949] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-09-15T18:10:41.449191] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-09-15T18:10:41.449270] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-09-15T18:10:41.450008] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-09-15T18:10:41.450064] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-09-15T18:10:41.451154] [DEBUG] [LOCAL ] DXC: Trimmed 53237 records to 36743 (keeping 150 days of data) [2025-09-15T18:10:41.670156] [DEBUG] [LOCAL ] DXC: Primary data saved (36743 records). [2025-09-15T18:10:41.670365] [INFO ] [MAIN ] DXC: Full history saved. [2025-09-15T18:10:41.671165] [INFO ] [MAIN ] Update Progress: 670/2369 symbols completed. DXC took 21.7s. Estimated remaining: 2h 59m 8s. Rate: 9.5 symbols/min [2025-09-15T18:10:41.840196] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:10:41.873818] [DEBUG] [LOCAL ] EAF: Loaded 33346 existing records from primary storage. [2025-09-15T18:10:41.873951] [INFO ] [MAIN ] EAF: Loaded 33346 existing records. [2025-09-15T18:10:42.049527] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:10:42.049854] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-09-15T18:10:42.049901] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-09-15T18:10:42.050557] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-09-15T18:10:42.050603] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-09-15T18:10:42.081639] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-09-15T18:10:42.427701] [INFO ] [REMOTE ] EAF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:10:42.469813] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-15T18:10:42.478981] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-15T18:10:42.857887] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-09-15T18:10:43.246489] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-15T18:10:43.657897] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-09-15T18:10:44.457902] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-09-15T18:10:44.631367] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-15T18:10:44.720159] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-15T18:10:45.257881] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-09-15T18:10:45.458488] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-15T18:10:46.058083] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-09-15T18:10:46.167243] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-15T18:10:46.857883] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-09-15T18:10:47.657883] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-09-15T18:10:47.855348] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-15T18:10:47.954034] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-15T18:10:48.424529] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-15T18:10:48.457910] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-09-15T18:10:49.257965] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-09-15T18:10:49.657635] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-15T18:10:50.057873] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-09-15T18:10:50.857936] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-09-15T18:10:51.089612] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-15T18:10:51.170763] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-15T18:10:51.657885] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-09-15T18:10:52.266835] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-15T18:10:52.457883] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-09-15T18:10:52.861468] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T18:10:53.257886] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-09-15T18:10:53.722153] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T18:10:53.725792] [INFO ] [REMOTE ] E: Full fetch complete (36535 records). [2025-09-15T18:10:53.725892] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-09-15T18:10:54.062963] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-09-15T18:10:54.102912] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-09-15T18:10:54.103041] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-09-15T18:10:54.103630] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-09-15T18:10:54.103707] [DEBUG] [LOCAL ] E: Saving primary data. [2025-09-15T18:10:54.104696] [DEBUG] [LOCAL ] E: Trimmed 36535 records to 24276 (keeping 150 days of data) [2025-09-15T18:10:54.250038] [DEBUG] [LOCAL ] E: Primary data saved (24276 records). [2025-09-15T18:10:54.250179] [INFO ] [MAIN ] E: Full history saved. [2025-09-15T18:10:54.250262] [INFO ] [MAIN ] Update Progress: 671/2369 symbols completed. E took 20.4s. Estimated remaining: 2h 59m 17s. Rate: 9.5 symbols/min [2025-09-15T18:10:54.424860] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:10:54.429121] [DEBUG] [LOCAL ] EAI: Loaded 2854 existing records from primary storage. [2025-09-15T18:10:54.429198] [INFO ] [MAIN ] EAI: Loaded 2854 existing records. [2025-09-15T18:10:54.608951] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:10:54.609221] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-09-15T18:10:54.609269] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-09-15T18:10:54.609482] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-09-15T18:10:54.609534] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-09-15T18:10:54.858238] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-09-15T18:10:54.916805] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-15T18:10:54.978849] [INFO ] [REMOTE ] EAI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:10:54.979370] [INFO ] [REMOTE ] DXYZ: Full fetch complete (40586 records). [2025-09-15T18:10:54.979459] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-09-15T18:10:55.365098] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-09-15T18:10:55.365268] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-09-15T18:10:55.365954] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-09-15T18:10:55.366029] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-09-15T18:10:55.367357] [DEBUG] [LOCAL ] DXYZ: Trimmed 40586 records to 26469 (keeping 150 days of data) [2025-09-15T18:10:55.550209] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-15T18:10:55.569819] [DEBUG] [LOCAL ] DXYZ: Primary data saved (26469 records). [2025-09-15T18:10:55.569993] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-09-15T18:10:55.570096] [INFO ] [MAIN ] Update Progress: 672/2369 symbols completed. DXYZ took 30.5s. Estimated remaining: 2h 58m 58s. Rate: 9.5 symbols/min [2025-09-15T18:10:55.664032] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-09-15T18:10:55.756291] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:10:55.778527] [DEBUG] [LOCAL ] EARN: Loaded 20708 existing records from primary storage. [2025-09-15T18:10:55.778720] [INFO ] [MAIN ] EARN: Loaded 20708 existing records. [2025-09-15T18:10:55.960794] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:10:55.961067] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-09-15T18:10:55.961117] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-09-15T18:10:55.961746] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-09-15T18:10:55.961798] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-09-15T18:10:56.328987] [INFO ] [REMOTE ] EARN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:10:56.334622] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-15T18:10:56.457950] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-09-15T18:10:56.618728] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-15T18:10:56.790881] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-15T18:10:57.257876] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-09-15T18:10:58.057886] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-09-15T18:10:58.757205] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-15T18:10:58.857863] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-09-15T18:10:59.479428] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-15T18:10:59.483149] [INFO ] [REMOTE ] DY: Full fetch complete (33461 records). [2025-09-15T18:10:59.483240] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-09-15T18:10:59.659400] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-09-15T18:10:59.857146] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-09-15T18:10:59.857254] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-09-15T18:10:59.858128] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-09-15T18:10:59.858175] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-09-15T18:10:59.859304] [DEBUG] [LOCAL ] DY: Trimmed 33461 records to 20943 (keeping 150 days of data) [2025-09-15T18:10:59.999425] [DEBUG] [LOCAL ] DY: Primary data saved (20943 records). [2025-09-15T18:10:59.999614] [INFO ] [MAIN ] DY: Full history saved. [2025-09-15T18:10:59.999747] [INFO ] [MAIN ] Update Progress: 673/2369 symbols completed. DY took 28.7s. Estimated remaining: 2h 58m 47s. Rate: 9.5 symbols/min [2025-09-15T18:11:00.183897] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:11:00.226317] [DEBUG] [LOCAL ] EAT: Loaded 37345 existing records from primary storage. [2025-09-15T18:11:00.226471] [INFO ] [MAIN ] EAT: Loaded 37345 existing records. [2025-09-15T18:11:00.404392] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:11:00.404729] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-09-15T18:11:00.409521] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-09-15T18:11:00.410506] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-15T18:11:00.412266] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-09-15T18:11:00.412578] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-09-15T18:11:00.466478] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-09-15T18:11:00.768907] [INFO ] [REMOTE ] EAT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:11:00.803493] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-15T18:11:01.257886] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-09-15T18:11:01.320169] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-15T18:11:02.057883] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-09-15T18:11:02.857774] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-15T18:11:02.857833] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-09-15T18:11:02.896620] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-15T18:11:03.657935] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-09-15T18:11:04.114211] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-15T18:11:04.223338] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-15T18:11:04.457870] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-09-15T18:11:05.257931] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-09-15T18:11:06.057882] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-09-15T18:11:06.297181] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-15T18:11:06.737967] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-15T18:11:06.857890] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-09-15T18:11:07.172073] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-15T18:11:07.176350] [INFO ] [REMOTE ] EAF: Full fetch complete (48841 records). [2025-09-15T18:11:07.176449] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-09-15T18:11:07.564624] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-09-15T18:11:07.564759] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-09-15T18:11:07.565611] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-09-15T18:11:07.565688] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-09-15T18:11:07.566874] [DEBUG] [LOCAL ] EAF: Trimmed 48841 records to 32555 (keeping 150 days of data) [2025-09-15T18:11:07.661872] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-09-15T18:11:07.775160] [DEBUG] [LOCAL ] EAF: Primary data saved (32555 records). [2025-09-15T18:11:07.775316] [INFO ] [MAIN ] EAF: Full history saved. [2025-09-15T18:11:07.775443] [INFO ] [MAIN ] Update Progress: 674/2369 symbols completed. EAF took 26.1s. Estimated remaining: 2h 58m 44s. Rate: 9.5 symbols/min [2025-09-15T18:11:07.950607] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:11:07.978584] [DEBUG] [LOCAL ] EB: Loaded 27695 existing records from primary storage. [2025-09-15T18:11:07.978745] [INFO ] [MAIN ] EB: Loaded 27695 existing records. [2025-09-15T18:11:08.167518] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:11:08.168039] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-09-15T18:11:08.168176] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-09-15T18:11:08.168861] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-09-15T18:11:08.168914] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-09-15T18:11:08.323915] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T18:11:08.424106] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-15T18:11:08.461890] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-09-15T18:11:08.572229] [INFO ] [REMOTE ] EB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:11:09.257881] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-09-15T18:11:09.882623] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T18:11:09.883694] [INFO ] [REMOTE ] EAI: Full fetch complete (4308 records). [2025-09-15T18:11:09.883765] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-09-15T18:11:10.061405] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-09-15T18:11:10.252293] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-09-15T18:11:10.252406] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-09-15T18:11:10.252561] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-09-15T18:11:10.252621] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-09-15T18:11:10.253290] [DEBUG] [LOCAL ] EAI: Trimmed 4308 records to 2827 (keeping 150 days of data) [2025-09-15T18:11:10.271777] [DEBUG] [LOCAL ] EAI: Primary data saved (2827 records). [2025-09-15T18:11:10.271878] [INFO ] [MAIN ] EAI: Full history saved. [2025-09-15T18:11:10.271994] [INFO ] [MAIN ] Update Progress: 675/2369 symbols completed. EAI took 16.0s. Estimated remaining: 2h 58m 28s. Rate: 9.5 symbols/min [2025-09-15T18:11:10.444532] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:11:10.476665] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-15T18:11:10.499216] [DEBUG] [LOCAL ] EBF: Loaded 14154 existing records from primary storage. [2025-09-15T18:11:10.499344] [INFO ] [MAIN ] EBF: Loaded 14154 existing records. [2025-09-15T18:11:10.679530] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:11:10.679966] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-09-15T18:11:10.680022] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-09-15T18:11:10.680411] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-09-15T18:11:10.680459] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-09-15T18:11:10.865588] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-09-15T18:11:11.033923] [INFO ] [REMOTE ] EBF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:11:11.213809] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-15T18:11:11.657882] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-09-15T18:11:12.417573] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-15T18:11:12.457895] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-09-15T18:11:12.768400] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T18:11:13.257884] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-09-15T18:11:13.537779] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-15T18:11:14.057959] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-09-15T18:11:14.644677] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-15T18:11:14.857974] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-09-15T18:11:15.105466] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-15T18:11:15.657870] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-09-15T18:11:16.236880] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T18:11:16.457870] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-09-15T18:11:16.933972] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T18:11:17.257911] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-09-15T18:11:17.936571] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T18:11:18.007285] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-15T18:11:18.057846] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-09-15T18:11:18.857922] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-09-15T18:11:19.550731] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-15T18:11:19.657851] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-09-15T18:11:19.896580] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-15T18:11:20.457877] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-09-15T18:11:21.262701] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-09-15T18:11:21.284548] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-15T18:11:21.541219] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-15T18:11:22.057885] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-09-15T18:11:22.647580] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T18:11:22.857887] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-09-15T18:11:23.048340] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T18:11:23.052008] [INFO ] [REMOTE ] EARN: Full fetch complete (34457 records). [2025-09-15T18:11:23.052114] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-09-15T18:11:23.454255] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-09-15T18:11:23.454383] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-09-15T18:11:23.455013] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-09-15T18:11:23.455069] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-09-15T18:11:23.456020] [DEBUG] [LOCAL ] EARN: Trimmed 34457 records to 20059 (keeping 150 days of data) [2025-09-15T18:11:23.585064] [DEBUG] [LOCAL ] EARN: Primary data saved (20059 records). [2025-09-15T18:11:23.585195] [INFO ] [MAIN ] EARN: Full history saved. [2025-09-15T18:11:23.585284] [INFO ] [MAIN ] Update Progress: 676/2369 symbols completed. EARN took 28.0s. Estimated remaining: 2h 58m 40s. Rate: 9.5 symbols/min [2025-09-15T18:11:23.659261] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-09-15T18:11:23.761784] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:11:23.774935] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-15T18:11:23.818467] [DEBUG] [LOCAL ] EBR: Loaded 31998 existing records from primary storage. [2025-09-15T18:11:23.818628] [INFO ] [MAIN ] EBR: Loaded 31998 existing records. [2025-09-15T18:11:23.994499] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:11:23.994773] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-09-15T18:11:23.994821] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-09-15T18:11:23.995585] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-09-15T18:11:23.995633] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-09-15T18:11:24.350352] [INFO ] [REMOTE ] EBR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:11:24.457834] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-09-15T18:11:24.538519] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-15T18:11:25.257887] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-09-15T18:11:26.015480] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-15T18:11:26.057846] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-09-15T18:11:26.677855] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T18:11:26.857889] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-09-15T18:11:27.233883] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-15T18:11:27.239430] [INFO ] [REMOTE ] EAT: Full fetch complete (54329 records). [2025-09-15T18:11:27.239539] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-09-15T18:11:27.612166] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-09-15T18:11:27.612243] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-09-15T18:11:27.612982] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-09-15T18:11:27.613030] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-09-15T18:11:27.614161] [DEBUG] [LOCAL ] EAT: Trimmed 54329 records to 36616 (keeping 150 days of data) [2025-09-15T18:11:27.670412] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-09-15T18:11:27.865495] [DEBUG] [LOCAL ] EAT: Primary data saved (36616 records). [2025-09-15T18:11:27.865782] [INFO ] [MAIN ] EAT: Full history saved. [2025-09-15T18:11:27.865982] [INFO ] [MAIN ] Update Progress: 677/2369 symbols completed. EAT took 27.9s. Estimated remaining: 2h 58m 28s. Rate: 9.5 symbols/min [2025-09-15T18:11:27.892066] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-15T18:11:28.457895] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-09-15T18:11:28.639737] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-15T18:11:29.257924] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-09-15T18:11:30.057923] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-09-15T18:11:30.127628] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T18:11:30.188325] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-15T18:11:30.857954] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-09-15T18:11:31.534033] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T18:11:31.657866] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-09-15T18:11:32.325167] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T18:11:32.457828] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-09-15T18:11:33.167955] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-15T18:11:33.257887] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-09-15T18:11:33.766264] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T18:11:34.057875] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-09-15T18:11:34.115107] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-15T18:11:34.119321] [INFO ] [REMOTE ] EB: Full fetch complete (41551 records). [2025-09-15T18:11:34.119427] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-09-15T18:11:34.527192] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-09-15T18:11:34.527331] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-09-15T18:11:34.528304] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-09-15T18:11:34.528369] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-09-15T18:11:34.530112] [DEBUG] [LOCAL ] EB: Trimmed 41551 records to 26972 (keeping 150 days of data) [2025-09-15T18:11:34.695188] [DEBUG] [LOCAL ] EB: Primary data saved (26972 records). [2025-09-15T18:11:34.695374] [INFO ] [MAIN ] EB: Full history saved. [2025-09-15T18:11:34.695480] [INFO ] [MAIN ] Update Progress: 678/2369 symbols completed. EB took 26.9s. Estimated remaining: 2h 58m 23s. Rate: 9.5 symbols/min [2025-09-15T18:11:34.857865] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-09-15T18:11:35.069334] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T18:11:35.657873] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-09-15T18:11:36.130124] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-15T18:11:36.457927] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-09-15T18:11:36.538286] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-15T18:11:36.540681] [INFO ] [REMOTE ] EBF: Full fetch complete (21461 records). [2025-09-15T18:11:36.540757] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-09-15T18:11:36.915420] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-09-15T18:11:36.915552] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-09-15T18:11:36.916021] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-09-15T18:11:36.916064] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-09-15T18:11:36.916632] [DEBUG] [LOCAL ] EBF: Trimmed 21461 records to 13862 (keeping 150 days of data) [2025-09-15T18:11:37.008925] [DEBUG] [LOCAL ] EBF: Primary data saved (13862 records). [2025-09-15T18:11:37.009097] [INFO ] [MAIN ] EBF: Full history saved. [2025-09-15T18:11:37.009189] [INFO ] [MAIN ] Update Progress: 679/2369 symbols completed. EBF took 26.7s. Estimated remaining: 2h 58m 7s. Rate: 9.5 symbols/min [2025-09-15T18:11:38.148626] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-15T18:11:38.158145] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-09-15T18:11:39.596885] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-15T18:11:39.602057] [INFO ] [REMOTE ] EBR: Full fetch complete (46449 records). [2025-09-15T18:11:39.602174] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-09-15T18:11:39.987353] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-09-15T18:11:39.987435] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-09-15T18:11:39.988115] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-09-15T18:11:39.988157] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-09-15T18:11:39.989139] [DEBUG] [LOCAL ] EBR: Trimmed 46449 records to 31335 (keeping 150 days of data) [2025-09-15T18:11:40.177483] [DEBUG] [LOCAL ] EBR: Primary data saved (31335 records). [2025-09-15T18:11:40.177628] [INFO ] [MAIN ] EBR: Full history saved. [2025-09-15T18:11:40.178546] [INFO ] [MAIN ] Update Progress: 680/2369 symbols completed. EBR took 16.6s. Estimated remaining: 2h 57m 53s. Rate: 9.5 symbols/min [2025-09-15T18:11:40.959362] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:11:40.924536] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:11:40.965298] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:11:40.984565] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:11:41.006536] [DEBUG] [LOCAL ] ECAT: Loaded 21834 existing records from primary storage. [2025-09-15T18:11:41.016064] [INFO ] [MAIN ] ECAT: Loaded 21834 existing records. [2025-09-15T18:11:41.165342] [DEBUG] [LOCAL ] EBS: Loaded 35421 existing records from primary storage. [2025-09-15T18:11:41.166023] [DEBUG] [LOCAL ] EC: Loaded 36834 existing records from primary storage. [2025-09-15T18:11:41.166612] [INFO ] [MAIN ] EBS: Loaded 35421 existing records. [2025-09-15T18:11:41.171963] [INFO ] [MAIN ] EC: Loaded 36834 existing records. [2025-09-15T18:11:41.350968] [DEBUG] [LOCAL ] ECC: Loaded 32304 existing records from primary storage. [2025-09-15T18:11:41.375009] [INFO ] [MAIN ] ECC: Loaded 32304 existing records. [2025-09-15T18:11:41.531578] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:11:41.648327] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-09-15T18:11:41.715505] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:11:41.717411] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-09-15T18:11:41.737528] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-09-15T18:11:41.754939] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-09-15T18:11:41.754793] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-09-15T18:11:41.755230] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-09-15T18:11:41.774595] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-09-15T18:11:41.784435] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:11:41.820442] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-09-15T18:11:41.845210] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-09-15T18:11:41.896287] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-09-15T18:11:42.046904] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:11:42.038247] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-09-15T18:11:42.058282] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-09-15T18:11:42.058194] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-09-15T18:11:42.079320] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-09-15T18:11:42.104672] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-09-15T18:11:42.115231] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-09-15T18:11:43.093261] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:11:43.159909] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-09-15T18:11:43.316962] [INFO ] [REMOTE ] EBS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:11:43.374116] [INFO ] [REMOTE ] EC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:11:43.369163] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-09-15T18:11:43.355873] [INFO ] [REMOTE ] ECC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:11:43.375914] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-09-15T18:11:43.377035] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-09-15T18:11:44.529988] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T18:11:44.536164] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-09-15T18:11:44.663483] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-15T18:11:44.671155] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-09-15T18:11:44.751042] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T18:11:44.761040] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-09-15T18:11:44.970191] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T18:11:44.979178] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-09-15T18:11:45.923000] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-15T18:11:45.933148] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-09-15T18:11:45.955140] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-15T18:11:45.962247] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-09-15T18:11:46.239467] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-15T18:11:46.249616] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-09-15T18:11:46.437393] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T18:11:46.857894] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-09-15T18:11:47.160051] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T18:11:47.387180] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T18:11:47.657942] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-09-15T18:11:47.819735] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T18:11:48.332510] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T18:11:48.457908] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-09-15T18:11:48.973654] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T18:11:49.257933] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-09-15T18:11:49.587271] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-15T18:11:50.057948] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-09-15T18:11:50.814864] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T18:11:50.857817] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-09-15T18:11:51.641819] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T18:11:51.657823] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-09-15T18:11:52.367996] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-15T18:11:52.457881] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-09-15T18:11:53.257918] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-09-15T18:11:53.429863] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-15T18:11:53.812016] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T18:11:54.057865] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-09-15T18:11:54.857913] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-09-15T18:11:55.008784] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-15T18:11:55.657909] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-09-15T18:11:55.849941] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-15T18:11:56.256711] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-15T18:11:56.457878] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-09-15T18:11:57.257899] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-09-15T18:11:57.282173] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-15T18:11:57.397546] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-15T18:11:58.057862] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-09-15T18:11:58.807892] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T18:11:58.857829] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-09-15T18:11:59.438690] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-15T18:11:59.443715] [INFO ] [REMOTE ] EBS: Full fetch complete (51085 records). [2025-09-15T18:11:59.443840] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-09-15T18:11:59.666256] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-09-15T18:11:59.824961] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-09-15T18:11:59.825046] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-09-15T18:11:59.825879] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-09-15T18:11:59.825936] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-09-15T18:11:59.827133] [DEBUG] [LOCAL ] EBS: Trimmed 51085 records to 34806 (keeping 150 days of data) [2025-09-15T18:12:00.035916] [DEBUG] [LOCAL ] EBS: Primary data saved (34806 records). [2025-09-15T18:12:00.036093] [INFO ] [MAIN ] EBS: Full history saved. [2025-09-15T18:12:00.036202] [INFO ] [MAIN ] Update Progress: 681/2369 symbols completed. EBS took 19.9s. Estimated remaining: 2h 58m 20s. Rate: 9.5 symbols/min [2025-09-15T18:12:00.218134] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:12:00.218356] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-09-15T18:12:00.218400] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-09-15T18:12:00.218552] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-09-15T18:12:00.218594] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-15T18:12:00.218633] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-15T18:12:00.218687] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-09-15T18:12:00.462985] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-09-15T18:12:00.576722] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:12:00.607437] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-15T18:12:00.926848] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T18:12:01.257932] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-09-15T18:12:02.057877] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-09-15T18:12:02.351209] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-15T18:12:02.857878] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-09-15T18:12:03.321846] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-15T18:12:03.326996] [INFO ] [REMOTE ] ECC: Full fetch complete (46701 records). [2025-09-15T18:12:03.327116] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-09-15T18:12:03.668187] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-09-15T18:12:03.707474] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-09-15T18:12:03.707543] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-09-15T18:12:03.708206] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-09-15T18:12:03.708251] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-09-15T18:12:03.709436] [DEBUG] [LOCAL ] ECC: Trimmed 46701 records to 31558 (keeping 150 days of data) [2025-09-15T18:12:03.905133] [DEBUG] [LOCAL ] ECC: Primary data saved (31558 records). [2025-09-15T18:12:03.905315] [INFO ] [MAIN ] ECC: Full history saved. [2025-09-15T18:12:03.906566] [INFO ] [MAIN ] Update Progress: 682/2369 symbols completed. ECC took 23.7s. Estimated remaining: 2h 58m 7s. Rate: 9.5 symbols/min [2025-09-15T18:12:04.078599] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:12:04.082792] [DEBUG] [LOCAL ] ECCU: Loaded 1685 existing records from primary storage. [2025-09-15T18:12:04.082882] [INFO ] [MAIN ] ECCU: Loaded 1685 existing records. [2025-09-15T18:12:04.267422] [WARN ] [MAIN ] ECCU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:12:04.267708] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-09-15T18:12:04.267756] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-15T18:12:04.267965] [DEBUG] [LOCAL ] ECCU: Deleted primary data file. [2025-09-15T18:12:04.268011] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-09-15T18:12:04.351701] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-15T18:12:04.477899] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-09-15T18:12:04.666815] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:12:04.976257] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-15T18:12:04.998229] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-15T18:12:05.003877] [INFO ] [REMOTE ] EC: Full fetch complete (53998 records). [2025-09-15T18:12:05.004055] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-09-15T18:12:05.264283] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-09-15T18:12:05.402730] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-09-15T18:12:05.402845] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-09-15T18:12:05.403596] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-09-15T18:12:05.403658] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-09-15T18:12:05.404998] [DEBUG] [LOCAL ] EC: Trimmed 53998 records to 36092 (keeping 150 days of data) [2025-09-15T18:12:05.631981] [DEBUG] [LOCAL ] EC: Primary data saved (36092 records). [2025-09-15T18:12:05.632149] [INFO ] [MAIN ] EC: Full history saved. [2025-09-15T18:12:05.632292] [INFO ] [MAIN ] Update Progress: 683/2369 symbols completed. EC took 25.5s. Estimated remaining: 2h 57m 50s. Rate: 9.5 symbols/min [2025-09-15T18:12:05.810084] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:12:05.810306] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-09-15T18:12:05.810358] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-09-15T18:12:05.810482] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-09-15T18:12:05.810522] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-15T18:12:05.810574] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-15T18:12:05.810625] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-09-15T18:12:05.915638] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-15T18:12:05.970383] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-09-15T18:12:05.995320] [INFO ] [REMOTE ] ECAT: Full fetch complete (32295 records). [2025-09-15T18:12:06.023197] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-09-15T18:12:06.063019] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-09-15T18:12:06.518461] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:12:06.741837] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-15T18:12:06.833492] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-09-15T18:12:06.833698] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-09-15T18:12:06.835558] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-09-15T18:12:06.835771] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-09-15T18:12:06.837495] [DEBUG] [LOCAL ] ECAT: Trimmed 32295 records to 21685 (keeping 150 days of data) [2025-09-15T18:12:06.913393] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-09-15T18:12:07.033625] [DEBUG] [LOCAL ] ECAT: Primary data saved (21685 records). [2025-09-15T18:12:07.033906] [INFO ] [MAIN ] ECAT: Full history saved. [2025-09-15T18:12:07.034084] [INFO ] [MAIN ] Update Progress: 684/2369 symbols completed. ECAT took 26.9s. Estimated remaining: 2h 57m 31s. Rate: 9.5 symbols/min [2025-09-15T18:12:07.281616] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:12:07.281908] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-09-15T18:12:07.281951] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-09-15T18:12:07.282098] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-09-15T18:12:07.282168] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-15T18:12:07.282214] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-15T18:12:07.282250] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-09-15T18:12:07.606148] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-15T18:12:07.661232] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-09-15T18:12:07.687953] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:12:07.961952] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-15T18:12:08.457952] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-09-15T18:12:08.877904] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-15T18:12:09.258035] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-09-15T18:12:09.667709] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-15T18:12:10.057943] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-09-15T18:12:10.393977] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-15T18:12:10.857896] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-09-15T18:12:11.329785] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-15T18:12:11.657888] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-09-15T18:12:11.967785] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-15T18:12:12.457923] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-09-15T18:12:12.947617] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-15T18:12:13.257916] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-09-15T18:12:13.725564] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-15T18:12:14.057875] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-09-15T18:12:14.857884] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-09-15T18:12:14.868231] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-15T18:12:15.657890] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-09-15T18:12:15.862133] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-15T18:12:15.947579] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-15T18:12:16.457911] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-09-15T18:12:16.985361] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-15T18:12:17.257924] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-09-15T18:12:17.596358] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-15T18:12:18.057878] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-09-15T18:12:18.499046] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-15T18:12:18.857891] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-09-15T18:12:19.302109] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-15T18:12:19.302919] [INFO ] [REMOTE ] ECCC: Full fetch complete (965 records). [2025-09-15T18:12:19.302991] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-09-15T18:12:19.500321] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-15T18:12:19.500593] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:12:19.500689] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:12:19.500846] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-15T18:12:19.500929] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-15T18:12:19.500976] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-09-15T18:12:19.501028] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-09-15T18:12:19.501094] [INFO ] [MAIN ] Update Progress: 685/2369 symbols completed. ECCC took 19.5s. Estimated remaining: 2h 57m 40s. Rate: 9.5 symbols/min [2025-09-15T18:12:19.663055] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-09-15T18:12:19.685802] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:12:19.711053] [DEBUG] [LOCAL ] ECG: Loaded 24863 existing records from primary storage. [2025-09-15T18:12:19.711227] [INFO ] [MAIN ] ECG: Loaded 24863 existing records. [2025-09-15T18:12:19.899495] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:12:19.899788] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-09-15T18:12:19.899837] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-09-15T18:12:19.900491] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-09-15T18:12:19.900541] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-09-15T18:12:20.192799] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-15T18:12:20.273412] [INFO ] [REMOTE ] ECG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:12:20.457881] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-09-15T18:12:21.257889] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-09-15T18:12:21.731210] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-15T18:12:21.759862] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-15T18:12:22.057864] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-09-15T18:12:22.304224] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-09-15T18:12:22.857868] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-09-15T18:12:23.293390] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-15T18:12:23.294243] [INFO ] [REMOTE ] ECCX: Full fetch complete (1151 records). [2025-09-15T18:12:23.294344] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-09-15T18:12:23.476177] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-15T18:12:23.476385] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:12:23.476437] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:12:23.476486] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-15T18:12:23.476546] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-15T18:12:23.476584] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-09-15T18:12:23.476626] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-09-15T18:12:23.476707] [INFO ] [MAIN ] Update Progress: 686/2369 symbols completed. ECCX took 16.4s. Estimated remaining: 2h 57m 28s. Rate: 9.5 symbols/min [2025-09-15T18:12:23.654352] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:12:23.657858] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-09-15T18:12:23.699962] [DEBUG] [LOCAL ] ECL: Loaded 34722 existing records from primary storage. [2025-09-15T18:12:23.700138] [INFO ] [MAIN ] ECL: Loaded 34722 existing records. [2025-09-15T18:12:23.883937] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:12:23.884198] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-09-15T18:12:23.884245] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-09-15T18:12:23.885045] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-09-15T18:12:23.885099] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-09-15T18:12:24.162909] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-15T18:12:24.252897] [INFO ] [REMOTE ] ECL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:12:24.457878] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-09-15T18:12:24.738573] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-15T18:12:25.257910] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-09-15T18:12:26.057922] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-09-15T18:12:26.469816] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-15T18:12:26.470966] [INFO ] [REMOTE ] ECCU: Full fetch complete (3202 records). [2025-09-15T18:12:26.471053] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-09-15T18:12:26.870394] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-09-15T18:12:26.882003] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T18:12:26.883321] [DEBUG] [VALIDATOR ] ECCU: All expected trading days are present. [2025-09-15T18:12:26.892801] [DEBUG] [VALIDATOR ] ECCU: Primary data validation passed. [2025-09-15T18:12:26.893787] [INFO ] [MAIN ] ECCU: Fetched primary data is valid. [2025-09-15T18:12:26.893886] [DEBUG] [LOCAL ] ECCU: Saving primary data. [2025-09-15T18:12:26.894733] [DEBUG] [LOCAL ] ECCU: Trimmed 3202 records to 1672 (keeping 150 days of data) [2025-09-15T18:12:26.906963] [DEBUG] [LOCAL ] ECCU: Primary data saved (1672 records). [2025-09-15T18:12:26.907112] [INFO ] [MAIN ] ECCU: Full history saved. [2025-09-15T18:12:26.907225] [INFO ] [MAIN ] Update Progress: 687/2369 symbols completed. ECCU took 23.0s. Estimated remaining: 2h 57m 14s. Rate: 9.5 symbols/min [2025-09-15T18:12:27.081895] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:12:27.099695] [DEBUG] [LOCAL ] ECO: Loaded 13176 existing records from primary storage. [2025-09-15T18:12:27.099857] [INFO ] [MAIN ] ECO: Loaded 13176 existing records. [2025-09-15T18:12:27.278678] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:12:27.278939] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-09-15T18:12:27.278984] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-09-15T18:12:27.279455] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-09-15T18:12:27.279501] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-09-15T18:12:27.666098] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-09-15T18:12:27.671519] [INFO ] [REMOTE ] ECO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:12:28.026694] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-15T18:12:28.457875] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-09-15T18:12:28.548364] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T18:12:29.257911] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-09-15T18:12:29.570084] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-15T18:12:30.039507] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T18:12:30.057902] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-09-15T18:12:30.858024] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-09-15T18:12:31.193222] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-15T18:12:31.512127] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T18:12:31.657921] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-09-15T18:12:32.457903] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-09-15T18:12:32.599526] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T18:12:32.876235] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-15T18:12:33.257905] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-09-15T18:12:34.057867] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-09-15T18:12:34.295776] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-15T18:12:34.857887] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-09-15T18:12:35.369014] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-15T18:12:35.369774] [INFO ] [REMOTE ] ECCW: Full fetch complete (1185 records). [2025-09-15T18:12:35.369848] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-09-15T18:12:35.545037] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 144 unique days, need 150 days [2025-09-15T18:12:35.545223] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:12:35.545263] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:12:35.545303] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-15T18:12:35.545381] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-15T18:12:35.545432] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-09-15T18:12:35.545475] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-09-15T18:12:35.545531] [INFO ] [MAIN ] Update Progress: 688/2369 symbols completed. ECCW took 29.9s. Estimated remaining: 2h 57m 14s. Rate: 9.5 symbols/min [2025-09-15T18:12:35.662928] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-09-15T18:12:35.750802] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:12:35.783235] [DEBUG] [LOCAL ] ECVT: Loaded 32268 existing records from primary storage. [2025-09-15T18:12:35.783420] [INFO ] [MAIN ] ECVT: Loaded 32268 existing records. [2025-09-15T18:12:35.969418] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:12:35.969852] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-09-15T18:12:35.970007] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-09-15T18:12:35.979410] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-09-15T18:12:35.995681] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-09-15T18:12:36.045946] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-15T18:12:36.358176] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:12:36.457833] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-09-15T18:12:36.484188] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-15T18:12:37.257877] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-09-15T18:12:37.860600] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-15T18:12:37.938346] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-15T18:12:38.057878] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-09-15T18:12:38.857879] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-09-15T18:12:38.948090] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-15T18:12:39.657870] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-09-15T18:12:39.847636] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-15T18:12:40.318894] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-15T18:12:40.457870] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-09-15T18:12:41.257921] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-09-15T18:12:41.562802] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-15T18:12:42.057876] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-09-15T18:12:42.308221] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-15T18:12:42.857852] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-09-15T18:12:43.158415] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-15T18:12:43.657893] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-09-15T18:12:44.162561] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-15T18:12:44.457939] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-09-15T18:12:44.685057] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-15T18:12:45.257913] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-09-15T18:12:45.810951] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T18:12:46.057890] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-09-15T18:12:46.784732] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-15T18:12:46.857874] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-09-15T18:12:47.535004] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T18:12:47.654371] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-15T18:12:47.657450] [INFO ] [REMOTE ] ECO: Full fetch complete (20673 records). [2025-09-15T18:12:47.657778] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-09-15T18:12:47.657855] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-09-15T18:12:48.023088] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-09-15T18:12:48.023172] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-09-15T18:12:48.023714] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-09-15T18:12:48.023773] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-09-15T18:12:48.024920] [DEBUG] [LOCAL ] ECO: Trimmed 20673 records to 13055 (keeping 150 days of data) [2025-09-15T18:12:48.109016] [DEBUG] [LOCAL ] ECO: Primary data saved (13055 records). [2025-09-15T18:12:48.109175] [INFO ] [MAIN ] ECO: Full history saved. [2025-09-15T18:12:48.109273] [INFO ] [MAIN ] Update Progress: 689/2369 symbols completed. ECO took 21.2s. Estimated remaining: 2h 57m 23s. Rate: 9.5 symbols/min [2025-09-15T18:12:48.297292] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:12:48.354264] [DEBUG] [LOCAL ] ED: Loaded 39716 existing records from primary storage. [2025-09-15T18:12:48.354511] [INFO ] [MAIN ] ED: Loaded 39716 existing records. [2025-09-15T18:12:48.463108] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-09-15T18:12:48.569634] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:12:48.570107] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-09-15T18:12:48.570175] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-09-15T18:12:48.571376] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-09-15T18:12:48.571449] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-09-15T18:12:48.988939] [INFO ] [REMOTE ] ED: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:12:49.132616] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-15T18:12:49.257963] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-09-15T18:12:49.922263] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T18:12:49.925870] [INFO ] [REMOTE ] ECG: Full fetch complete (38919 records). [2025-09-15T18:12:49.925956] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-09-15T18:12:50.068089] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-09-15T18:12:50.298541] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-09-15T18:12:50.298625] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-09-15T18:12:50.299244] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-09-15T18:12:50.299287] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-09-15T18:12:50.300116] [DEBUG] [LOCAL ] ECG: Trimmed 38919 records to 24130 (keeping 150 days of data) [2025-09-15T18:12:50.450712] [DEBUG] [LOCAL ] ECG: Primary data saved (24130 records). [2025-09-15T18:12:50.450850] [INFO ] [MAIN ] ECG: Full history saved. [2025-09-15T18:12:50.450981] [INFO ] [MAIN ] Update Progress: 690/2369 symbols completed. ECG took 30.9s. Estimated remaining: 2h 57m 7s. Rate: 9.5 symbols/min [2025-09-15T18:12:50.619329] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:12:50.639293] [DEBUG] [LOCAL ] EDD: Loaded 20453 existing records from primary storage. [2025-09-15T18:12:50.639421] [INFO ] [MAIN ] EDD: Loaded 20453 existing records. [2025-09-15T18:12:50.818420] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:12:50.818798] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-09-15T18:12:50.818867] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-09-15T18:12:50.819468] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-09-15T18:12:50.819516] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-09-15T18:12:50.881621] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-09-15T18:12:51.182039] [INFO ] [REMOTE ] EDD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:12:51.198289] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-15T18:12:51.204536] [INFO ] [REMOTE ] ECL: Full fetch complete (50926 records). [2025-09-15T18:12:51.204731] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-09-15T18:12:51.601848] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-09-15T18:12:51.602012] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-09-15T18:12:51.603465] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-09-15T18:12:51.603558] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-09-15T18:12:51.605415] [DEBUG] [LOCAL ] ECL: Trimmed 50926 records to 33964 (keeping 150 days of data) [2025-09-15T18:12:51.674626] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-09-15T18:12:51.867154] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-15T18:12:51.893504] [DEBUG] [LOCAL ] ECL: Primary data saved (33964 records). [2025-09-15T18:12:51.893779] [INFO ] [MAIN ] ECL: Full history saved. [2025-09-15T18:12:51.894987] [INFO ] [MAIN ] Update Progress: 691/2369 symbols completed. ECL took 28.4s. Estimated remaining: 2h 56m 48s. Rate: 9.5 symbols/min [2025-09-15T18:12:52.072315] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:12:52.089951] [DEBUG] [LOCAL ] EDF: Loaded 9711 existing records from primary storage. [2025-09-15T18:12:52.090136] [INFO ] [MAIN ] EDF: Loaded 9711 existing records. [2025-09-15T18:12:52.271412] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:12:52.271781] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-09-15T18:12:52.271830] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-09-15T18:12:52.272205] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-09-15T18:12:52.272253] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-09-15T18:12:52.472829] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-09-15T18:12:52.642814] [INFO ] [REMOTE ] EDF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:12:52.659528] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-15T18:12:52.699182] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-15T18:12:53.257911] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-09-15T18:12:54.056080] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T18:12:54.068324] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-09-15T18:12:54.450170] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-15T18:12:54.857888] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-09-15T18:12:55.135282] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-15T18:12:55.657867] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-09-15T18:12:56.467575] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-09-15T18:12:56.473722] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-15T18:12:56.560920] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T18:12:57.257914] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-09-15T18:12:57.950217] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T18:12:58.057852] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-09-15T18:12:58.385895] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-15T18:12:58.857908] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-09-15T18:12:59.446424] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-15T18:12:59.657980] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-09-15T18:13:00.038157] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-15T18:13:00.457953] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-09-15T18:13:01.257959] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-09-15T18:13:01.378050] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-15T18:13:01.428415] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-15T18:13:02.057877] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-09-15T18:13:02.771673] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-15T18:13:02.857942] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-09-15T18:13:02.951717] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-15T18:13:03.440476] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-15T18:13:03.657919] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-09-15T18:13:04.457908] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-09-15T18:13:04.704624] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-15T18:13:05.257937] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-09-15T18:13:05.304156] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-15T18:13:06.057877] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-09-15T18:13:06.689102] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T18:13:06.694684] [INFO ] [REMOTE ] ECVT: Full fetch complete (46200 records). [2025-09-15T18:13:06.694838] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-09-15T18:13:06.858692] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-09-15T18:13:07.139845] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-09-15T18:13:07.139935] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-09-15T18:13:07.140607] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-09-15T18:13:07.140678] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-09-15T18:13:07.141813] [DEBUG] [LOCAL ] ECVT: Trimmed 46200 records to 31664 (keeping 150 days of data) [2025-09-15T18:13:07.350871] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-15T18:13:07.372142] [DEBUG] [LOCAL ] ECVT: Primary data saved (31664 records). [2025-09-15T18:13:07.372303] [INFO ] [MAIN ] ECVT: Full history saved. [2025-09-15T18:13:07.372425] [INFO ] [MAIN ] Update Progress: 692/2369 symbols completed. ECVT took 31.8s. Estimated remaining: 2h 57m 4s. Rate: 9.5 symbols/min [2025-09-15T18:13:07.540418] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:13:07.555123] [DEBUG] [LOCAL ] EDN: Loaded 13165 existing records from primary storage. [2025-09-15T18:13:07.555251] [INFO ] [MAIN ] EDN: Loaded 13165 existing records. [2025-09-15T18:13:07.663812] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-09-15T18:13:07.746150] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:13:07.746464] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-09-15T18:13:07.746668] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-09-15T18:13:07.752292] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-09-15T18:13:07.757457] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-09-15T18:13:07.805289] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T18:13:08.147639] [INFO ] [REMOTE ] EDN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:13:08.457964] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-09-15T18:13:09.037477] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T18:13:09.257923] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-09-15T18:13:09.464494] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T18:13:10.057862] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-09-15T18:13:10.698512] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T18:13:10.857882] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-09-15T18:13:11.077066] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T18:13:11.080593] [INFO ] [REMOTE ] EDD: Full fetch complete (29747 records). [2025-09-15T18:13:11.080692] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-09-15T18:13:11.451031] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-09-15T18:13:11.451124] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-09-15T18:13:11.451672] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-09-15T18:13:11.451724] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-09-15T18:13:11.460554] [DEBUG] [LOCAL ] EDD: Trimmed 29747 records to 19939 (keeping 150 days of data) [2025-09-15T18:13:11.460434] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-15T18:13:11.581490] [DEBUG] [LOCAL ] EDD: Primary data saved (19939 records). [2025-09-15T18:13:11.581682] [INFO ] [MAIN ] EDD: Full history saved. [2025-09-15T18:13:11.581776] [INFO ] [MAIN ] Update Progress: 693/2369 symbols completed. EDD took 21.1s. Estimated remaining: 2h 56m 53s. Rate: 9.5 symbols/min [2025-09-15T18:13:11.663089] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-09-15T18:13:11.758344] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:13:11.789479] [DEBUG] [LOCAL ] EDU: Loaded 33261 existing records from primary storage. [2025-09-15T18:13:11.789633] [INFO ] [MAIN ] EDU: Loaded 33261 existing records. [2025-09-15T18:13:11.967897] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:13:11.968201] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-09-15T18:13:11.968306] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-09-15T18:13:11.969219] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-09-15T18:13:11.969280] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-09-15T18:13:12.330931] [INFO ] [REMOTE ] EDU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:13:12.458019] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-09-15T18:13:12.938735] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T18:13:13.257966] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-09-15T18:13:14.036756] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T18:13:14.057823] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-09-15T18:13:14.295981] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-15T18:13:14.857965] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-09-15T18:13:15.514175] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T18:13:15.520566] [INFO ] [REMOTE ] ED: Full fetch complete (57404 records). [2025-09-15T18:13:15.520798] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-09-15T18:13:15.661093] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-09-15T18:13:15.845922] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-15T18:13:15.963248] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-09-15T18:13:15.963333] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-09-15T18:13:15.964104] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-09-15T18:13:15.964150] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-09-15T18:13:15.965455] [DEBUG] [LOCAL ] ED: Trimmed 57404 records to 38957 (keeping 150 days of data) [2025-09-15T18:13:16.219798] [DEBUG] [LOCAL ] ED: Primary data saved (38957 records). [2025-09-15T18:13:16.219950] [INFO ] [MAIN ] ED: Full history saved. [2025-09-15T18:13:16.220688] [INFO ] [MAIN ] Update Progress: 694/2369 symbols completed. ED took 28.1s. Estimated remaining: 2h 56m 42s. Rate: 9.5 symbols/min [2025-09-15T18:13:16.391117] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:13:16.415002] [DEBUG] [LOCAL ] EE: Loaded 24503 existing records from primary storage. [2025-09-15T18:13:16.415136] [INFO ] [MAIN ] EE: Loaded 24503 existing records. [2025-09-15T18:13:16.468723] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-09-15T18:13:16.545842] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-15T18:13:16.604491] [INFO ] [REMOTE ] EDF: Full fetch complete (15235 records). [2025-09-15T18:13:16.604624] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:13:16.604875] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-09-15T18:13:16.605225] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-09-15T18:13:16.605315] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-09-15T18:13:16.674620] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-09-15T18:13:16.680245] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-09-15T18:13:17.267846] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-09-15T18:13:17.333999] [INFO ] [REMOTE ] EE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:13:17.337270] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-09-15T18:13:17.337459] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-09-15T18:13:17.338145] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-09-15T18:13:17.338266] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-09-15T18:13:17.353534] [DEBUG] [LOCAL ] EDF: Trimmed 15235 records to 9497 (keeping 150 days of data) [2025-09-15T18:13:17.356078] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-15T18:13:17.418341] [DEBUG] [LOCAL ] EDF: Primary data saved (9497 records). [2025-09-15T18:13:17.418488] [INFO ] [MAIN ] EDF: Full history saved. [2025-09-15T18:13:17.418586] [INFO ] [MAIN ] Update Progress: 695/2369 symbols completed. EDF took 25.5s. Estimated remaining: 2h 56m 24s. Rate: 9.5 symbols/min [2025-09-15T18:13:17.630588] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:13:17.634407] [DEBUG] [LOCAL ] EEA: Loaded 2030 existing records from primary storage. [2025-09-15T18:13:17.634475] [INFO ] [MAIN ] EEA: Loaded 2030 existing records. [2025-09-15T18:13:17.810177] [WARN ] [MAIN ] EEA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:13:17.810437] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-09-15T18:13:17.810483] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-15T18:13:17.810691] [DEBUG] [LOCAL ] EEA: Deleted primary data file. [2025-09-15T18:13:17.810739] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-09-15T18:13:18.063103] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-09-15T18:13:18.167352] [INFO ] [REMOTE ] EEA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:13:18.857860] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-09-15T18:13:18.948294] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T18:13:19.359702] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-15T18:13:19.457508] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-15T18:13:19.657904] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-09-15T18:13:20.457900] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-09-15T18:13:20.578620] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-15T18:13:21.257851] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-09-15T18:13:21.452044] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-15T18:13:21.773867] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-15T18:13:22.057865] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-09-15T18:13:22.857898] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-09-15T18:13:23.662831] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-09-15T18:13:23.669878] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T18:13:23.876784] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-15T18:13:24.457984] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-09-15T18:13:25.147393] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T18:13:25.257902] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-09-15T18:13:25.546989] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-15T18:13:25.549858] [INFO ] [REMOTE ] EDN: Full fetch complete (19698 records). [2025-09-15T18:13:25.549936] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-09-15T18:13:25.854475] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-15T18:13:25.929914] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-09-15T18:13:25.930023] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-09-15T18:13:25.930491] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-09-15T18:13:25.930535] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-09-15T18:13:25.931344] [DEBUG] [LOCAL ] EDN: Trimmed 19698 records to 12886 (keeping 150 days of data) [2025-09-15T18:13:26.007804] [DEBUG] [LOCAL ] EDN: Primary data saved (12886 records). [2025-09-15T18:13:26.007955] [INFO ] [MAIN ] EDN: Full history saved. [2025-09-15T18:13:26.008042] [INFO ] [MAIN ] Update Progress: 696/2369 symbols completed. EDN took 18.6s. Estimated remaining: 2h 56m 23s. Rate: 9.5 symbols/min [2025-09-15T18:13:26.063067] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-09-15T18:13:26.178281] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:13:26.188099] [DEBUG] [LOCAL ] EEX: Loaded 7466 existing records from primary storage. [2025-09-15T18:13:26.188226] [INFO ] [MAIN ] EEX: Loaded 7466 existing records. [2025-09-15T18:13:26.362323] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:13:26.362594] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-09-15T18:13:26.362676] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-09-15T18:13:26.363015] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-09-15T18:13:26.363061] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-09-15T18:13:26.724655] [INFO ] [REMOTE ] EEX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:13:26.857860] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-09-15T18:13:27.388085] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T18:13:27.599751] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-15T18:13:27.657853] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-09-15T18:13:28.457879] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-09-15T18:13:29.257887] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-09-15T18:13:29.423606] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T18:13:29.489486] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-15T18:13:29.672479] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-15T18:13:30.057927] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-09-15T18:13:30.522725] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-15T18:13:30.857870] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-09-15T18:13:31.304417] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-15T18:13:31.657864] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-09-15T18:13:32.457836] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-09-15T18:13:32.588750] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-15T18:13:33.257867] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-09-15T18:13:33.937574] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T18:13:34.057859] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-09-15T18:13:34.206839] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-15T18:13:34.857865] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-09-15T18:13:35.047698] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-15T18:13:35.630579] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-15T18:13:35.657899] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-09-15T18:13:36.306767] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-15T18:13:36.457879] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-09-15T18:13:36.929693] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-15T18:13:37.257874] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-09-15T18:13:37.737378] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-15T18:13:37.738551] [INFO ] [REMOTE ] EEA: Full fetch complete (3047 records). [2025-09-15T18:13:37.738666] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-09-15T18:13:38.062982] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-09-15T18:13:38.139873] [DEBUG] [VALIDATOR ] EEA: All expected trading days are present. [2025-09-15T18:13:38.139962] [DEBUG] [VALIDATOR ] EEA: Primary data validation passed. [2025-09-15T18:13:38.140106] [INFO ] [MAIN ] EEA: Fetched primary data is valid. [2025-09-15T18:13:38.140156] [DEBUG] [LOCAL ] EEA: Saving primary data. [2025-09-15T18:13:38.140520] [DEBUG] [LOCAL ] EEA: Trimmed 3047 records to 1980 (keeping 150 days of data) [2025-09-15T18:13:38.153293] [DEBUG] [LOCAL ] EEA: Primary data saved (1980 records). [2025-09-15T18:13:38.153355] [INFO ] [MAIN ] EEA: Full history saved. [2025-09-15T18:13:38.153424] [INFO ] [MAIN ] Update Progress: 697/2369 symbols completed. EEA took 20.7s. Estimated remaining: 2h 56m 30s. Rate: 9.5 symbols/min [2025-09-15T18:13:38.332532] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:13:38.370542] [DEBUG] [LOCAL ] EFC: Loaded 34360 existing records from primary storage. [2025-09-15T18:13:38.370703] [INFO ] [MAIN ] EFC: Loaded 34360 existing records. [2025-09-15T18:13:38.549039] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:13:38.549580] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-09-15T18:13:38.549629] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-09-15T18:13:38.550712] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-09-15T18:13:38.550771] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-09-15T18:13:38.871894] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-09-15T18:13:38.912458] [INFO ] [REMOTE ] EFC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:13:39.516903] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-15T18:13:39.563135] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-15T18:13:39.657840] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-09-15T18:13:40.366682] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-15T18:13:40.457877] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-09-15T18:13:41.141171] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T18:13:41.257925] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-09-15T18:13:41.893584] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-15T18:13:41.895635] [INFO ] [REMOTE ] EEX: Full fetch complete (13751 records). [2025-09-15T18:13:41.895750] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-09-15T18:13:42.063186] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-09-15T18:13:42.275586] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-09-15T18:13:42.275691] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-09-15T18:13:42.276024] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-09-15T18:13:42.276083] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-09-15T18:13:42.276614] [DEBUG] [LOCAL ] EEX: Trimmed 13751 records to 7231 (keeping 150 days of data) [2025-09-15T18:13:42.320098] [DEBUG] [LOCAL ] EEX: Primary data saved (7231 records). [2025-09-15T18:13:42.320233] [INFO ] [MAIN ] EEX: Full history saved. [2025-09-15T18:13:42.320333] [INFO ] [MAIN ] Update Progress: 698/2369 symbols completed. EEX took 16.3s. Estimated remaining: 2h 56m 19s. Rate: 9.5 symbols/min [2025-09-15T18:13:42.495959] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:13:42.509073] [DEBUG] [LOCAL ] EFR: Loaded 10568 existing records from primary storage. [2025-09-15T18:13:42.509246] [INFO ] [MAIN ] EFR: Loaded 10568 existing records. [2025-09-15T18:13:42.697605] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:13:42.697878] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-09-15T18:13:42.697924] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-09-15T18:13:42.698374] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-09-15T18:13:42.698422] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-09-15T18:13:42.859805] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-09-15T18:13:43.065133] [INFO ] [REMOTE ] EFR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:13:43.657944] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-09-15T18:13:43.763348] [DEBUG] [REMOTE ] EFR: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-15T18:13:43.763660] [WARN ] [REMOTE ] EFR: No data returned for month 2025-02 [2025-09-15T18:13:43.850215] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-15T18:13:44.457905] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-09-15T18:13:44.520687] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-15T18:13:45.257966] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-09-15T18:13:46.057897] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-09-15T18:13:46.136108] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T18:13:46.520386] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T18:13:46.721075] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-15T18:13:46.857887] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-09-15T18:13:47.657885] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-09-15T18:13:47.776894] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-15T18:13:48.457888] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-09-15T18:13:48.680293] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T18:13:48.685800] [INFO ] [REMOTE ] EDU: Full fetch complete (49881 records). [2025-09-15T18:13:48.685980] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-09-15T18:13:49.092536] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-09-15T18:13:49.092675] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-09-15T18:13:49.093409] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-09-15T18:13:49.093453] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-09-15T18:13:49.094683] [DEBUG] [LOCAL ] EDU: Trimmed 49881 records to 32550 (keeping 150 days of data) [2025-09-15T18:13:49.273309] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-09-15T18:13:49.297374] [DEBUG] [LOCAL ] EDU: Primary data saved (32550 records). [2025-09-15T18:13:49.297546] [INFO ] [MAIN ] EDU: Full history saved. [2025-09-15T18:13:49.297677] [INFO ] [MAIN ] Update Progress: 699/2369 symbols completed. EDU took 37.7s. Estimated remaining: 2h 56m 14s. Rate: 9.5 symbols/min [2025-09-15T18:13:49.466075] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:13:49.476309] [DEBUG] [LOCAL ] EFT: Loaded 9263 existing records from primary storage. [2025-09-15T18:13:49.476420] [INFO ] [MAIN ] EFT: Loaded 9263 existing records. [2025-09-15T18:13:49.655551] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:13:49.655868] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-09-15T18:13:49.655916] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-09-15T18:13:49.656215] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-09-15T18:13:49.656259] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-09-15T18:13:50.009671] [INFO ] [REMOTE ] EFT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:13:50.018437] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-15T18:13:50.057834] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-09-15T18:13:50.092856] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-15T18:13:50.581178] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-15T18:13:50.857930] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-09-15T18:13:51.574841] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-15T18:13:51.657883] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-09-15T18:13:52.457902] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-09-15T18:13:52.885408] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T18:13:53.257945] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-09-15T18:13:54.057895] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-09-15T18:13:54.234526] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-15T18:13:54.280511] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T18:13:54.857880] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-09-15T18:13:55.048411] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-15T18:13:55.657909] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-09-15T18:13:56.010115] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-15T18:13:56.457875] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-09-15T18:13:56.659905] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-15T18:13:56.663300] [INFO ] [REMOTE ] EE: Full fetch complete (34402 records). [2025-09-15T18:13:56.663376] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-09-15T18:13:57.043208] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-09-15T18:13:57.043365] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-09-15T18:13:57.044315] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-09-15T18:13:57.044436] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-09-15T18:13:57.046114] [DEBUG] [LOCAL ] EE: Trimmed 34402 records to 23948 (keeping 150 days of data) [2025-09-15T18:13:57.197596] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-15T18:13:57.207807] [DEBUG] [LOCAL ] EE: Primary data saved (23948 records). [2025-09-15T18:13:57.207883] [INFO ] [MAIN ] EE: Full history saved. [2025-09-15T18:13:57.207960] [INFO ] [MAIN ] Update Progress: 700/2369 symbols completed. EE took 41.0s. Estimated remaining: 2h 56m 12s. Rate: 9.5 symbols/min [2025-09-15T18:13:57.263733] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-09-15T18:13:57.391191] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:13:57.425552] [DEBUG] [LOCAL ] EFX: Loaded 33339 existing records from primary storage. [2025-09-15T18:13:57.425725] [INFO ] [MAIN ] EFX: Loaded 33339 existing records. [2025-09-15T18:13:57.601322] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:13:57.601584] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-09-15T18:13:57.601633] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-09-15T18:13:57.602422] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-09-15T18:13:57.602471] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-09-15T18:13:57.962795] [INFO ] [REMOTE ] EFX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:13:58.057854] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-09-15T18:13:58.292479] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-15T18:13:58.857972] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-09-15T18:13:59.645787] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-15T18:13:59.657833] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-09-15T18:14:00.006256] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-15T18:14:00.457891] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-09-15T18:14:01.212361] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T18:14:01.257836] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-09-15T18:14:02.057880] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-09-15T18:14:02.139704] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T18:14:02.639996] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-15T18:14:02.857873] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-09-15T18:14:03.053566] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-15T18:14:03.657926] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-09-15T18:14:03.695993] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-15T18:14:04.457905] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-09-15T18:14:05.023040] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-15T18:14:05.241350] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-15T18:14:05.257849] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-09-15T18:14:06.057868] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-09-15T18:14:06.171274] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-15T18:14:06.173275] [INFO ] [REMOTE ] EFT: Full fetch complete (13148 records). [2025-09-15T18:14:06.173552] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-09-15T18:14:06.539956] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-09-15T18:14:06.540050] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-09-15T18:14:06.540347] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-09-15T18:14:06.540388] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-09-15T18:14:06.540871] [DEBUG] [LOCAL ] EFT: Trimmed 13148 records to 9090 (keeping 150 days of data) [2025-09-15T18:14:06.597131] [DEBUG] [LOCAL ] EFT: Primary data saved (9090 records). [2025-09-15T18:14:06.597278] [INFO ] [MAIN ] EFT: Full history saved. [2025-09-15T18:14:06.597365] [INFO ] [MAIN ] Update Progress: 701/2369 symbols completed. EFT took 17.3s. Estimated remaining: 2h 56m 13s. Rate: 9.5 symbols/min [2025-09-15T18:14:06.766408] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:14:06.785715] [DEBUG] [LOCAL ] EFXT: Loaded 21439 existing records from primary storage. [2025-09-15T18:14:06.785833] [INFO ] [MAIN ] EFXT: Loaded 21439 existing records. [2025-09-15T18:14:06.863079] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-09-15T18:14:06.967226] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:14:06.967500] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-09-15T18:14:06.967560] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-09-15T18:14:06.968138] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-09-15T18:14:06.968191] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-09-15T18:14:07.336532] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:14:07.657920] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-09-15T18:14:07.704229] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-15T18:14:08.388578] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T18:14:08.394342] [INFO ] [REMOTE ] EFC: Full fetch complete (50146 records). [2025-09-15T18:14:08.394511] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-09-15T18:14:08.464600] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-09-15T18:14:08.793822] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-09-15T18:14:08.793916] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-09-15T18:14:08.794622] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-09-15T18:14:08.794762] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-09-15T18:14:08.795981] [DEBUG] [LOCAL ] EFC: Trimmed 50146 records to 33691 (keeping 150 days of data) [2025-09-15T18:14:08.926879] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-15T18:14:09.039348] [DEBUG] [LOCAL ] EFC: Primary data saved (33691 records). [2025-09-15T18:14:09.039509] [INFO ] [MAIN ] EFC: Full history saved. [2025-09-15T18:14:09.039608] [INFO ] [MAIN ] Update Progress: 702/2369 symbols completed. EFC took 30.9s. Estimated remaining: 2h 55m 57s. Rate: 9.5 symbols/min [2025-09-15T18:14:09.212186] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:14:09.232555] [DEBUG] [LOCAL ] EG: Loaded 21242 existing records from primary storage. [2025-09-15T18:14:09.232768] [INFO ] [MAIN ] EG: Loaded 21242 existing records. [2025-09-15T18:14:09.263094] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-09-15T18:14:09.379945] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-15T18:14:09.437500] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:14:09.437832] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-09-15T18:14:09.437885] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-09-15T18:14:09.438480] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-09-15T18:14:09.438535] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-09-15T18:14:09.806996] [INFO ] [REMOTE ] EG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:14:10.057890] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-09-15T18:14:10.476672] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-15T18:14:10.857872] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-09-15T18:14:11.333058] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T18:14:11.657877] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-09-15T18:14:12.051046] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-15T18:14:12.457928] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-09-15T18:14:12.499117] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-15T18:14:12.501630] [INFO ] [REMOTE ] EFR: Full fetch complete (13771 records). [2025-09-15T18:14:12.501949] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-09-15T18:14:12.502486] [FATAL] [VALIDATOR ] EFR: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:14:12.502573] [FATAL] [MAIN ] EFR: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:14:12.502612] [WARN ] [MAIN ] EFR: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:14:12.502683] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-09-15T18:14:12.502759] [DEBUG] [LOCAL ] EFR: No primary data file found to delete. [2025-09-15T18:14:12.502804] [INFO ] [LOCAL ] EFR: Starting deletion of derivative data. [2025-09-15T18:14:12.503163] [DEBUG] [LOCAL ] EFR: Deleted derivative data file. [2025-09-15T18:14:12.503248] [INFO ] [MAIN ] Update Progress: 703/2369 symbols completed. EFR took 30.2s. Estimated remaining: 2h 55m 44s. Rate: 9.5 symbols/min [2025-09-15T18:14:12.674425] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:14:12.715300] [DEBUG] [LOCAL ] EGO: Loaded 38604 existing records from primary storage. [2025-09-15T18:14:12.715441] [INFO ] [MAIN ] EGO: Loaded 38604 existing records. [2025-09-15T18:14:12.901628] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:14:12.901937] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-09-15T18:14:12.901987] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-09-15T18:14:12.902809] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-09-15T18:14:12.902873] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-09-15T18:14:13.254170] [INFO ] [REMOTE ] EGO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:14:13.257821] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-09-15T18:14:14.057852] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-09-15T18:14:14.133601] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T18:14:14.857869] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-09-15T18:14:15.137921] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-15T18:14:15.372807] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-15T18:14:15.657868] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-09-15T18:14:16.335691] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T18:14:16.340841] [INFO ] [REMOTE ] EFX: Full fetch complete (48976 records). [2025-09-15T18:14:16.340950] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-09-15T18:14:16.463023] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-09-15T18:14:16.726144] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-09-15T18:14:16.726227] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-09-15T18:14:16.727797] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-09-15T18:14:16.727950] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-09-15T18:14:16.732830] [DEBUG] [LOCAL ] EFX: Trimmed 48976 records to 32620 (keeping 150 days of data) [2025-09-15T18:14:16.950782] [DEBUG] [LOCAL ] EFX: Primary data saved (32620 records). [2025-09-15T18:14:16.950941] [INFO ] [MAIN ] EFX: Full history saved. [2025-09-15T18:14:16.951494] [INFO ] [MAIN ] Update Progress: 704/2369 symbols completed. EFX took 19.7s. Estimated remaining: 2h 55m 33s. Rate: 9.5 symbols/min [2025-09-15T18:14:17.122352] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:14:17.148701] [DEBUG] [LOCAL ] EGP: Loaded 22583 existing records from primary storage. [2025-09-15T18:14:17.148843] [INFO ] [MAIN ] EGP: Loaded 22583 existing records. [2025-09-15T18:14:17.262430] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-09-15T18:14:17.338399] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:14:17.339058] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-09-15T18:14:17.339132] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-09-15T18:14:17.340031] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-09-15T18:14:17.340110] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-09-15T18:14:17.608616] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-15T18:14:17.756956] [INFO ] [REMOTE ] EGP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:14:17.772427] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T18:14:18.057872] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-09-15T18:14:18.782240] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-15T18:14:18.857884] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-09-15T18:14:19.657875] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-09-15T18:14:19.817070] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T18:14:20.028206] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-15T18:14:20.457898] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-09-15T18:14:20.876062] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-15T18:14:21.264276] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-09-15T18:14:21.281311] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-15T18:14:22.057872] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-09-15T18:14:22.630239] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-15T18:14:22.857923] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-09-15T18:14:23.401942] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-15T18:14:23.407431] [INFO ] [REMOTE ] EFXT: Full fetch complete (32340 records). [2025-09-15T18:14:23.407558] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-09-15T18:14:23.663675] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-09-15T18:14:23.819851] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-09-15T18:14:23.819932] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-09-15T18:14:23.820546] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-09-15T18:14:23.820589] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-09-15T18:14:23.821442] [DEBUG] [LOCAL ] EFXT: Trimmed 32340 records to 20982 (keeping 150 days of data) [2025-09-15T18:14:23.953694] [DEBUG] [LOCAL ] EFXT: Primary data saved (20982 records). [2025-09-15T18:14:23.953839] [INFO ] [MAIN ] EFXT: Full history saved. [2025-09-15T18:14:23.953938] [INFO ] [MAIN ] Update Progress: 705/2369 symbols completed. EFXT took 17.4s. Estimated remaining: 2h 55m 28s. Rate: 9.5 symbols/min [2025-09-15T18:14:24.125226] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:14:24.160062] [DEBUG] [LOCAL ] EGY: Loaded 31091 existing records from primary storage. [2025-09-15T18:14:24.160224] [INFO ] [MAIN ] EGY: Loaded 31091 existing records. [2025-09-15T18:14:24.346752] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:14:24.347186] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-09-15T18:14:24.347252] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-09-15T18:14:24.348037] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-09-15T18:14:24.348211] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-09-15T18:14:24.457883] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-09-15T18:14:24.493219] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T18:14:24.753803] [INFO ] [REMOTE ] EGY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:14:25.073589] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T18:14:25.257866] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-09-15T18:14:26.052563] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-15T18:14:26.059774] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-09-15T18:14:26.857902] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-09-15T18:14:26.922013] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-15T18:14:27.220596] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-15T18:14:27.657882] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-09-15T18:14:28.136872] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-15T18:14:28.457902] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-09-15T18:14:29.257906] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-09-15T18:14:29.342451] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T18:14:29.645498] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T18:14:30.057860] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-09-15T18:14:30.413408] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-15T18:14:30.857880] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-09-15T18:14:31.282849] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-15T18:14:31.657890] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-09-15T18:14:32.237978] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T18:14:32.457891] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-09-15T18:14:33.248930] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-15T18:14:33.255864] [INFO ] [REMOTE ] EGO: Full fetch complete (55426 records). [2025-09-15T18:14:33.255986] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-09-15T18:14:33.257534] [FATAL] [VALIDATOR ] EGO: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:14:33.257622] [FATAL] [MAIN ] EGO: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:14:33.257695] [WARN ] [MAIN ] EGO: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:14:33.257753] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-09-15T18:14:33.257826] [DEBUG] [LOCAL ] EGO: No primary data file found to delete. [2025-09-15T18:14:33.258054] [INFO ] [LOCAL ] EGO: Starting deletion of derivative data. [2025-09-15T18:14:33.257943] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-09-15T18:14:33.259204] [DEBUG] [LOCAL ] EGO: Deleted derivative data file. [2025-09-15T18:14:33.260544] [INFO ] [MAIN ] Update Progress: 706/2369 symbols completed. EGO took 20.8s. Estimated remaining: 2h 55m 29s. Rate: 9.5 symbols/min [2025-09-15T18:14:33.436060] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:14:33.465852] [DEBUG] [LOCAL ] EHAB: Loaded 22977 existing records from primary storage. [2025-09-15T18:14:33.465991] [INFO ] [MAIN ] EHAB: Loaded 22977 existing records. [2025-09-15T18:14:33.658191] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:14:33.658452] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-09-15T18:14:33.658501] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-09-15T18:14:33.659074] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-09-15T18:14:33.659126] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-09-15T18:14:34.023516] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:14:34.048820] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-15T18:14:34.058427] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-09-15T18:14:34.129816] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-15T18:14:34.857888] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-09-15T18:14:35.381588] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T18:14:35.657912] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-09-15T18:14:35.720923] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T18:14:36.457888] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-09-15T18:14:37.047096] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-15T18:14:37.257905] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-09-15T18:14:37.740279] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T18:14:38.057927] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-09-15T18:14:38.479884] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T18:14:38.857906] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-09-15T18:14:39.384827] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T18:14:39.657867] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-09-15T18:14:39.962451] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T18:14:40.457928] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-09-15T18:14:40.833584] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-15T18:14:41.257951] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-09-15T18:14:41.465091] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T18:14:42.057860] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-09-15T18:14:42.745310] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T18:14:42.857823] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-09-15T18:14:43.263557] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-15T18:14:43.266753] [INFO ] [REMOTE ] EG: Full fetch complete (32043 records). [2025-09-15T18:14:43.266825] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-09-15T18:14:43.629222] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-09-15T18:14:43.629299] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-09-15T18:14:43.629843] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-09-15T18:14:43.629894] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-09-15T18:14:43.630582] [DEBUG] [LOCAL ] EG: Trimmed 32043 records to 20850 (keeping 150 days of data) [2025-09-15T18:14:43.692817] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-09-15T18:14:43.769922] [DEBUG] [LOCAL ] EG: Primary data saved (20850 records). [2025-09-15T18:14:43.770035] [INFO ] [MAIN ] EG: Full history saved. [2025-09-15T18:14:43.770146] [INFO ] [MAIN ] Update Progress: 707/2369 symbols completed. EG took 34.7s. Estimated remaining: 2h 55m 33s. Rate: 9.5 symbols/min [2025-09-15T18:14:43.943606] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:14:43.981315] [DEBUG] [LOCAL ] EHC: Loaded 31562 existing records from primary storage. [2025-09-15T18:14:43.981463] [INFO ] [MAIN ] EHC: Loaded 31562 existing records. [2025-09-15T18:14:44.159702] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:14:44.159955] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-09-15T18:14:44.160009] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-09-15T18:14:44.160916] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-09-15T18:14:44.160979] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-09-15T18:14:44.465076] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-09-15T18:14:44.530671] [INFO ] [REMOTE ] EHC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:14:44.554484] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-15T18:14:44.956798] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-15T18:14:45.257901] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-09-15T18:14:45.481926] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T18:14:45.485840] [INFO ] [REMOTE ] EGP: Full fetch complete (34543 records). [2025-09-15T18:14:45.485940] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-09-15T18:14:45.850735] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-09-15T18:14:45.850813] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-09-15T18:14:45.851361] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-09-15T18:14:45.851401] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-09-15T18:14:45.852147] [DEBUG] [LOCAL ] EGP: Trimmed 34543 records to 22063 (keeping 150 days of data) [2025-09-15T18:14:45.995265] [DEBUG] [LOCAL ] EGP: Primary data saved (22063 records). [2025-09-15T18:14:45.995393] [INFO ] [MAIN ] EGP: Full history saved. [2025-09-15T18:14:45.995480] [INFO ] [MAIN ] Update Progress: 708/2369 symbols completed. EGP took 29.0s. Estimated remaining: 2h 55m 17s. Rate: 9.5 symbols/min [2025-09-15T18:14:46.063022] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-09-15T18:14:46.163163] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:14:46.172216] [DEBUG] [LOCAL ] EHI: Loaded 7822 existing records from primary storage. [2025-09-15T18:14:46.172311] [INFO ] [MAIN ] EHI: Loaded 7822 existing records. [2025-09-15T18:14:46.345928] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:14:46.346137] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-09-15T18:14:46.346180] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-09-15T18:14:46.346486] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-09-15T18:14:46.346541] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-09-15T18:14:46.700852] [INFO ] [REMOTE ] EHI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:14:46.863339] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-09-15T18:14:46.878015] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T18:14:47.291018] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T18:14:47.295405] [INFO ] [REMOTE ] EGY: Full fetch complete (45923 records). [2025-09-15T18:14:47.295485] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-09-15T18:14:47.598435] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-15T18:14:47.666845] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-09-15T18:14:47.682566] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-09-15T18:14:47.682622] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-09-15T18:14:47.683265] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-09-15T18:14:47.683383] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-09-15T18:14:47.684395] [DEBUG] [LOCAL ] EGY: Trimmed 45923 records to 30410 (keeping 150 days of data) [2025-09-15T18:14:47.892597] [DEBUG] [LOCAL ] EGY: Primary data saved (30410 records). [2025-09-15T18:14:47.892868] [INFO ] [MAIN ] EGY: Full history saved. [2025-09-15T18:14:47.892995] [INFO ] [MAIN ] Update Progress: 709/2369 symbols completed. EGY took 23.9s. Estimated remaining: 2h 54m 60s. Rate: 9.5 symbols/min [2025-09-15T18:14:48.078808] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:14:48.100766] [DEBUG] [LOCAL ] EIC: Loaded 18009 existing records from primary storage. [2025-09-15T18:14:48.101012] [INFO ] [MAIN ] EIC: Loaded 18009 existing records. [2025-09-15T18:14:48.298454] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:14:48.298808] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-09-15T18:14:48.298859] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-09-15T18:14:48.299538] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-09-15T18:14:48.299593] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-09-15T18:14:48.463607] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-09-15T18:14:48.593540] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-15T18:14:48.706022] [INFO ] [REMOTE ] EIC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:14:49.257913] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-09-15T18:14:49.917432] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-15T18:14:50.057883] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-09-15T18:14:50.360607] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-15T18:14:50.857839] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-09-15T18:14:51.262978] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T18:14:51.657905] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-09-15T18:14:52.240046] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-15T18:14:52.457922] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-09-15T18:14:52.561522] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-15T18:14:53.257892] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-09-15T18:14:53.658333] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-15T18:14:53.732366] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-15T18:14:54.057881] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-09-15T18:14:54.859361] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-15T18:14:54.857844] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-09-15T18:14:55.657890] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-09-15T18:14:56.228756] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-15T18:14:56.457896] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-09-15T18:14:56.717263] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T18:14:56.720460] [INFO ] [REMOTE ] EHAB: Full fetch complete (32262 records). [2025-09-15T18:14:56.720546] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-09-15T18:14:57.128388] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-09-15T18:14:57.128473] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-09-15T18:14:57.129202] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-09-15T18:14:57.129259] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-09-15T18:14:57.130129] [DEBUG] [LOCAL ] EHAB: Trimmed 32262 records to 22563 (keeping 150 days of data) [2025-09-15T18:14:57.261488] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-09-15T18:14:57.270962] [DEBUG] [LOCAL ] EHAB: Primary data saved (22563 records). [2025-09-15T18:14:57.271161] [INFO ] [MAIN ] EHAB: Full history saved. [2025-09-15T18:14:57.271253] [INFO ] [MAIN ] Update Progress: 710/2369 symbols completed. EHAB took 24.0s. Estimated remaining: 2h 55m 1s. Rate: 9.5 symbols/min [2025-09-15T18:14:57.454749] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:14:57.454967] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-09-15T18:14:57.455009] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-09-15T18:14:57.455137] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-09-15T18:14:57.455177] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-15T18:14:57.455218] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-15T18:14:57.455251] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-09-15T18:14:57.821816] [INFO ] [REMOTE ] EICA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:14:57.877406] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-15T18:14:58.057890] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-09-15T18:14:58.430909] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-15T18:14:58.468670] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-15T18:14:58.857890] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-09-15T18:14:59.497039] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-15T18:14:59.657909] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-09-15T18:14:59.962265] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-09-15T18:15:00.457894] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-09-15T18:15:00.829479] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-15T18:15:01.257918] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-09-15T18:15:02.057933] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-09-15T18:15:02.857901] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-09-15T18:15:03.657921] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-09-15T18:15:03.709842] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-15T18:15:04.457914] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-09-15T18:15:04.695023] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-09-15T18:15:04.787901] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-15T18:15:05.257945] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-09-15T18:15:05.416250] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-15T18:15:06.057891] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-09-15T18:15:06.405491] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-15T18:15:06.478583] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-15T18:15:06.857910] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-09-15T18:15:06.919907] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-15T18:15:07.657926] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-09-15T18:15:08.306910] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-15T18:15:08.312093] [INFO ] [REMOTE ] EHC: Full fetch complete (45172 records). [2025-09-15T18:15:08.312273] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-09-15T18:15:08.461738] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-09-15T18:15:08.698558] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-09-15T18:15:08.698665] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-09-15T18:15:08.699369] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-09-15T18:15:08.699411] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-09-15T18:15:08.700474] [DEBUG] [LOCAL ] EHC: Trimmed 45172 records to 30763 (keeping 150 days of data) [2025-09-15T18:15:08.902063] [DEBUG] [LOCAL ] EHC: Primary data saved (30763 records). [2025-09-15T18:15:08.902217] [INFO ] [MAIN ] EHC: Full history saved. [2025-09-15T18:15:08.902311] [INFO ] [MAIN ] Update Progress: 711/2369 symbols completed. EHC took 25.1s. Estimated remaining: 2h 55m 7s. Rate: 9.5 symbols/min [2025-09-15T18:15:09.076408] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:15:09.076782] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-09-15T18:15:09.076934] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-09-15T18:15:09.077343] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-09-15T18:15:09.077471] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-15T18:15:09.084588] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-15T18:15:09.085804] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-15T18:15:09.085295] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-09-15T18:15:09.146408] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-15T18:15:09.263039] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-09-15T18:15:09.473567] [INFO ] [REMOTE ] EICB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:15:10.057866] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-09-15T18:15:10.269502] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-15T18:15:10.271876] [INFO ] [REMOTE ] EHI: Full fetch complete (11397 records). [2025-09-15T18:15:10.271958] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-09-15T18:15:10.635839] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-09-15T18:15:10.635926] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-09-15T18:15:10.636194] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-09-15T18:15:10.636235] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-09-15T18:15:10.636891] [DEBUG] [LOCAL ] EHI: Trimmed 11397 records to 7828 (keeping 150 days of data) [2025-09-15T18:15:10.684919] [DEBUG] [LOCAL ] EHI: Primary data saved (7828 records). [2025-09-15T18:15:10.685078] [INFO ] [MAIN ] EHI: Full history saved. [2025-09-15T18:15:10.685166] [INFO ] [MAIN ] Update Progress: 712/2369 symbols completed. EHI took 24.7s. Estimated remaining: 2h 54m 50s. Rate: 9.5 symbols/min [2025-09-15T18:15:10.862773] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-09-15T18:15:10.863907] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:15:10.871895] [DEBUG] [LOCAL ] EICC: Loaded 4350 existing records from primary storage. [2025-09-15T18:15:10.872022] [INFO ] [MAIN ] EICC: Loaded 4350 existing records. [2025-09-15T18:15:11.059511] [WARN ] [MAIN ] EICC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:15:11.059831] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-09-15T18:15:11.059882] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-15T18:15:11.060166] [DEBUG] [LOCAL ] EICC: Deleted primary data file. [2025-09-15T18:15:11.060248] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-09-15T18:15:11.387243] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-15T18:15:11.455751] [INFO ] [REMOTE ] EICC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:15:11.473268] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T18:15:11.657910] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-09-15T18:15:12.189209] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-15T18:15:12.457881] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-09-15T18:15:13.038190] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-15T18:15:13.257959] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-09-15T18:15:14.057940] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-09-15T18:15:14.069862] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-15T18:15:14.857924] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-09-15T18:15:15.657902] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-09-15T18:15:15.918333] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-15T18:15:15.990975] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-15T18:15:16.008235] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-15T18:15:16.457894] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-09-15T18:15:16.767046] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-15T18:15:17.257895] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-09-15T18:15:17.867439] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-15T18:15:18.057862] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-09-15T18:15:18.656703] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-15T18:15:18.857870] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-09-15T18:15:19.454878] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-15T18:15:19.657874] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-09-15T18:15:20.064330] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-15T18:15:20.457878] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-09-15T18:15:20.825770] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-15T18:15:20.826704] [INFO ] [REMOTE ] EICA: Full fetch complete (867 records). [2025-09-15T18:15:20.826777] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-09-15T18:15:20.827213] [FATAL] [VALIDATOR ] EICA: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:15:20.827300] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:15:20.827339] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:15:20.827384] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-15T18:15:20.827451] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-15T18:15:20.827498] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-09-15T18:15:20.827873] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-09-15T18:15:20.828478] [INFO ] [MAIN ] Update Progress: 713/2369 symbols completed. EICA took 23.6s. Estimated remaining: 2h 54m 52s. Rate: 9.5 symbols/min [2025-09-15T18:15:21.008524] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:15:21.025574] [DEBUG] [LOCAL ] EIG: Loaded 15585 existing records from primary storage. [2025-09-15T18:15:21.025747] [INFO ] [MAIN ] EIG: Loaded 15585 existing records. [2025-09-15T18:15:21.220666] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:15:21.221038] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-09-15T18:15:21.221089] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-09-15T18:15:21.221616] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-09-15T18:15:21.221698] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-09-15T18:15:21.263056] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-09-15T18:15:21.588047] [INFO ] [REMOTE ] EIG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:15:21.732233] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-15T18:15:21.733575] [INFO ] [REMOTE ] EICC: Full fetch complete (6245 records). [2025-09-15T18:15:21.733664] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-09-15T18:15:21.734048] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:15:21.734119] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:15:21.734162] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:15:21.734205] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-15T18:15:21.734262] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-15T18:15:21.734333] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-09-15T18:15:21.734693] [DEBUG] [LOCAL ] EICC: Deleted derivative data file. [2025-09-15T18:15:21.734773] [INFO ] [MAIN ] Update Progress: 714/2369 symbols completed. EICC took 11.0s. Estimated remaining: 2h 54m 33s. Rate: 9.5 symbols/min [2025-09-15T18:15:21.907131] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:15:21.948043] [DEBUG] [LOCAL ] EIX: Loaded 40171 existing records from primary storage. [2025-09-15T18:15:21.948187] [INFO ] [MAIN ] EIX: Loaded 40171 existing records. [2025-09-15T18:15:22.063001] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-09-15T18:15:22.123595] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:15:22.123840] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-09-15T18:15:22.123888] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-09-15T18:15:22.124765] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-09-15T18:15:22.124817] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-09-15T18:15:22.502307] [INFO ] [REMOTE ] EIX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:15:22.839872] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-15T18:15:22.842406] [INFO ] [REMOTE ] EIC: Full fetch complete (26964 records). [2025-09-15T18:15:22.842498] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-09-15T18:15:22.863101] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-09-15T18:15:23.209776] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-09-15T18:15:23.209860] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-09-15T18:15:23.210437] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-09-15T18:15:23.210993] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-09-15T18:15:23.211725] [DEBUG] [LOCAL ] EIC: Trimmed 26964 records to 17683 (keeping 150 days of data) [2025-09-15T18:15:23.322268] [DEBUG] [LOCAL ] EIC: Primary data saved (17683 records). [2025-09-15T18:15:23.322431] [INFO ] [MAIN ] EIC: Full history saved. [2025-09-15T18:15:23.322522] [INFO ] [MAIN ] Update Progress: 715/2369 symbols completed. EIC took 35.4s. Estimated remaining: 2h 54m 16s. Rate: 9.5 symbols/min [2025-09-15T18:15:23.423071] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-15T18:15:23.494680] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:15:23.533677] [DEBUG] [LOCAL ] EL: Loaded 40296 existing records from primary storage. [2025-09-15T18:15:23.533830] [INFO ] [MAIN ] EL: Loaded 40296 existing records. [2025-09-15T18:15:23.663866] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-09-15T18:15:23.737587] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:15:23.737985] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-09-15T18:15:23.738060] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-09-15T18:15:23.739087] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-09-15T18:15:23.739150] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-09-15T18:15:24.089352] [INFO ] [REMOTE ] EL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:15:24.457826] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-09-15T18:15:24.840314] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-15T18:15:25.257891] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-09-15T18:15:26.057884] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-09-15T18:15:26.317037] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-15T18:15:26.399691] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-15T18:15:26.857883] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-09-15T18:15:27.136886] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-15T18:15:27.657885] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-09-15T18:15:28.457869] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-09-15T18:15:28.593715] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-15T18:15:29.067226] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-15T18:15:29.257916] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-09-15T18:15:29.573359] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-15T18:15:29.599230] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-15T18:15:30.057891] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-09-15T18:15:30.857876] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-09-15T18:15:31.181890] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-15T18:15:31.657863] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-09-15T18:15:31.885804] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-15T18:15:32.097832] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-15T18:15:32.457875] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-09-15T18:15:33.257933] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-09-15T18:15:34.057901] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-09-15T18:15:34.365962] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-15T18:15:34.452312] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-15T18:15:34.489182] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-15T18:15:34.857936] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-09-15T18:15:35.657939] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-09-15T18:15:36.457884] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-09-15T18:15:36.944171] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-15T18:15:37.257931] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-09-15T18:15:37.684236] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-15T18:15:37.786014] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-15T18:15:37.786962] [INFO ] [REMOTE ] EICB: Full fetch complete (1986 records). [2025-09-15T18:15:37.787035] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-09-15T18:15:37.972629] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-15T18:15:37.972866] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:15:37.972993] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:15:37.973107] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-15T18:15:37.973204] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-15T18:15:37.973343] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-09-15T18:15:37.973419] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-09-15T18:15:37.973504] [INFO ] [MAIN ] Update Progress: 716/2369 symbols completed. EICB took 29.1s. Estimated remaining: 2h 54m 29s. Rate: 9.5 symbols/min [2025-09-15T18:15:38.063086] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-09-15T18:15:38.156777] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-09-15T18:15:38.197917] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:15:38.245260] [DEBUG] [LOCAL ] ELAN: Loaded 40091 existing records from primary storage. [2025-09-15T18:15:38.245430] [INFO ] [MAIN ] ELAN: Loaded 40091 existing records. [2025-09-15T18:15:38.434898] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:15:38.435245] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-09-15T18:15:38.435298] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-09-15T18:15:38.436334] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-09-15T18:15:38.436393] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-09-15T18:15:38.798548] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:15:38.857833] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-09-15T18:15:39.649986] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-15T18:15:39.661134] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-09-15T18:15:40.334555] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-15T18:15:40.457917] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-09-15T18:15:40.481560] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T18:15:41.257890] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-09-15T18:15:42.057873] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-09-15T18:15:42.664030] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-15T18:15:42.750157] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-15T18:15:42.776382] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-15T18:15:42.857899] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-09-15T18:15:43.657893] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-09-15T18:15:44.452525] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T18:15:44.463103] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-09-15T18:15:45.090791] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T18:15:45.257891] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-09-15T18:15:45.368841] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-15T18:15:46.057889] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-09-15T18:15:46.862999] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-09-15T18:15:46.885013] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T18:15:47.186094] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-15T18:15:47.188726] [INFO ] [REMOTE ] EIG: Full fetch complete (21647 records). [2025-09-15T18:15:47.188800] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-09-15T18:15:47.557916] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-09-15T18:15:47.558025] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-09-15T18:15:47.558535] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-09-15T18:15:47.558577] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-09-15T18:15:47.559268] [DEBUG] [LOCAL ] EIG: Trimmed 21647 records to 15429 (keeping 150 days of data) [2025-09-15T18:15:47.666302] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-09-15T18:15:47.666167] [DEBUG] [LOCAL ] EIG: Primary data saved (15429 records). [2025-09-15T18:15:47.666626] [INFO ] [MAIN ] EIG: Full history saved. [2025-09-15T18:15:47.667719] [INFO ] [MAIN ] Update Progress: 717/2369 symbols completed. EIG took 26.8s. Estimated remaining: 2h 54m 30s. Rate: 9.5 symbols/min [2025-09-15T18:15:48.457834] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-09-15T18:15:48.937301] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-15T18:15:49.257922] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-09-15T18:15:49.351724] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T18:15:50.057926] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-09-15T18:15:50.527760] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-15T18:15:50.673144] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-15T18:15:50.679288] [INFO ] [REMOTE ] EL: Full fetch complete (58158 records). [2025-09-15T18:15:50.679461] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-09-15T18:15:50.858694] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-09-15T18:15:51.069118] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-09-15T18:15:51.069209] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-09-15T18:15:51.070007] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-09-15T18:15:51.070054] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-09-15T18:15:51.071366] [DEBUG] [LOCAL ] EL: Trimmed 58158 records to 39517 (keeping 150 days of data) [2025-09-15T18:15:51.330100] [DEBUG] [LOCAL ] EL: Primary data saved (39517 records). [2025-09-15T18:15:51.330301] [INFO ] [MAIN ] EL: Full history saved. [2025-09-15T18:15:51.330431] [INFO ] [MAIN ] Update Progress: 718/2369 symbols completed. EL took 28.0s. Estimated remaining: 2h 54m 18s. Rate: 9.5 symbols/min [2025-09-15T18:15:51.649453] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-15T18:15:51.662234] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-09-15T18:15:52.700081] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-15T18:15:52.711813] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-09-15T18:15:53.375348] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-15T18:15:53.387022] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-09-15T18:15:54.343732] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-15T18:15:54.349349] [INFO ] [REMOTE ] EIX: Full fetch complete (57648 records). [2025-09-15T18:15:54.349487] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-09-15T18:15:54.350298] [FATAL] [VALIDATOR ] EIX: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:15:54.350381] [FATAL] [MAIN ] EIX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:15:54.350418] [WARN ] [MAIN ] EIX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:15:54.350456] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-09-15T18:15:54.350515] [DEBUG] [LOCAL ] EIX: No primary data file found to delete. [2025-09-15T18:15:54.350560] [INFO ] [LOCAL ] EIX: Starting deletion of derivative data. [2025-09-15T18:15:54.350915] [DEBUG] [LOCAL ] EIX: Deleted derivative data file. [2025-09-15T18:15:54.351656] [INFO ] [MAIN ] Update Progress: 719/2369 symbols completed. EIX took 32.6s. Estimated remaining: 2h 54m 4s. Rate: 9.5 symbols/min [2025-09-15T18:15:55.113088] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-15T18:15:55.119439] [INFO ] [REMOTE ] ELAN: Full fetch complete (57756 records). [2025-09-15T18:15:55.119597] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-09-15T18:15:55.499212] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-09-15T18:15:55.499295] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-09-15T18:15:55.500077] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-09-15T18:15:55.500123] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-09-15T18:15:55.501364] [DEBUG] [LOCAL ] ELAN: Trimmed 57756 records to 39316 (keeping 150 days of data) [2025-09-15T18:15:55.745098] [DEBUG] [LOCAL ] ELAN: Primary data saved (39316 records). [2025-09-15T18:15:55.745268] [INFO ] [MAIN ] ELAN: Full history saved. [2025-09-15T18:15:55.745372] [INFO ] [MAIN ] Update Progress: 720/2369 symbols completed. ELAN took 17.8s. Estimated remaining: 2h 53m 46s. Rate: 9.5 symbols/min [2025-09-15T18:15:56.253270] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:15:56.409085] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:15:56.440953] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:15:56.469728] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:15:56.474276] [DEBUG] [LOCAL ] ELC: Loaded 2672 existing records from primary storage. [2025-09-15T18:15:56.474586] [INFO ] [MAIN ] ELC: Loaded 2672 existing records. [2025-09-15T18:15:56.678106] [DEBUG] [LOCAL ] ELF: Loaded 39284 existing records from primary storage. [2025-09-15T18:15:56.642794] [DEBUG] [LOCAL ] ELP: Loaded 19609 existing records from primary storage. [2025-09-15T18:15:56.707713] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:15:56.707959] [INFO ] [MAIN ] ELP: Loaded 19609 existing records. [2025-09-15T18:15:56.715892] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-09-15T18:15:56.708082] [INFO ] [MAIN ] ELF: Loaded 39284 existing records. [2025-09-15T18:15:56.728115] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-09-15T18:15:56.772071] [DEBUG] [LOCAL ] ELME: Loaded 29297 existing records from primary storage. [2025-09-15T18:15:56.843490] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-09-15T18:15:56.873280] [INFO ] [MAIN ] ELME: Loaded 29297 existing records. [2025-09-15T18:15:56.873187] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-09-15T18:15:57.439514] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:15:57.526019] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-09-15T18:15:57.518497] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:15:57.555828] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-09-15T18:15:57.599715] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-09-15T18:15:57.618033] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-09-15T18:15:57.599557] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-09-15T18:15:57.646274] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-09-15T18:15:57.646864] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-09-15T18:15:57.646581] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-09-15T18:15:57.980507] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:15:58.146250] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-09-15T18:15:58.190284] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-09-15T18:15:58.235688] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-09-15T18:15:58.256486] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-09-15T18:15:58.446412] [INFO ] [REMOTE ] ELC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:15:58.488839] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-09-15T18:15:58.891311] [INFO ] [REMOTE ] ELF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:15:58.918668] [INFO ] [REMOTE ] ELP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:15:58.944865] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-09-15T18:15:58.944626] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-09-15T18:15:59.102115] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-15T18:15:59.108852] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-09-15T18:15:59.180841] [INFO ] [REMOTE ] ELME: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:15:59.181222] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-09-15T18:15:59.741061] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-15T18:15:59.742514] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-09-15T18:16:00.117415] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-15T18:16:00.124737] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-09-15T18:16:00.330562] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-15T18:16:00.332137] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-09-15T18:16:00.846769] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-15T18:16:00.858893] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-09-15T18:16:00.864574] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-15T18:16:00.890361] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-15T18:16:01.257884] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-09-15T18:16:01.383752] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-15T18:16:01.841866] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-15T18:16:02.057878] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-09-15T18:16:02.514210] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-15T18:16:02.857869] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-09-15T18:16:03.001465] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-15T18:16:03.218144] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-15T18:16:03.657908] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-09-15T18:16:04.457896] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-09-15T18:16:05.257911] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-09-15T18:16:05.683109] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-15T18:16:05.711721] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-15T18:16:06.057926] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-09-15T18:16:06.721374] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-15T18:16:06.722562] [INFO ] [REMOTE ] ELC: Full fetch complete (3756 records). [2025-09-15T18:16:06.722671] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-09-15T18:16:06.723129] [FATAL] [VALIDATOR ] ELC: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:16:06.723238] [FATAL] [MAIN ] ELC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:16:06.723281] [WARN ] [MAIN ] ELC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:16:06.723338] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-09-15T18:16:06.723403] [DEBUG] [LOCAL ] ELC: No primary data file found to delete. [2025-09-15T18:16:06.723443] [INFO ] [LOCAL ] ELC: Starting deletion of derivative data. [2025-09-15T18:16:06.723736] [DEBUG] [LOCAL ] ELC: Deleted derivative data file. [2025-09-15T18:16:06.723833] [INFO ] [MAIN ] Update Progress: 721/2369 symbols completed. ELC took 11.0s. Estimated remaining: 2h 53m 51s. Rate: 9.5 symbols/min [2025-09-15T18:16:06.863010] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-09-15T18:16:06.914101] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:16:06.914368] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-09-15T18:16:06.914427] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-09-15T18:16:06.914570] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-09-15T18:16:06.914611] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-15T18:16:06.914700] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-15T18:16:06.914747] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-09-15T18:16:07.275153] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:16:07.300348] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-15T18:16:07.657868] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-09-15T18:16:08.073279] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-15T18:16:08.457829] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-09-15T18:16:08.587004] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-15T18:16:09.257905] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-09-15T18:16:09.865667] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-15T18:16:09.897000] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-15T18:16:10.057896] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-09-15T18:16:10.857939] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-09-15T18:16:11.387747] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T18:16:11.657925] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-09-15T18:16:12.087896] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-15T18:16:12.175282] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T18:16:12.457904] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-09-15T18:16:13.257860] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-09-15T18:16:13.488721] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-15T18:16:14.057918] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-09-15T18:16:14.345671] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-15T18:16:14.857920] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-09-15T18:16:15.328606] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-15T18:16:15.657922] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-09-15T18:16:16.011690] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-15T18:16:16.457918] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-09-15T18:16:17.257912] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-09-15T18:16:17.510422] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-15T18:16:17.610900] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-15T18:16:17.658554] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-15T18:16:18.057865] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-09-15T18:16:18.468133] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-15T18:16:18.857911] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-09-15T18:16:19.657935] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-09-15T18:16:19.951194] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-15T18:16:19.953869] [INFO ] [REMOTE ] ELP: Full fetch complete (28203 records). [2025-09-15T18:16:19.953943] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-09-15T18:16:20.320548] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-09-15T18:16:20.320626] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-09-15T18:16:20.321172] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-09-15T18:16:20.321214] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-09-15T18:16:20.321984] [DEBUG] [LOCAL ] ELP: Trimmed 28203 records to 19225 (keeping 150 days of data) [2025-09-15T18:16:20.433959] [DEBUG] [LOCAL ] ELP: Primary data saved (19225 records). [2025-09-15T18:16:20.434092] [INFO ] [MAIN ] ELP: Full history saved. [2025-09-15T18:16:20.434174] [INFO ] [MAIN ] Update Progress: 722/2369 symbols completed. ELP took 24.7s. Estimated remaining: 2h 54m 1s. Rate: 9.5 symbols/min [2025-09-15T18:16:20.464825] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-09-15T18:16:20.606734] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:16:20.641765] [DEBUG] [LOCAL ] ELS: Loaded 37194 existing records from primary storage. [2025-09-15T18:16:20.641908] [INFO ] [MAIN ] ELS: Loaded 37194 existing records. [2025-09-15T18:16:20.800558] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-15T18:16:20.820471] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:16:20.820682] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-09-15T18:16:20.820728] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-09-15T18:16:20.821589] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-09-15T18:16:20.821657] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-09-15T18:16:21.175660] [INFO ] [REMOTE ] ELS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:16:21.194380] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-15T18:16:21.257884] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-09-15T18:16:21.591601] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-15T18:16:21.592357] [INFO ] [REMOTE ] ELPC: Full fetch complete (971 records). [2025-09-15T18:16:21.592431] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-09-15T18:16:21.592940] [FATAL] [VALIDATOR ] ELPC: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:16:21.593034] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:16:21.593098] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:16:21.593168] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-15T18:16:21.593251] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-15T18:16:21.593320] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-09-15T18:16:21.593408] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-09-15T18:16:21.593493] [INFO ] [MAIN ] Update Progress: 723/2369 symbols completed. ELPC took 14.9s. Estimated remaining: 2h 53m 43s. Rate: 9.5 symbols/min [2025-09-15T18:16:21.762687] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:16:21.805186] [DEBUG] [LOCAL ] ELV: Loaded 38179 existing records from primary storage. [2025-09-15T18:16:21.805350] [INFO ] [MAIN ] ELV: Loaded 38179 existing records. [2025-09-15T18:16:21.984871] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:16:21.985191] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-09-15T18:16:21.985254] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-09-15T18:16:21.986243] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-09-15T18:16:21.986305] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-09-15T18:16:22.062958] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-09-15T18:16:22.339457] [INFO ] [REMOTE ] ELV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:16:22.857888] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-09-15T18:16:23.657875] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-09-15T18:16:24.240532] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-15T18:16:24.457870] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-09-15T18:16:24.560979] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T18:16:25.012022] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T18:16:25.257876] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-09-15T18:16:26.057874] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-09-15T18:16:26.144727] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-15T18:16:26.562596] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-15T18:16:26.857873] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-09-15T18:16:27.341354] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T18:16:27.657871] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-09-15T18:16:28.457886] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-09-15T18:16:28.615718] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T18:16:28.812624] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-15T18:16:29.257871] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-09-15T18:16:29.833656] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-15T18:16:30.057872] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-09-15T18:16:30.825155] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T18:16:30.831434] [INFO ] [REMOTE ] ELME: Full fetch complete (42445 records). [2025-09-15T18:16:30.831585] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-09-15T18:16:30.832282] [FATAL] [VALIDATOR ] ELME: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:16:30.832385] [FATAL] [MAIN ] ELME: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:16:30.832445] [WARN ] [MAIN ] ELME: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:16:30.832507] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-09-15T18:16:30.832579] [DEBUG] [LOCAL ] ELME: No primary data file found to delete. [2025-09-15T18:16:30.832618] [INFO ] [LOCAL ] ELME: Starting deletion of derivative data. [2025-09-15T18:16:30.832871] [DEBUG] [LOCAL ] ELME: Deleted derivative data file. [2025-09-15T18:16:30.833007] [INFO ] [MAIN ] Update Progress: 724/2369 symbols completed. ELME took 35.1s. Estimated remaining: 2h 53m 43s. Rate: 9.5 symbols/min [2025-09-15T18:16:30.858216] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-09-15T18:16:31.014362] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:16:31.014571] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-09-15T18:16:31.014610] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-09-15T18:16:31.014751] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-09-15T18:16:31.014792] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-15T18:16:31.014835] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-15T18:16:31.014868] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-09-15T18:16:31.376063] [INFO ] [REMOTE ] EMA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:16:31.657870] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-02. [2025-09-15T18:16:32.457846] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-09-15T18:16:32.548349] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-15T18:16:32.756951] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T18:16:32.757281] [WARN ] [REMOTE ] EMA: No data returned for month 2025-02 [2025-09-15T18:16:33.257901] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-09-15T18:16:33.867416] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (3.01 seconds). [2025-09-15T18:16:34.057872] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-03. [2025-09-15T18:16:34.259951] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T18:16:34.260257] [WARN ] [REMOTE ] EMA: No data returned for month 2025-03 [2025-09-15T18:16:34.857886] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-09-15T18:16:35.172292] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-15T18:16:35.220807] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (2.76 seconds). [2025-09-15T18:16:35.226819] [INFO ] [REMOTE ] ELF: Full fetch complete (57012 records). [2025-09-15T18:16:35.226930] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-09-15T18:16:35.617602] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-09-15T18:16:35.617727] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-09-15T18:16:35.618555] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-09-15T18:16:35.618611] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-09-15T18:16:35.620256] [DEBUG] [LOCAL ] ELF: Trimmed 57012 records to 38501 (keeping 150 days of data) [2025-09-15T18:16:35.679681] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-09-15T18:16:35.870325] [DEBUG] [LOCAL ] ELF: Primary data saved (38501 records). [2025-09-15T18:16:35.870483] [INFO ] [MAIN ] ELF: Full history saved. [2025-09-15T18:16:35.870602] [INFO ] [MAIN ] Update Progress: 725/2369 symbols completed. ELF took 40.1s. Estimated remaining: 2h 53m 34s. Rate: 9.5 symbols/min [2025-09-15T18:16:36.040060] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:16:36.056482] [DEBUG] [LOCAL ] EMD: Loaded 15058 existing records from primary storage. [2025-09-15T18:16:36.056661] [INFO ] [MAIN ] EMD: Loaded 15058 existing records. [2025-09-15T18:16:36.238151] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:16:36.238459] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-09-15T18:16:36.238508] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-09-15T18:16:36.238933] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-09-15T18:16:36.238987] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-09-15T18:16:36.470279] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-04. [2025-09-15T18:16:36.612576] [INFO ] [REMOTE ] EMD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:16:36.642707] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-15T18:16:36.733275] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T18:16:36.733592] [WARN ] [REMOTE ] EMA: No data returned for month 2025-04 [2025-09-15T18:16:37.037605] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-15T18:16:37.257864] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-09-15T18:16:38.057945] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-09-15T18:16:38.857893] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-09-15T18:16:39.007185] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-15T18:16:39.657836] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-05. [2025-09-15T18:16:39.794905] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T18:16:40.115055] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-15T18:16:40.195382] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-15T18:16:40.457908] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-06. [2025-09-15T18:16:41.256048] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-15T18:16:41.259545] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-07. [2025-09-15T18:16:42.044024] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-15T18:16:42.057819] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-08. [2025-09-15T18:16:42.857879] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-09-15T18:16:42.976699] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-15T18:16:43.657877] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-09. [2025-09-15T18:16:44.457890] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-09-15T18:16:45.242551] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-15T18:16:45.244945] [INFO ] [REMOTE ] EMA: Full fetch complete (7215 records). [2025-09-15T18:16:45.245039] [DEBUG] [VALIDATOR ] EMA: Validating primary data. [2025-09-15T18:16:45.267660] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-09-15T18:16:45.430498] [WARN ] [VALIDATOR ] EMA: Validation failed - insufficient historical data. Have 76 unique days, need 150 days [2025-09-15T18:16:45.430782] [FATAL] [MAIN ] EMA: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:16:45.430843] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:16:45.430895] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-15T18:16:45.430962] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-15T18:16:45.431000] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-09-15T18:16:45.431049] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-09-15T18:16:45.431117] [INFO ] [MAIN ] Update Progress: 726/2369 symbols completed. EMA took 14.6s. Estimated remaining: 2h 53m 35s. Rate: 9.5 symbols/min [2025-09-15T18:16:45.598880] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:16:45.629447] [DEBUG] [LOCAL ] EME: Loaded 22709 existing records from primary storage. [2025-09-15T18:16:45.629632] [INFO ] [MAIN ] EME: Loaded 22709 existing records. [2025-09-15T18:16:45.816779] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:16:45.817198] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-09-15T18:16:45.817350] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-09-15T18:16:45.818226] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-09-15T18:16:45.818308] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-09-15T18:16:46.148985] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (3.29 seconds). [2025-09-15T18:16:46.233635] [INFO ] [REMOTE ] EME: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:16:46.234522] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-09-15T18:16:46.250160] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-15T18:16:46.257234] [INFO ] [REMOTE ] ELS: Full fetch complete (52917 records). [2025-09-15T18:16:46.257377] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-09-15T18:16:46.258378] [FATAL] [VALIDATOR ] ELS: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:16:46.258460] [FATAL] [MAIN ] ELS: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:16:46.258498] [WARN ] [MAIN ] ELS: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:16:46.258542] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-09-15T18:16:46.258611] [DEBUG] [LOCAL ] ELS: No primary data file found to delete. [2025-09-15T18:16:46.258672] [INFO ] [LOCAL ] ELS: Starting deletion of derivative data. [2025-09-15T18:16:46.258911] [DEBUG] [LOCAL ] ELS: Deleted derivative data file. [2025-09-15T18:16:46.258999] [INFO ] [MAIN ] Update Progress: 727/2369 symbols completed. ELS took 25.8s. Estimated remaining: 2h 53m 16s. Rate: 9.5 symbols/min [2025-09-15T18:16:46.431257] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:16:46.435382] [DEBUG] [LOCAL ] EMF: Loaded 2183 existing records from primary storage. [2025-09-15T18:16:46.435465] [INFO ] [MAIN ] EMF: Loaded 2183 existing records. [2025-09-15T18:16:46.614323] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:16:46.614680] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-09-15T18:16:46.614872] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-09-15T18:16:46.620183] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-09-15T18:16:46.628858] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-09-15T18:16:46.712186] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-15T18:16:46.863036] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-09-15T18:16:46.996555] [INFO ] [REMOTE ] EMF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:16:47.657933] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-09-15T18:16:48.015089] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-15T18:16:48.035829] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-15T18:16:48.165491] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T18:16:48.457852] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-09-15T18:16:49.257872] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-09-15T18:16:49.880113] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-15T18:16:50.057958] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-09-15T18:16:50.857967] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-09-15T18:16:50.988002] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-15T18:16:50.994343] [INFO ] [REMOTE ] ELV: Full fetch complete (54443 records). [2025-09-15T18:16:50.994526] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-09-15T18:16:50.995342] [FATAL] [VALIDATOR ] ELV: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:16:50.995458] [FATAL] [MAIN ] ELV: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:16:50.995498] [WARN ] [MAIN ] ELV: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:16:50.995545] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-09-15T18:16:50.995605] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-09-15T18:16:50.995663] [INFO ] [LOCAL ] ELV: Starting deletion of derivative data. [2025-09-15T18:16:50.995961] [DEBUG] [LOCAL ] ELV: Deleted derivative data file. [2025-09-15T18:16:50.997181] [INFO ] [MAIN ] Update Progress: 728/2369 symbols completed. ELV took 29.4s. Estimated remaining: 2h 53m 6s. Rate: 9.5 symbols/min [2025-09-15T18:16:51.169461] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:16:51.217809] [DEBUG] [LOCAL ] EMN: Loaded 38189 existing records from primary storage. [2025-09-15T18:16:51.217954] [INFO ] [MAIN ] EMN: Loaded 38189 existing records. [2025-09-15T18:16:51.394350] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:16:51.394581] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-09-15T18:16:51.394629] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-09-15T18:16:51.395541] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-09-15T18:16:51.395595] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-09-15T18:16:51.662540] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-15T18:16:51.661874] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-09-15T18:16:51.779079] [INFO ] [REMOTE ] EMN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:16:51.812267] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-15T18:16:52.457906] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-09-15T18:16:52.798576] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-15T18:16:53.257880] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-09-15T18:16:53.587612] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-15T18:16:53.969034] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-15T18:16:54.057909] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-09-15T18:16:54.857903] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-09-15T18:16:55.355065] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-15T18:16:55.510949] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-15T18:16:55.657891] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-09-15T18:16:56.457893] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-09-15T18:16:56.950829] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-15T18:16:57.257913] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-09-15T18:16:57.952189] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-15T18:16:58.057855] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-09-15T18:16:58.504213] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-15T18:16:58.776873] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-15T18:16:58.857868] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-09-15T18:16:59.657874] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-09-15T18:17:00.389567] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-15T18:17:00.457852] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-09-15T18:17:00.694864] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-15T18:17:01.257879] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-09-15T18:17:01.846358] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-15T18:17:02.057839] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-09-15T18:17:02.274539] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T18:17:02.277159] [INFO ] [REMOTE ] EMD: Full fetch complete (23795 records). [2025-09-15T18:17:02.277240] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-09-15T18:17:02.579219] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-15T18:17:02.666090] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-09-15T18:17:02.666180] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-09-15T18:17:02.666826] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-09-15T18:17:02.666880] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-09-15T18:17:02.667579] [DEBUG] [LOCAL ] EMD: Trimmed 23795 records to 14899 (keeping 150 days of data) [2025-09-15T18:17:02.763476] [DEBUG] [LOCAL ] EMD: Primary data saved (14899 records). [2025-09-15T18:17:02.763678] [INFO ] [MAIN ] EMD: Full history saved. [2025-09-15T18:17:02.763797] [INFO ] [MAIN ] Update Progress: 729/2369 symbols completed. EMD took 26.9s. Estimated remaining: 2h 53m 12s. Rate: 9.5 symbols/min [2025-09-15T18:17:02.863032] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-09-15T18:17:02.936900] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:17:02.947780] [DEBUG] [LOCAL ] EMO: Loaded 9565 existing records from primary storage. [2025-09-15T18:17:02.947903] [INFO ] [MAIN ] EMO: Loaded 9565 existing records. [2025-09-15T18:17:03.128076] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:17:03.128371] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-09-15T18:17:03.128419] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-09-15T18:17:03.128829] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-09-15T18:17:03.128883] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-09-15T18:17:03.486391] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-15T18:17:03.506491] [INFO ] [REMOTE ] EMO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:17:03.657875] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-09-15T18:17:04.457894] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-09-15T18:17:05.153139] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T18:17:05.257878] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-09-15T18:17:05.319026] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T18:17:06.057886] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-09-15T18:17:06.742181] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-15T18:17:06.778012] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T18:17:06.857863] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-09-15T18:17:07.657880] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-09-15T18:17:07.754420] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-15T18:17:08.457868] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-09-15T18:17:08.841140] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-15T18:17:08.845021] [INFO ] [REMOTE ] EME: Full fetch complete (35268 records). [2025-09-15T18:17:08.845108] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-09-15T18:17:09.226936] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-09-15T18:17:09.227023] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-09-15T18:17:09.227692] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-09-15T18:17:09.227738] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-09-15T18:17:09.228703] [DEBUG] [LOCAL ] EME: Trimmed 35268 records to 22200 (keeping 150 days of data) [2025-09-15T18:17:09.290077] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-09-15T18:17:09.388130] [DEBUG] [LOCAL ] EME: Primary data saved (22200 records). [2025-09-15T18:17:09.388280] [INFO ] [MAIN ] EME: Full history saved. [2025-09-15T18:17:09.388380] [INFO ] [MAIN ] Update Progress: 730/2369 symbols completed. EME took 24.0s. Estimated remaining: 2h 53m 6s. Rate: 9.5 symbols/min [2025-09-15T18:17:09.563812] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:17:09.568326] [DEBUG] [LOCAL ] EMP: Loaded 2192 existing records from primary storage. [2025-09-15T18:17:09.568440] [INFO ] [MAIN ] EMP: Loaded 2192 existing records. [2025-09-15T18:17:09.790352] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:17:09.790672] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-09-15T18:17:09.790859] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-09-15T18:17:09.791085] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-09-15T18:17:09.791138] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-09-15T18:17:09.900473] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-15T18:17:10.057835] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-09-15T18:17:10.203008] [INFO ] [REMOTE ] EMP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:17:10.205985] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-15T18:17:10.601697] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-15T18:17:10.857885] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-09-15T18:17:11.241762] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-15T18:17:11.657894] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-09-15T18:17:12.211751] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-15T18:17:12.457878] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-09-15T18:17:12.878968] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-15T18:17:12.879883] [INFO ] [REMOTE ] EMF: Full fetch complete (4235 records). [2025-09-15T18:17:12.879955] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-09-15T18:17:13.233286] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-09-15T18:17:13.233372] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-09-15T18:17:13.233513] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-09-15T18:17:13.233554] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-09-15T18:17:13.233994] [DEBUG] [LOCAL ] EMF: Trimmed 4235 records to 2155 (keeping 150 days of data) [2025-09-15T18:17:13.248583] [DEBUG] [LOCAL ] EMF: Primary data saved (2155 records). [2025-09-15T18:17:13.248701] [INFO ] [MAIN ] EMF: Full history saved. [2025-09-15T18:17:13.248797] [INFO ] [MAIN ] Update Progress: 731/2369 symbols completed. EMF took 27.0s. Estimated remaining: 2h 52m 55s. Rate: 9.5 symbols/min [2025-09-15T18:17:13.262985] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-09-15T18:17:13.421391] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:17:13.468412] [DEBUG] [LOCAL ] EMR: Loaded 40060 existing records from primary storage. [2025-09-15T18:17:13.468557] [INFO ] [MAIN ] EMR: Loaded 40060 existing records. [2025-09-15T18:17:13.652377] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:17:13.652667] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-09-15T18:17:13.652721] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-09-15T18:17:13.653724] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-09-15T18:17:13.653779] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-09-15T18:17:14.005453] [INFO ] [REMOTE ] EMR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:17:14.057871] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-09-15T18:17:14.132618] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-15T18:17:14.378666] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-15T18:17:14.857895] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-09-15T18:17:15.657890] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-09-15T18:17:15.926779] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-15T18:17:16.457903] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-09-15T18:17:17.048395] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-15T18:17:17.257853] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-09-15T18:17:17.375981] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-15T18:17:17.738359] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-15T18:17:18.057872] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-09-15T18:17:18.857871] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-09-15T18:17:19.272701] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-15T18:17:19.657883] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-09-15T18:17:19.955817] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-15T18:17:20.457892] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-09-15T18:17:20.579220] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-09-15T18:17:21.257877] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-09-15T18:17:21.328400] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-15T18:17:22.057863] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-09-15T18:17:22.655036] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-15T18:17:22.656010] [INFO ] [REMOTE ] EMP: Full fetch complete (3149 records). [2025-09-15T18:17:22.656113] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-09-15T18:17:22.656487] [FATAL] [VALIDATOR ] EMP: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:17:22.656562] [FATAL] [MAIN ] EMP: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:17:22.656607] [WARN ] [MAIN ] EMP: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:17:22.656697] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-09-15T18:17:22.656791] [DEBUG] [LOCAL ] EMP: No primary data file found to delete. [2025-09-15T18:17:22.656864] [INFO ] [LOCAL ] EMP: Starting deletion of derivative data. [2025-09-15T18:17:22.657259] [DEBUG] [LOCAL ] EMP: Deleted derivative data file. [2025-09-15T18:17:22.657364] [INFO ] [MAIN ] Update Progress: 732/2369 symbols completed. EMP took 13.3s. Estimated remaining: 2h 52m 55s. Rate: 9.5 symbols/min [2025-09-15T18:17:22.835269] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:17:22.865278] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-09-15T18:17:22.882711] [DEBUG] [LOCAL ] ENB: Loaded 40294 existing records from primary storage. [2025-09-15T18:17:22.882925] [INFO ] [MAIN ] ENB: Loaded 40294 existing records. [2025-09-15T18:17:23.072202] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:17:23.085789] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-09-15T18:17:23.085990] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-09-15T18:17:23.087093] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-15T18:17:23.092109] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-09-15T18:17:23.092470] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-09-15T18:17:23.137657] [INFO ] [REMOTE ] EMN: Full fetch complete (54276 records). [2025-09-15T18:17:23.165220] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-09-15T18:17:23.658203] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-09-15T18:17:23.747415] [INFO ] [REMOTE ] ENB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:17:23.845740] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-09-15T18:17:23.845830] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-09-15T18:17:23.846612] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-09-15T18:17:23.846672] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-09-15T18:17:23.848160] [DEBUG] [LOCAL ] EMN: Trimmed 54276 records to 37455 (keeping 150 days of data) [2025-09-15T18:17:24.087346] [DEBUG] [LOCAL ] EMN: Primary data saved (37455 records). [2025-09-15T18:17:24.087494] [INFO ] [MAIN ] EMN: Full history saved. [2025-09-15T18:17:24.088776] [INFO ] [MAIN ] Update Progress: 733/2369 symbols completed. EMN took 33.1s. Estimated remaining: 2h 52m 38s. Rate: 9.5 symbols/min [2025-09-15T18:17:24.265281] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:17:24.271987] [DEBUG] [LOCAL ] ENFY: Loaded 2700 existing records from primary storage. [2025-09-15T18:17:24.272299] [INFO ] [MAIN ] ENFY: Loaded 2700 existing records. [2025-09-15T18:17:24.465083] [WARN ] [MAIN ] ENFY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:17:24.460964] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-09-15T18:17:24.465574] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-09-15T18:17:24.466673] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-09-15T18:17:24.467062] [DEBUG] [LOCAL ] ENFY: Deleted primary data file. [2025-09-15T18:17:24.467169] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-09-15T18:17:24.629196] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-15T18:17:24.926910] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:17:24.931438] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T18:17:24.934537] [INFO ] [REMOTE ] EMO: Full fetch complete (12948 records). [2025-09-15T18:17:24.934727] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-09-15T18:17:25.271092] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-09-15T18:17:25.312213] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-09-15T18:17:25.312295] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-09-15T18:17:25.312628] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-09-15T18:17:25.312701] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-09-15T18:17:25.313184] [DEBUG] [LOCAL ] EMO: Trimmed 12948 records to 9432 (keeping 150 days of data) [2025-09-15T18:17:25.380294] [DEBUG] [LOCAL ] EMO: Primary data saved (9432 records). [2025-09-15T18:17:25.380471] [INFO ] [MAIN ] EMO: Full history saved. [2025-09-15T18:17:25.380569] [INFO ] [MAIN ] Update Progress: 734/2369 symbols completed. EMO took 22.6s. Estimated remaining: 2h 52m 20s. Rate: 9.5 symbols/min [2025-09-15T18:17:25.547611] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:17:25.574147] [DEBUG] [LOCAL ] ENIC: Loaded 28052 existing records from primary storage. [2025-09-15T18:17:25.574323] [INFO ] [MAIN ] ENIC: Loaded 28052 existing records. [2025-09-15T18:17:25.749178] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:17:25.749449] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-09-15T18:17:25.749496] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-09-15T18:17:25.750250] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-09-15T18:17:25.750301] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-09-15T18:17:26.070921] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-09-15T18:17:26.115720] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:17:26.411415] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-15T18:17:26.655978] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-15T18:17:26.857839] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-09-15T18:17:26.913969] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T18:17:27.284165] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-15T18:17:27.657873] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-09-15T18:17:28.457872] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-09-15T18:17:29.018368] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-15T18:17:29.257879] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-09-15T18:17:29.574733] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-15T18:17:30.057872] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-09-15T18:17:30.275907] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-15T18:17:30.857874] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-09-15T18:17:31.393132] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T18:17:31.657883] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-09-15T18:17:32.457872] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-09-15T18:17:32.573662] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-15T18:17:33.130900] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T18:17:33.257866] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-09-15T18:17:34.057899] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-09-15T18:17:34.095685] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T18:17:34.813287] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-15T18:17:34.857898] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-09-15T18:17:35.389378] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T18:17:35.459871] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-15T18:17:35.657877] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-09-15T18:17:36.457884] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-09-15T18:17:36.674411] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T18:17:36.881067] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-15T18:17:37.257916] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-09-15T18:17:38.057883] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-09-15T18:17:38.522802] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-15T18:17:38.857876] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-09-15T18:17:39.201983] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-15T18:17:39.657892] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-09-15T18:17:40.153516] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-15T18:17:40.457880] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-09-15T18:17:40.795734] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-15T18:17:41.043799] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-15T18:17:41.045053] [INFO ] [REMOTE ] ENFY: Full fetch complete (3566 records). [2025-09-15T18:17:41.045136] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-09-15T18:17:41.045585] [FATAL] [VALIDATOR ] ENFY: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:17:41.045700] [FATAL] [MAIN ] ENFY: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:17:41.045745] [WARN ] [MAIN ] ENFY: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:17:41.045801] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-09-15T18:17:41.045869] [DEBUG] [LOCAL ] ENFY: No primary data file found to delete. [2025-09-15T18:17:41.045912] [INFO ] [LOCAL ] ENFY: Starting deletion of derivative data. [2025-09-15T18:17:41.046201] [DEBUG] [LOCAL ] ENFY: Deleted derivative data file. [2025-09-15T18:17:41.046299] [INFO ] [MAIN ] Update Progress: 735/2369 symbols completed. ENFY took 17.0s. Estimated remaining: 2h 52m 35s. Rate: 9.5 symbols/min [2025-09-15T18:17:41.230492] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:17:41.233580] [DEBUG] [LOCAL ] ENO: Loaded 1267 existing records from primary storage. [2025-09-15T18:17:41.233672] [INFO ] [MAIN ] ENO: Loaded 1267 existing records. [2025-09-15T18:17:41.262948] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-09-15T18:17:41.414046] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:17:41.414322] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-09-15T18:17:41.414371] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-09-15T18:17:41.414559] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-09-15T18:17:41.414609] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-09-15T18:17:41.768078] [INFO ] [REMOTE ] ENO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:17:42.057915] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-09-15T18:17:42.857871] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-09-15T18:17:43.197378] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-15T18:17:43.290608] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-15T18:17:43.657882] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-09-15T18:17:43.969902] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-15T18:17:43.973168] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-15T18:17:44.457937] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-09-15T18:17:44.988943] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-15T18:17:45.258044] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-09-15T18:17:46.057950] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-09-15T18:17:46.862925] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-09-15T18:17:46.880163] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-15T18:17:47.646905] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-15T18:17:47.652633] [INFO ] [REMOTE ] EMR: Full fetch complete (57887 records). [2025-09-15T18:17:47.652758] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-09-15T18:17:47.664600] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-09-15T18:17:48.048579] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-09-15T18:17:48.052961] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-09-15T18:17:48.053182] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-15T18:17:48.054329] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-09-15T18:17:48.056033] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-09-15T18:17:48.070455] [DEBUG] [LOCAL ] EMR: Trimmed 57887 records to 39273 (keeping 150 days of data) [2025-09-15T18:17:48.096697] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-15T18:17:48.367460] [DEBUG] [LOCAL ] EMR: Primary data saved (39273 records). [2025-09-15T18:17:48.367631] [INFO ] [MAIN ] EMR: Full history saved. [2025-09-15T18:17:48.369149] [INFO ] [MAIN ] Update Progress: 736/2369 symbols completed. EMR took 35.1s. Estimated remaining: 2h 52m 31s. Rate: 9.5 symbols/min [2025-09-15T18:17:48.462943] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-09-15T18:17:48.545303] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:17:48.581922] [DEBUG] [LOCAL ] ENOV: Loaded 34517 existing records from primary storage. [2025-09-15T18:17:48.582062] [INFO ] [MAIN ] ENOV: Loaded 34517 existing records. [2025-09-15T18:17:48.764609] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:17:48.765035] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-09-15T18:17:48.765090] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-09-15T18:17:48.765912] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-09-15T18:17:48.765965] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-09-15T18:17:49.119392] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:17:49.257870] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-09-15T18:17:50.058065] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-09-15T18:17:50.316462] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-15T18:17:50.404321] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-15T18:17:50.833055] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-15T18:17:50.857817] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-09-15T18:17:51.657880] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-09-15T18:17:52.366804] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-15T18:17:52.457894] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-09-15T18:17:53.095420] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-15T18:17:53.257900] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-09-15T18:17:53.607255] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-15T18:17:54.057886] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-09-15T18:17:54.393982] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-15T18:17:54.857894] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-09-15T18:17:55.296515] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-15T18:17:55.657875] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-09-15T18:17:56.359482] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T18:17:56.365451] [INFO ] [REMOTE ] ENB: Full fetch complete (58209 records). [2025-09-15T18:17:56.365598] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-09-15T18:17:56.464506] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-09-15T18:17:56.767186] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-09-15T18:17:56.767764] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-09-15T18:17:56.768659] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-09-15T18:17:56.767696] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-15T18:17:56.768791] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-09-15T18:17:56.773289] [INFO ] [REMOTE ] ENIC: Full fetch complete (39432 records). [2025-09-15T18:17:56.773455] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-09-15T18:17:56.806112] [DEBUG] [LOCAL ] ENB: Trimmed 58209 records to 39511 (keeping 150 days of data) [2025-09-15T18:17:57.016470] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-15T18:17:57.279447] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-09-15T18:17:57.385870] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-09-15T18:17:57.386558] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-09-15T18:17:57.387630] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-09-15T18:17:57.388037] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-09-15T18:17:57.391385] [DEBUG] [LOCAL ] ENIC: Trimmed 39432 records to 27637 (keeping 150 days of data) [2025-09-15T18:17:57.572119] [DEBUG] [LOCAL ] ENIC: Primary data saved (27637 records). [2025-09-15T18:17:57.572869] [INFO ] [MAIN ] ENIC: Full history saved. [2025-09-15T18:17:57.573263] [INFO ] [MAIN ] Update Progress: 737/2369 symbols completed. ENIC took 32.2s. Estimated remaining: 2h 52m 31s. Rate: 9.5 symbols/min [2025-09-15T18:17:57.755190] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:17:57.765116] [DEBUG] [LOCAL ] ENB: Primary data saved (39511 records). [2025-09-15T18:17:57.765314] [INFO ] [MAIN ] ENB: Full history saved. [2025-09-15T18:17:57.766409] [INFO ] [MAIN ] Update Progress: 738/2369 symbols completed. ENB took 35.1s. Estimated remaining: 2h 52m 11s. Rate: 9.5 symbols/min [2025-09-15T18:17:57.943699] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-15T18:17:57.970517] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:17:57.972223] [DEBUG] [LOCAL ] ENR: Loaded 33339 existing records from primary storage. [2025-09-15T18:17:57.974141] [INFO ] [MAIN ] ENR: Loaded 33339 existing records. [2025-09-15T18:17:57.974314] [INFO ] [REMOTE ] ENO: Full fetch complete (2231 records). [2025-09-15T18:17:58.029395] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-09-15T18:17:58.061021] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-09-15T18:17:58.304834] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:17:58.309310] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-09-15T18:17:58.318886] [DEBUG] [LOCAL ] ENS: Loaded 21770 existing records from primary storage. [2025-09-15T18:17:58.329622] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-15T18:17:58.329524] [INFO ] [MAIN ] ENS: Loaded 21770 existing records. [2025-09-15T18:17:58.377215] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-09-15T18:17:58.409983] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-09-15T18:17:58.966286] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:17:59.042479] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-09-15T18:17:59.042750] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-09-15T18:17:59.050036] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-09-15T18:17:59.049975] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-09-15T18:17:59.067112] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-09-15T18:17:59.067175] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-09-15T18:17:59.067327] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-09-15T18:17:59.080285] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-09-15T18:17:59.173727] [DEBUG] [LOCAL ] ENO: Trimmed 2231 records to 1228 (keeping 150 days of data) [2025-09-15T18:17:59.278101] [INFO ] [REMOTE ] ENR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:17:59.296270] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-09-15T18:17:59.353052] [DEBUG] [LOCAL ] ENO: Primary data saved (1228 records). [2025-09-15T18:17:59.444888] [INFO ] [MAIN ] ENO: Full history saved. [2025-09-15T18:17:59.468557] [INFO ] [MAIN ] Update Progress: 739/2369 symbols completed. ENO took 18.4s. Estimated remaining: 2h 51m 54s. Rate: 9.5 symbols/min [2025-09-15T18:17:59.688533] [INFO ] [REMOTE ] ENS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:17:59.694419] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-09-15T18:17:59.774696] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:17:59.803283] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-15T18:17:59.828513] [DEBUG] [LOCAL ] ENVA: Loaded 18954 existing records from primary storage. [2025-09-15T18:17:59.828715] [INFO ] [MAIN ] ENVA: Loaded 18954 existing records. [2025-09-15T18:18:00.033249] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:18:00.033530] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-09-15T18:18:00.033600] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-09-15T18:18:00.034122] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-09-15T18:18:00.034185] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-09-15T18:18:00.386737] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:18:00.457837] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-09-15T18:18:00.549143] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-15T18:18:01.257927] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-09-15T18:18:01.371955] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T18:18:01.597779] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-15T18:18:02.057876] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-09-15T18:18:02.857902] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-09-15T18:18:03.138533] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-15T18:18:03.657877] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-09-15T18:18:04.457891] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-09-15T18:18:04.625932] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-09-15T18:18:05.257881] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-09-15T18:18:05.554836] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-15T18:18:06.057840] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-09-15T18:18:06.136295] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (3.28 seconds). [2025-09-15T18:18:06.421467] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-15T18:18:06.523489] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-15T18:18:06.857882] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-09-15T18:18:07.657885] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-09-15T18:18:07.957414] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-15T18:18:08.074856] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-15T18:18:08.457909] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-09-15T18:18:09.061849] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T18:18:09.257864] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-09-15T18:18:10.057915] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-09-15T18:18:10.127221] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-15T18:18:10.191822] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-15T18:18:10.857870] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-09-15T18:18:11.460779] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T18:18:11.657872] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-09-15T18:18:12.245949] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-15T18:18:12.457868] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-09-15T18:18:13.223089] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T18:18:13.227919] [INFO ] [REMOTE ] ENOV: Full fetch complete (48321 records). [2025-09-15T18:18:13.228020] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-09-15T18:18:13.228666] [FATAL] [VALIDATOR ] ENOV: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:18:13.228743] [FATAL] [MAIN ] ENOV: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:18:13.228813] [WARN ] [MAIN ] ENOV: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:18:13.228861] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-09-15T18:18:13.228917] [DEBUG] [LOCAL ] ENOV: No primary data file found to delete. [2025-09-15T18:18:13.228952] [INFO ] [LOCAL ] ENOV: Starting deletion of derivative data. [2025-09-15T18:18:13.229226] [DEBUG] [LOCAL ] ENOV: Deleted derivative data file. [2025-09-15T18:18:13.229324] [INFO ] [MAIN ] Update Progress: 740/2369 symbols completed. ENOV took 24.9s. Estimated remaining: 2h 52m 4s. Rate: 9.5 symbols/min [2025-09-15T18:18:13.262955] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-09-15T18:18:13.408783] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:18:13.422431] [DEBUG] [LOCAL ] EOD: Loaded 11000 existing records from primary storage. [2025-09-15T18:18:13.422559] [INFO ] [MAIN ] EOD: Loaded 11000 existing records. [2025-09-15T18:18:13.600250] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:18:13.600483] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-09-15T18:18:13.600527] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-09-15T18:18:13.600955] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-09-15T18:18:13.601029] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-09-15T18:18:13.959445] [INFO ] [REMOTE ] EOD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:18:14.057900] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-09-15T18:18:14.086762] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T18:18:14.747893] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-15T18:18:14.857887] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-09-15T18:18:15.244091] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T18:18:15.657921] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-09-15T18:18:15.872793] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-15T18:18:16.457893] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-09-15T18:18:17.177745] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-15T18:18:17.257873] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-09-15T18:18:17.933447] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T18:18:18.057874] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-09-15T18:18:18.859837] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-09-15T18:18:18.865366] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T18:18:19.111751] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-15T18:18:19.115023] [INFO ] [REMOTE ] ENVA: Full fetch complete (27971 records). [2025-09-15T18:18:19.115119] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-09-15T18:18:19.474340] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-09-15T18:18:19.474433] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-09-15T18:18:19.474968] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-09-15T18:18:19.475012] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-09-15T18:18:19.475758] [DEBUG] [LOCAL ] ENVA: Trimmed 27971 records to 18662 (keeping 150 days of data) [2025-09-15T18:18:19.593806] [DEBUG] [LOCAL ] ENVA: Primary data saved (18662 records). [2025-09-15T18:18:19.593962] [INFO ] [MAIN ] ENVA: Full history saved. [2025-09-15T18:18:19.594071] [INFO ] [MAIN ] Update Progress: 741/2369 symbols completed. ENVA took 20.1s. Estimated remaining: 2h 51m 58s. Rate: 9.5 symbols/min [2025-09-15T18:18:19.662914] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-09-15T18:18:19.766726] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:18:19.808214] [DEBUG] [LOCAL ] EOG: Loaded 40135 existing records from primary storage. [2025-09-15T18:18:19.808355] [INFO ] [MAIN ] EOG: Loaded 40135 existing records. [2025-09-15T18:18:19.982409] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:18:19.982676] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-09-15T18:18:19.982724] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-09-15T18:18:19.983629] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-09-15T18:18:19.983718] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-09-15T18:18:20.347368] [INFO ] [REMOTE ] EOG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:18:20.356116] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-15T18:18:20.375723] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T18:18:20.457813] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-09-15T18:18:21.257902] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-09-15T18:18:21.536734] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-15T18:18:21.540232] [INFO ] [REMOTE ] ENS: Full fetch complete (31995 records). [2025-09-15T18:18:21.540305] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-09-15T18:18:21.928143] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-09-15T18:18:21.928224] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-09-15T18:18:21.928781] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-09-15T18:18:21.928832] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-09-15T18:18:21.929698] [DEBUG] [LOCAL ] ENS: Trimmed 31995 records to 21455 (keeping 150 days of data) [2025-09-15T18:18:22.063187] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-09-15T18:18:22.066703] [DEBUG] [LOCAL ] ENS: Primary data saved (21455 records). [2025-09-15T18:18:22.067740] [INFO ] [MAIN ] ENS: Full history saved. [2025-09-15T18:18:22.067863] [INFO ] [MAIN ] Update Progress: 742/2369 symbols completed. ENS took 24.3s. Estimated remaining: 2h 51m 43s. Rate: 9.5 symbols/min [2025-09-15T18:18:22.243725] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:18:22.252564] [DEBUG] [LOCAL ] EOI: Loaded 7034 existing records from primary storage. [2025-09-15T18:18:22.252721] [INFO ] [MAIN ] EOI: Loaded 7034 existing records. [2025-09-15T18:18:22.453377] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:18:22.454064] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-09-15T18:18:22.454291] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-09-15T18:18:22.454860] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-09-15T18:18:22.454946] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-09-15T18:18:22.661764] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T18:18:22.869179] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-09-15T18:18:22.873460] [INFO ] [REMOTE ] EOI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:18:23.658047] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-09-15T18:18:23.832850] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-15T18:18:23.837544] [INFO ] [REMOTE ] ENR: Full fetch complete (45615 records). [2025-09-15T18:18:23.837673] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-09-15T18:18:24.245791] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-15T18:18:24.269596] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-09-15T18:18:24.270069] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-09-15T18:18:24.270758] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-09-15T18:18:24.270806] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-09-15T18:18:24.271704] [DEBUG] [LOCAL ] ENR: Trimmed 45615 records to 32871 (keeping 150 days of data) [2025-09-15T18:18:24.458612] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-09-15T18:18:24.473782] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-15T18:18:24.496085] [DEBUG] [LOCAL ] ENR: Primary data saved (32871 records). [2025-09-15T18:18:24.496190] [INFO ] [MAIN ] ENR: Full history saved. [2025-09-15T18:18:24.496274] [INFO ] [MAIN ] Update Progress: 743/2369 symbols completed. ENR took 26.9s. Estimated remaining: 2h 51m 28s. Rate: 9.5 symbols/min [2025-09-15T18:18:24.664079] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:18:24.674698] [DEBUG] [LOCAL ] EOS: Loaded 10469 existing records from primary storage. [2025-09-15T18:18:24.674790] [INFO ] [MAIN ] EOS: Loaded 10469 existing records. [2025-09-15T18:18:24.849327] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:18:24.849587] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-09-15T18:18:24.849632] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-09-15T18:18:24.849994] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-09-15T18:18:24.850039] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-09-15T18:18:25.203960] [INFO ] [REMOTE ] EOS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:18:25.257872] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-09-15T18:18:25.469264] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-15T18:18:26.057874] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-09-15T18:18:26.403546] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-15T18:18:26.847167] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-15T18:18:26.857818] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-09-15T18:18:27.658093] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-09-15T18:18:27.902933] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-15T18:18:28.457875] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-09-15T18:18:28.958987] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-15T18:18:29.257913] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-09-15T18:18:29.296211] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T18:18:30.057888] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-09-15T18:18:30.272166] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-15T18:18:30.857910] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-09-15T18:18:31.657899] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-09-15T18:18:31.791715] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-15T18:18:31.889251] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-15T18:18:32.457868] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-09-15T18:18:32.472256] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-15T18:18:33.257865] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-09-15T18:18:34.057869] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-09-15T18:18:34.330494] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-15T18:18:34.411327] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-15T18:18:34.857874] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-09-15T18:18:35.123743] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-15T18:18:35.657899] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-09-15T18:18:35.672321] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-15T18:18:36.457929] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-09-15T18:18:37.006827] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-15T18:18:37.101210] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T18:18:37.257869] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-09-15T18:18:38.057880] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-09-15T18:18:38.094169] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-15T18:18:38.096000] [INFO ] [REMOTE ] EOD: Full fetch complete (15413 records). [2025-09-15T18:18:38.096073] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-09-15T18:18:38.457815] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-09-15T18:18:38.457950] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-09-15T18:18:38.458308] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-09-15T18:18:38.458349] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-09-15T18:18:38.458899] [DEBUG] [LOCAL ] EOD: Trimmed 15413 records to 10829 (keeping 150 days of data) [2025-09-15T18:18:38.524138] [DEBUG] [LOCAL ] EOD: Primary data saved (10829 records). [2025-09-15T18:18:38.524267] [INFO ] [MAIN ] EOD: Full history saved. [2025-09-15T18:18:38.524410] [INFO ] [MAIN ] Update Progress: 744/2369 symbols completed. EOD took 25.3s. Estimated remaining: 2h 51m 39s. Rate: 9.5 symbols/min [2025-09-15T18:18:38.694724] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:18:38.701216] [DEBUG] [LOCAL ] EOT: Loaded 5036 existing records from primary storage. [2025-09-15T18:18:38.701315] [INFO ] [MAIN ] EOT: Loaded 5036 existing records. [2025-09-15T18:18:38.866223] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-09-15T18:18:38.886723] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:18:38.888141] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-09-15T18:18:38.894804] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-09-15T18:18:38.895631] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-15T18:18:38.898769] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-09-15T18:18:38.898867] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-09-15T18:18:39.254920] [INFO ] [REMOTE ] EOT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:18:39.657873] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-09-15T18:18:40.457847] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-09-15T18:18:40.841033] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-15T18:18:40.865758] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-15T18:18:40.952389] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-15T18:18:40.953963] [INFO ] [REMOTE ] EOI: Full fetch complete (11582 records). [2025-09-15T18:18:40.954058] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-09-15T18:18:41.262953] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-09-15T18:18:41.332901] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-09-15T18:18:41.333000] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-09-15T18:18:41.333338] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-09-15T18:18:41.333390] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-09-15T18:18:41.334023] [DEBUG] [LOCAL ] EOI: Trimmed 11582 records to 6869 (keeping 150 days of data) [2025-09-15T18:18:41.380713] [DEBUG] [LOCAL ] EOI: Primary data saved (6869 records). [2025-09-15T18:18:41.380874] [INFO ] [MAIN ] EOI: Full history saved. [2025-09-15T18:18:41.380977] [INFO ] [MAIN ] Update Progress: 745/2369 symbols completed. EOI took 19.3s. Estimated remaining: 2h 51m 25s. Rate: 9.5 symbols/min [2025-09-15T18:18:41.554918] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:18:41.577683] [DEBUG] [LOCAL ] EPAC: Loaded 19349 existing records from primary storage. [2025-09-15T18:18:41.577880] [INFO ] [MAIN ] EPAC: Loaded 19349 existing records. [2025-09-15T18:18:41.760468] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:18:41.760722] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-09-15T18:18:41.760768] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-09-15T18:18:41.761374] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-09-15T18:18:41.761423] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-09-15T18:18:42.063064] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-09-15T18:18:42.119886] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:18:42.862945] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-09-15T18:18:42.879221] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-15T18:18:42.956959] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-15T18:18:43.657872] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-09-15T18:18:43.691771] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-15T18:18:44.457905] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-09-15T18:18:45.201860] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-15T18:18:45.207938] [INFO ] [REMOTE ] EOG: Full fetch complete (58010 records). [2025-09-15T18:18:45.208050] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-09-15T18:18:45.265665] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-09-15T18:18:45.599569] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-09-15T18:18:45.599735] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-09-15T18:18:45.600551] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-09-15T18:18:45.600657] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-09-15T18:18:45.616219] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T18:18:45.621211] [DEBUG] [LOCAL ] EOG: Trimmed 58010 records to 39357 (keeping 150 days of data) [2025-09-15T18:18:45.884260] [DEBUG] [LOCAL ] EOG: Primary data saved (39357 records). [2025-09-15T18:18:45.884522] [INFO ] [MAIN ] EOG: Full history saved. [2025-09-15T18:18:45.885941] [INFO ] [MAIN ] Update Progress: 746/2369 symbols completed. EOG took 26.3s. Estimated remaining: 2h 51m 14s. Rate: 9.5 symbols/min [2025-09-15T18:18:46.057854] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-09-15T18:18:46.058969] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:18:46.097322] [DEBUG] [LOCAL ] EPAM: Loaded 29270 existing records from primary storage. [2025-09-15T18:18:46.097478] [INFO ] [MAIN ] EPAM: Loaded 29270 existing records. [2025-09-15T18:18:46.276686] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:18:46.276959] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-09-15T18:18:46.277006] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-09-15T18:18:46.277746] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-09-15T18:18:46.277797] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-09-15T18:18:46.461350] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-15T18:18:46.652826] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:18:46.659140] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-15T18:18:46.857922] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-09-15T18:18:47.657897] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-09-15T18:18:48.020213] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-15T18:18:48.235662] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-15T18:18:48.457890] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-09-15T18:18:49.257937] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-09-15T18:18:49.691451] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-15T18:18:50.057907] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-09-15T18:18:50.760075] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-15T18:18:50.774398] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-15T18:18:50.857869] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-09-15T18:18:51.509557] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-15T18:18:51.657882] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-09-15T18:18:52.040628] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-15T18:18:52.457912] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-09-15T18:18:53.257893] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-09-15T18:18:53.507392] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-15T18:18:53.892054] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-15T18:18:54.057870] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-09-15T18:18:54.846434] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-15T18:18:54.849019] [INFO ] [REMOTE ] EOS: Full fetch complete (16999 records). [2025-09-15T18:18:54.849121] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-09-15T18:18:54.862963] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-09-15T18:18:55.213565] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-09-15T18:18:55.213671] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-09-15T18:18:55.214058] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-09-15T18:18:55.214098] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-09-15T18:18:55.214726] [DEBUG] [LOCAL ] EOS: Trimmed 16999 records to 10119 (keeping 150 days of data) [2025-09-15T18:18:55.281753] [DEBUG] [LOCAL ] EOS: Primary data saved (10119 records). [2025-09-15T18:18:55.281913] [INFO ] [MAIN ] EOS: Full history saved. [2025-09-15T18:18:55.282020] [INFO ] [MAIN ] Update Progress: 747/2369 symbols completed. EOS took 30.8s. Estimated remaining: 2h 51m 15s. Rate: 9.5 symbols/min [2025-09-15T18:18:55.457374] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:18:55.492320] [DEBUG] [LOCAL ] EPC: Loaded 30114 existing records from primary storage. [2025-09-15T18:18:55.492474] [INFO ] [MAIN ] EPC: Loaded 30114 existing records. [2025-09-15T18:18:55.667068] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-09-15T18:18:55.672286] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:18:55.673319] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-09-15T18:18:55.673403] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-09-15T18:18:55.674563] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-09-15T18:18:55.674624] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-09-15T18:18:56.103777] [INFO ] [REMOTE ] EPC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:18:56.195362] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-15T18:18:56.457844] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-09-15T18:18:56.604428] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T18:18:57.257928] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-09-15T18:18:57.892989] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-15T18:18:57.937712] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T18:18:58.057949] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-09-15T18:18:58.857888] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-09-15T18:18:59.546140] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-15T18:18:59.657889] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-09-15T18:18:59.924952] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-15T18:19:00.457897] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-09-15T18:19:01.030621] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-15T18:19:01.032120] [INFO ] [REMOTE ] EOT: Full fetch complete (7490 records). [2025-09-15T18:19:01.032193] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-09-15T18:19:01.264100] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-09-15T18:19:01.423557] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-09-15T18:19:01.423760] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-09-15T18:19:01.424098] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-09-15T18:19:01.424175] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-09-15T18:19:01.425517] [DEBUG] [LOCAL ] EOT: Trimmed 7490 records to 4995 (keeping 150 days of data) [2025-09-15T18:19:01.485688] [DEBUG] [LOCAL ] EOT: Primary data saved (4995 records). [2025-09-15T18:19:01.486441] [INFO ] [MAIN ] EOT: Full history saved. [2025-09-15T18:19:01.487765] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-15T18:19:01.487943] [INFO ] [MAIN ] Update Progress: 748/2369 symbols completed. EOT took 23.0s. Estimated remaining: 2h 51m 8s. Rate: 9.5 symbols/min [2025-09-15T18:19:01.670005] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:19:01.714138] [DEBUG] [LOCAL ] EPD: Loaded 40362 existing records from primary storage. [2025-09-15T18:19:01.714329] [INFO ] [MAIN ] EPD: Loaded 40362 existing records. [2025-09-15T18:19:01.891607] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:19:01.891898] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-09-15T18:19:01.891947] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-09-15T18:19:01.892814] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-09-15T18:19:01.892867] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-09-15T18:19:02.068364] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-09-15T18:19:02.252359] [INFO ] [REMOTE ] EPD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:19:02.267782] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-15T18:19:02.857931] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-09-15T18:19:03.622521] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T18:19:03.657827] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-09-15T18:19:04.219692] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-15T18:19:04.457892] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-09-15T18:19:05.038375] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T18:19:05.257880] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-09-15T18:19:06.057893] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-09-15T18:19:06.427221] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-15T18:19:06.445307] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-15T18:19:06.448411] [INFO ] [REMOTE ] EPAC: Full fetch complete (29043 records). [2025-09-15T18:19:06.448624] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-09-15T18:19:06.809995] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-09-15T18:19:06.810103] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-09-15T18:19:06.810673] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-09-15T18:19:06.810730] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-09-15T18:19:06.811464] [DEBUG] [LOCAL ] EPAC: Trimmed 29043 records to 18981 (keeping 150 days of data) [2025-09-15T18:19:06.863530] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-09-15T18:19:06.929203] [DEBUG] [LOCAL ] EPAC: Primary data saved (18981 records). [2025-09-15T18:19:06.929362] [INFO ] [MAIN ] EPAC: Full history saved. [2025-09-15T18:19:06.929488] [INFO ] [MAIN ] Update Progress: 749/2369 symbols completed. EPAC took 25.5s. Estimated remaining: 2h 50m 60s. Rate: 9.5 symbols/min [2025-09-15T18:19:07.097608] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:19:07.136532] [DEBUG] [LOCAL ] EPR: Loaded 33117 existing records from primary storage. [2025-09-15T18:19:07.136761] [INFO ] [MAIN ] EPR: Loaded 33117 existing records. [2025-09-15T18:19:07.313487] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:19:07.313740] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-09-15T18:19:07.313790] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-09-15T18:19:07.315096] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-09-15T18:19:07.315152] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-09-15T18:19:07.663529] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-09-15T18:19:07.668965] [INFO ] [REMOTE ] EPR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:19:07.755412] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-15T18:19:08.313236] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T18:19:08.457853] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-09-15T18:19:09.257921] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-09-15T18:19:09.554210] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-15T18:19:09.905031] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-15T18:19:10.057892] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-09-15T18:19:10.600032] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-15T18:19:10.857896] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-09-15T18:19:11.468565] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-15T18:19:11.657892] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-09-15T18:19:12.106604] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-15T18:19:12.457876] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-09-15T18:19:13.257920] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-09-15T18:19:13.596829] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-15T18:19:13.883019] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T18:19:13.887847] [INFO ] [REMOTE ] EPAM: Full fetch complete (43212 records). [2025-09-15T18:19:13.887961] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-09-15T18:19:14.062865] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-09-15T18:19:14.267515] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-09-15T18:19:14.267594] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-09-15T18:19:14.268231] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-09-15T18:19:14.268275] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-09-15T18:19:14.270014] [DEBUG] [LOCAL ] EPAM: Trimmed 43212 records to 28631 (keeping 150 days of data) [2025-09-15T18:19:14.449423] [DEBUG] [LOCAL ] EPAM: Primary data saved (28631 records). [2025-09-15T18:19:14.449569] [INFO ] [MAIN ] EPAM: Full history saved. [2025-09-15T18:19:14.449678] [INFO ] [MAIN ] Update Progress: 750/2369 symbols completed. EPAM took 28.6s. Estimated remaining: 2h 50m 56s. Rate: 9.5 symbols/min [2025-09-15T18:19:14.618482] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:19:14.653462] [DEBUG] [LOCAL ] EPRT: Loaded 36216 existing records from primary storage. [2025-09-15T18:19:14.653622] [INFO ] [MAIN ] EPRT: Loaded 36216 existing records. [2025-09-15T18:19:14.831045] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:19:14.831398] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-09-15T18:19:14.831470] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-09-15T18:19:14.832362] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-09-15T18:19:14.832416] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-09-15T18:19:14.865496] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-09-15T18:19:14.988659] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-15T18:19:15.226251] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:19:15.657875] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-09-15T18:19:15.762569] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T18:19:16.457878] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-09-15T18:19:16.629127] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-15T18:19:17.046128] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-15T18:19:17.257955] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-09-15T18:19:17.690420] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-15T18:19:18.057886] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-09-15T18:19:18.814380] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-15T18:19:18.857823] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-09-15T18:19:19.290568] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-15T18:19:19.657889] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-09-15T18:19:20.457922] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-09-15T18:19:20.712693] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-15T18:19:21.256611] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-15T18:19:21.265065] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-09-15T18:19:21.671607] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-15T18:19:22.057883] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-09-15T18:19:22.279145] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T18:19:22.857879] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-09-15T18:19:23.657848] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-09-15T18:19:23.732525] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T18:19:23.847357] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T18:19:23.851945] [INFO ] [REMOTE ] EPC: Full fetch complete (43741 records). [2025-09-15T18:19:23.852036] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-09-15T18:19:24.228279] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-09-15T18:19:24.228370] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-09-15T18:19:24.229022] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-09-15T18:19:24.229072] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-09-15T18:19:24.230217] [DEBUG] [LOCAL ] EPC: Trimmed 43741 records to 29617 (keeping 150 days of data) [2025-09-15T18:19:24.433380] [DEBUG] [LOCAL ] EPC: Primary data saved (29617 records). [2025-09-15T18:19:24.433517] [INFO ] [MAIN ] EPC: Full history saved. [2025-09-15T18:19:24.433602] [INFO ] [MAIN ] Update Progress: 751/2369 symbols completed. EPC took 29.2s. Estimated remaining: 2h 50m 58s. Rate: 9.5 symbols/min [2025-09-15T18:19:24.465498] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-09-15T18:19:24.615691] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:19:24.625732] [DEBUG] [LOCAL ] EQBK: Loaded 8151 existing records from primary storage. [2025-09-15T18:19:24.625835] [INFO ] [MAIN ] EQBK: Loaded 8151 existing records. [2025-09-15T18:19:24.804154] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:19:24.804490] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-09-15T18:19:24.804541] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-09-15T18:19:24.804871] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-09-15T18:19:24.804922] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-09-15T18:19:25.154995] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:19:25.232021] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T18:19:25.257823] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-09-15T18:19:26.001155] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-15T18:19:26.057825] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-09-15T18:19:26.822680] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-15T18:19:26.857820] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-09-15T18:19:27.657927] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-09-15T18:19:28.079839] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-15T18:19:28.251198] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-15T18:19:28.465462] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-09-15T18:19:28.466772] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-15T18:19:28.472608] [INFO ] [REMOTE ] EPR: Full fetch complete (47889 records). [2025-09-15T18:19:28.472743] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-09-15T18:19:28.473458] [FATAL] [VALIDATOR ] EPR: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:19:28.473542] [FATAL] [MAIN ] EPR: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:19:28.473581] [WARN ] [MAIN ] EPR: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:19:28.473620] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-09-15T18:19:28.473726] [DEBUG] [LOCAL ] EPR: No primary data file found to delete. [2025-09-15T18:19:28.473768] [INFO ] [LOCAL ] EPR: Starting deletion of derivative data. [2025-09-15T18:19:28.474043] [DEBUG] [LOCAL ] EPR: Deleted derivative data file. [2025-09-15T18:19:28.474128] [INFO ] [MAIN ] Update Progress: 752/2369 symbols completed. EPR took 21.5s. Estimated remaining: 2h 50m 46s. Rate: 9.5 symbols/min [2025-09-15T18:19:28.651000] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:19:28.693501] [DEBUG] [LOCAL ] EQH: Loaded 39546 existing records from primary storage. [2025-09-15T18:19:28.693709] [INFO ] [MAIN ] EQH: Loaded 39546 existing records. [2025-09-15T18:19:28.873156] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:19:28.873402] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-09-15T18:19:28.873450] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-09-15T18:19:28.874405] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-09-15T18:19:28.874469] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-09-15T18:19:29.235061] [INFO ] [REMOTE ] EQH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:19:29.257850] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-09-15T18:19:29.803283] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-15T18:19:30.057856] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-09-15T18:19:30.853417] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T18:19:30.863119] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-09-15T18:19:31.657871] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-09-15T18:19:31.683688] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-15T18:19:31.930404] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-15T18:19:31.936714] [INFO ] [REMOTE ] EPD: Full fetch complete (58292 records). [2025-09-15T18:19:31.936834] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-09-15T18:19:32.317915] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-09-15T18:19:32.317995] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-09-15T18:19:32.318743] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-09-15T18:19:32.318789] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-09-15T18:19:32.320076] [DEBUG] [LOCAL ] EPD: Trimmed 58292 records to 39582 (keeping 150 days of data) [2025-09-15T18:19:32.505130] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-09-15T18:19:32.577154] [DEBUG] [LOCAL ] EPD: Primary data saved (39582 records). [2025-09-15T18:19:32.577313] [INFO ] [MAIN ] EPD: Full history saved. [2025-09-15T18:19:32.577401] [INFO ] [MAIN ] Update Progress: 753/2369 symbols completed. EPD took 31.1s. Estimated remaining: 2h 50m 35s. Rate: 9.5 symbols/min [2025-09-15T18:19:32.749469] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:19:32.788249] [DEBUG] [LOCAL ] EQNR: Loaded 39924 existing records from primary storage. [2025-09-15T18:19:32.788437] [INFO ] [MAIN ] EQNR: Loaded 39924 existing records. [2025-09-15T18:19:32.970746] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:19:32.971133] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-09-15T18:19:32.985911] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-09-15T18:19:32.999142] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-15T18:19:32.999195] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-09-15T18:19:32.999319] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-09-15T18:19:33.262928] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-09-15T18:19:33.377319] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:19:34.057880] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-09-15T18:19:34.223780] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-15T18:19:34.555733] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-15T18:19:34.857847] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-09-15T18:19:34.884620] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-15T18:19:35.657863] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-09-15T18:19:36.457888] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-09-15T18:19:36.690552] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-15T18:19:37.163623] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-15T18:19:37.169106] [INFO ] [REMOTE ] EPRT: Full fetch complete (52828 records). [2025-09-15T18:19:37.169200] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-09-15T18:19:37.262939] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-09-15T18:19:37.564723] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-09-15T18:19:37.565123] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-09-15T18:19:37.566437] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-09-15T18:19:37.566498] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-09-15T18:19:37.568087] [DEBUG] [LOCAL ] EPRT: Trimmed 52828 records to 35533 (keeping 150 days of data) [2025-09-15T18:19:37.791421] [DEBUG] [LOCAL ] EPRT: Primary data saved (35533 records). [2025-09-15T18:19:37.791706] [INFO ] [MAIN ] EPRT: Full history saved. [2025-09-15T18:19:37.793884] [INFO ] [MAIN ] Update Progress: 754/2369 symbols completed. EPRT took 23.3s. Estimated remaining: 2h 50m 26s. Rate: 9.5 symbols/min [2025-09-15T18:19:37.968446] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:19:38.008885] [DEBUG] [LOCAL ] EQR: Loaded 38710 existing records from primary storage. [2025-09-15T18:19:38.009040] [INFO ] [MAIN ] EQR: Loaded 38710 existing records. [2025-09-15T18:19:38.073052] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-09-15T18:19:38.182692] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-15T18:19:38.206583] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:19:38.206873] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-09-15T18:19:38.206927] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-09-15T18:19:38.207775] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-09-15T18:19:38.207826] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-09-15T18:19:38.580003] [INFO ] [REMOTE ] EQR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:19:38.610371] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-15T18:19:38.857930] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-09-15T18:19:39.657904] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-09-15T18:19:39.791198] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-15T18:19:40.156708] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-15T18:19:40.457912] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-09-15T18:19:41.257895] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-09-15T18:19:41.384073] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-15T18:19:41.506747] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-15T18:19:42.057892] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-09-15T18:19:42.561034] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-15T18:19:42.609268] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-15T18:19:42.857886] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-09-15T18:19:43.657933] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-09-15T18:19:43.668065] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-15T18:19:44.457936] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-09-15T18:19:45.270345] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-09-15T18:19:45.295320] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-15T18:19:46.057888] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-09-15T18:19:46.229725] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T18:19:46.857892] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-09-15T18:19:46.911430] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T18:19:47.657908] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-09-15T18:19:47.701632] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-15T18:19:48.427088] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T18:19:48.457826] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-09-15T18:19:49.263065] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-09-15T18:19:49.279476] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-15T18:19:49.612940] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-15T18:19:49.898451] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-15T18:19:49.900305] [INFO ] [REMOTE ] EQBK: Full fetch complete (11444 records). [2025-09-15T18:19:49.900374] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-09-15T18:19:50.062955] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-09-15T18:19:50.294605] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-09-15T18:19:50.294828] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-09-15T18:19:50.295438] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-09-15T18:19:50.295502] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-09-15T18:19:50.296941] [DEBUG] [LOCAL ] EQBK: Trimmed 11444 records to 7957 (keeping 150 days of data) [2025-09-15T18:19:50.358953] [DEBUG] [LOCAL ] EQBK: Primary data saved (7957 records). [2025-09-15T18:19:50.359196] [INFO ] [MAIN ] EQBK: Full history saved. [2025-09-15T18:19:50.359366] [INFO ] [MAIN ] Update Progress: 755/2369 symbols completed. EQBK took 25.9s. Estimated remaining: 2h 50m 33s. Rate: 9.5 symbols/min [2025-09-15T18:19:50.560096] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:19:50.560397] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-09-15T18:19:50.560437] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-09-15T18:19:50.560599] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-09-15T18:19:50.560660] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-15T18:19:50.560709] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-15T18:19:50.560746] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-09-15T18:19:50.863269] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-09-15T18:19:51.093355] [INFO ] [REMOTE ] EQS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:19:51.657921] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-09-15T18:19:51.897975] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-15T18:19:52.464463] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-09-15T18:19:52.484497] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-15T18:19:52.930438] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-15T18:19:53.257883] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-09-15T18:19:53.683285] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-15T18:19:54.057882] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-09-15T18:19:54.167842] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-15T18:19:54.857911] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-09-15T18:19:55.590278] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T18:19:55.596473] [INFO ] [REMOTE ] EQH: Full fetch complete (57285 records). [2025-09-15T18:19:55.596635] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-09-15T18:19:55.663058] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-09-15T18:19:56.018810] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-09-15T18:19:56.019082] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-09-15T18:19:56.019827] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-09-15T18:19:56.019871] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-09-15T18:19:56.021110] [DEBUG] [LOCAL ] EQH: Trimmed 57285 records to 38767 (keeping 150 days of data) [2025-09-15T18:19:56.090975] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-15T18:19:56.284384] [DEBUG] [LOCAL ] EQH: Primary data saved (38767 records). [2025-09-15T18:19:56.284557] [INFO ] [MAIN ] EQH: Full history saved. [2025-09-15T18:19:56.285207] [INFO ] [MAIN ] Update Progress: 756/2369 symbols completed. EQH took 27.8s. Estimated remaining: 2h 50m 26s. Rate: 9.5 symbols/min [2025-09-15T18:19:56.459318] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-09-15T18:19:56.459194] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:19:56.506196] [DEBUG] [LOCAL ] EQT: Loaded 40425 existing records from primary storage. [2025-09-15T18:19:56.506360] [INFO ] [MAIN ] EQT: Loaded 40425 existing records. [2025-09-15T18:19:56.703258] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:19:56.703630] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-09-15T18:19:56.703743] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-09-15T18:19:56.704875] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-09-15T18:19:56.704931] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-09-15T18:19:56.883579] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-15T18:19:57.055659] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-15T18:19:57.121690] [INFO ] [REMOTE ] EQT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:19:57.257874] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-09-15T18:19:58.057887] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-09-15T18:19:58.857850] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-09-15T18:19:59.185930] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-15T18:19:59.262958] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-15T18:19:59.657938] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-09-15T18:20:00.295542] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-15T18:20:00.335522] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-15T18:20:00.457842] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-09-15T18:20:01.257904] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-09-15T18:20:02.057891] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-09-15T18:20:02.277190] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-15T18:20:02.283111] [INFO ] [REMOTE ] EQNR: Full fetch complete (57336 records). [2025-09-15T18:20:02.283330] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-09-15T18:20:02.284223] [FATAL] [VALIDATOR ] EQNR: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:20:02.284376] [FATAL] [MAIN ] EQNR: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:20:02.284439] [WARN ] [MAIN ] EQNR: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:20:02.284491] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-09-15T18:20:02.284554] [DEBUG] [LOCAL ] EQNR: No primary data file found to delete. [2025-09-15T18:20:02.284606] [INFO ] [LOCAL ] EQNR: Starting deletion of derivative data. [2025-09-15T18:20:02.284976] [DEBUG] [LOCAL ] EQNR: Deleted derivative data file. [2025-09-15T18:20:02.285070] [INFO ] [MAIN ] Update Progress: 757/2369 symbols completed. EQNR took 29.7s. Estimated remaining: 2h 50m 19s. Rate: 9.5 symbols/min [2025-09-15T18:20:02.857941] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-09-15T18:20:03.232319] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-15T18:20:03.266060] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-15T18:20:03.403628] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T18:20:03.409983] [INFO ] [REMOTE ] EQR: Full fetch complete (55603 records). [2025-09-15T18:20:03.410119] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-09-15T18:20:03.663113] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-09-15T18:20:03.816517] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-09-15T18:20:03.816664] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-09-15T18:20:03.817866] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-09-15T18:20:03.817924] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-09-15T18:20:03.819774] [DEBUG] [LOCAL ] EQR: Trimmed 55603 records to 37964 (keeping 150 days of data) [2025-09-15T18:20:04.081626] [DEBUG] [LOCAL ] EQR: Primary data saved (37964 records). [2025-09-15T18:20:04.081912] [INFO ] [MAIN ] EQR: Full history saved. [2025-09-15T18:20:04.082938] [INFO ] [MAIN ] Update Progress: 758/2369 symbols completed. EQR took 26.3s. Estimated remaining: 2h 50m 3s. Rate: 9.5 symbols/min [2025-09-15T18:20:04.457971] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-09-15T18:20:05.168234] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-15T18:20:05.257941] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-09-15T18:20:05.505762] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-15T18:20:05.781169] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-15T18:20:05.782315] [INFO ] [REMOTE ] EQS: Full fetch complete (1849 records). [2025-09-15T18:20:05.782383] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-09-15T18:20:05.957223] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 139 unique days, need 150 days [2025-09-15T18:20:05.957458] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:20:05.957503] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:20:05.957554] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-15T18:20:05.957617] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-15T18:20:05.957695] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-09-15T18:20:05.957761] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-09-15T18:20:05.957831] [INFO ] [MAIN ] Update Progress: 759/2369 symbols completed. EQS took 15.6s. Estimated remaining: 2h 49m 47s. Rate: 9.5 symbols/min [2025-09-15T18:20:06.057943] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-09-15T18:20:07.739421] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-15T18:20:07.750782] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-09-15T18:20:10.092115] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-15T18:20:10.108630] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-09-15T18:20:12.287482] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-15T18:20:12.299525] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-09-15T18:20:13.657080] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-15T18:20:13.668457] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-09-15T18:20:15.404100] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-15T18:20:15.410093] [INFO ] [REMOTE ] EQT: Full fetch complete (58361 records). [2025-09-15T18:20:15.410228] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-09-15T18:20:15.790435] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-09-15T18:20:15.790552] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-09-15T18:20:15.791330] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-09-15T18:20:15.791379] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-09-15T18:20:15.792843] [DEBUG] [LOCAL ] EQT: Trimmed 58361 records to 39645 (keeping 150 days of data) [2025-09-15T18:20:16.037151] [DEBUG] [LOCAL ] EQT: Primary data saved (39645 records). [2025-09-15T18:20:16.037304] [INFO ] [MAIN ] EQT: Full history saved. [2025-09-15T18:20:16.037865] [INFO ] [MAIN ] Update Progress: 760/2369 symbols completed. EQT took 19.8s. Estimated remaining: 2h 49m 49s. Rate: 9.5 symbols/min [2025-09-15T18:20:16.662619] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:20:16.613745] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:20:16.691707] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:20:16.741861] [DEBUG] [LOCAL ] EQV: Loaded 2163 existing records from primary storage. [2025-09-15T18:20:16.743040] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:20:16.743364] [INFO ] [MAIN ] EQV: Loaded 2163 existing records. [2025-09-15T18:20:16.898545] [DEBUG] [LOCAL ] ERO: Loaded 30409 existing records from primary storage. [2025-09-15T18:20:16.930839] [INFO ] [MAIN ] ERO: Loaded 30409 existing records. [2025-09-15T18:20:16.965103] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:20:17.014794] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-09-15T18:20:17.043303] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-09-15T18:20:17.043249] [DEBUG] [LOCAL ] ERJ: Loaded 38090 existing records from primary storage. [2025-09-15T18:20:17.058865] [INFO ] [MAIN ] ERJ: Loaded 38090 existing records. [2025-09-15T18:20:17.117505] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-09-15T18:20:17.189282] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-09-15T18:20:17.274020] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:20:17.359889] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-09-15T18:20:17.399346] [DEBUG] [LOCAL ] ES: Loaded 39539 existing records from primary storage. [2025-09-15T18:20:17.451465] [INFO ] [MAIN ] ES: Loaded 39539 existing records. [2025-09-15T18:20:17.456744] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:20:17.440564] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-09-15T18:20:17.486434] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-09-15T18:20:17.504610] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-09-15T18:20:17.525952] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-09-15T18:20:17.515696] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-09-15T18:20:17.570898] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-09-15T18:20:17.605984] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-09-15T18:20:18.070523] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:20:18.132968] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-09-15T18:20:18.179286] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-09-15T18:20:18.284188] [INFO ] [REMOTE ] EQV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:20:18.289383] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-09-15T18:20:18.294892] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-09-15T18:20:18.357400] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-09-15T18:20:18.609043] [INFO ] [REMOTE ] ERO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:20:18.614520] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-09-15T18:20:18.806088] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:20:18.867845] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-09-15T18:20:19.006079] [INFO ] [REMOTE ] ES: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:20:19.006400] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-09-15T18:20:19.054728] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-15T18:20:19.056415] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-09-15T18:20:19.389202] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-15T18:20:19.390758] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-09-15T18:20:19.793773] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-15T18:20:19.795108] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-09-15T18:20:20.094769] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-15T18:20:20.103218] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-09-15T18:20:20.112305] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-15T18:20:20.113731] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-09-15T18:20:20.308365] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-15T18:20:20.318460] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-09-15T18:20:20.409080] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-15T18:20:20.419260] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-09-15T18:20:20.761027] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-15T18:20:20.762531] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-09-15T18:20:21.206962] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-15T18:20:21.208252] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-09-15T18:20:21.379986] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T18:20:21.389574] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-09-15T18:20:21.820609] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-15T18:20:21.823049] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-09-15T18:20:22.127494] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-15T18:20:22.138731] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-09-15T18:20:22.212040] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-15T18:20:22.212923] [INFO ] [REMOTE ] EQV: Full fetch complete (3381 records). [2025-09-15T18:20:22.212991] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-09-15T18:20:22.636731] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-09-15T18:20:22.637093] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-09-15T18:20:22.638946] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-15T18:20:22.639112] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-09-15T18:20:22.654054] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-09-15T18:20:22.655431] [DEBUG] [LOCAL ] EQV: Trimmed 3381 records to 2157 (keeping 150 days of data) [2025-09-15T18:20:22.669185] [DEBUG] [LOCAL ] EQV: Primary data saved (2157 records). [2025-09-15T18:20:22.669307] [INFO ] [MAIN ] EQV: Full history saved. [2025-09-15T18:20:22.669406] [INFO ] [MAIN ] Update Progress: 761/2369 symbols completed. EQV took 6.6s. Estimated remaining: 2h 49m 43s. Rate: 9.5 symbols/min [2025-09-15T18:20:22.846409] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:20:22.863248] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-09-15T18:20:22.875505] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T18:20:22.898025] [DEBUG] [LOCAL ] ESAB: Loaded 18378 existing records from primary storage. [2025-09-15T18:20:22.898153] [INFO ] [MAIN ] ESAB: Loaded 18378 existing records. [2025-09-15T18:20:23.075465] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:20:23.075785] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-09-15T18:20:23.075842] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-09-15T18:20:23.076367] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-09-15T18:20:23.076424] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-09-15T18:20:23.456141] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:20:23.657926] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-09-15T18:20:24.003330] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-15T18:20:24.233487] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T18:20:24.457887] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-09-15T18:20:24.761102] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-15T18:20:25.257924] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-09-15T18:20:26.008304] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T18:20:26.057880] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-09-15T18:20:26.543699] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-15T18:20:26.857878] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-09-15T18:20:27.410073] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T18:20:27.657869] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-09-15T18:20:28.120459] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-15T18:20:28.457895] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-09-15T18:20:29.187313] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-15T18:20:29.257886] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-09-15T18:20:29.545593] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-15T18:20:30.057893] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-09-15T18:20:30.809771] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T18:20:30.857824] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-09-15T18:20:30.933564] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-15T18:20:31.657936] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-09-15T18:20:32.206431] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T18:20:32.457871] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-09-15T18:20:32.739572] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-15T18:20:33.257872] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-09-15T18:20:34.057926] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-09-15T18:20:34.470403] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-15T18:20:34.589075] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-15T18:20:34.594869] [INFO ] [REMOTE ] ERO: Full fetch complete (44901 records). [2025-09-15T18:20:34.594966] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-09-15T18:20:34.859304] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-09-15T18:20:34.978913] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-09-15T18:20:34.979155] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-09-15T18:20:34.993050] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-09-15T18:20:34.993244] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-09-15T18:20:34.994896] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-15T18:20:35.001232] [DEBUG] [LOCAL ] ERO: Trimmed 44901 records to 29843 (keeping 150 days of data) [2025-09-15T18:20:35.178214] [DEBUG] [LOCAL ] ERO: Primary data saved (29843 records). [2025-09-15T18:20:35.178353] [INFO ] [MAIN ] ERO: Full history saved. [2025-09-15T18:20:35.178439] [INFO ] [MAIN ] Update Progress: 762/2369 symbols completed. ERO took 19.1s. Estimated remaining: 2h 49m 50s. Rate: 9.5 symbols/min [2025-09-15T18:20:35.344122] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:20:35.357070] [DEBUG] [LOCAL ] ESE: Loaded 12305 existing records from primary storage. [2025-09-15T18:20:35.357221] [INFO ] [MAIN ] ESE: Loaded 12305 existing records. [2025-09-15T18:20:35.532271] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:20:35.532559] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-09-15T18:20:35.532607] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-09-15T18:20:35.533080] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-09-15T18:20:35.533132] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-09-15T18:20:35.662982] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-09-15T18:20:35.890186] [INFO ] [REMOTE ] ESE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:20:36.462972] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-09-15T18:20:36.468492] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T18:20:36.866865] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-15T18:20:37.257917] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-09-15T18:20:37.738338] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T18:20:38.057867] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-09-15T18:20:38.603591] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T18:20:38.857882] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-09-15T18:20:39.263365] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-15T18:20:39.646671] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-15T18:20:39.657814] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-09-15T18:20:40.457871] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-09-15T18:20:40.657040] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-15T18:20:41.257912] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-09-15T18:20:41.476723] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T18:20:41.479956] [INFO ] [REMOTE ] ESAB: Full fetch complete (27531 records). [2025-09-15T18:20:41.480092] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-09-15T18:20:41.869908] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-09-15T18:20:41.869988] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-09-15T18:20:41.870508] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-09-15T18:20:41.870557] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-09-15T18:20:41.871457] [DEBUG] [LOCAL ] ESAB: Trimmed 27531 records to 18188 (keeping 150 days of data) [2025-09-15T18:20:41.989130] [DEBUG] [LOCAL ] ESAB: Primary data saved (18188 records). [2025-09-15T18:20:41.989437] [INFO ] [MAIN ] ESAB: Full history saved. [2025-09-15T18:20:41.989580] [INFO ] [MAIN ] Update Progress: 763/2369 symbols completed. ESAB took 19.3s. Estimated remaining: 2h 49m 45s. Rate: 9.5 symbols/min [2025-09-15T18:20:42.059144] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-09-15T18:20:42.181180] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:20:42.185886] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-15T18:20:42.228034] [DEBUG] [LOCAL ] ESI: Loaded 37839 existing records from primary storage. [2025-09-15T18:20:42.228181] [INFO ] [MAIN ] ESI: Loaded 37839 existing records. [2025-09-15T18:20:42.409121] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:20:42.409405] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-09-15T18:20:42.409453] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-09-15T18:20:42.410271] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-09-15T18:20:42.410364] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-09-15T18:20:42.764718] [INFO ] [REMOTE ] ESI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:20:42.857853] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-09-15T18:20:43.657878] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-09-15T18:20:43.852967] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-15T18:20:43.859691] [INFO ] [REMOTE ] ERJ: Full fetch complete (55401 records). [2025-09-15T18:20:43.859923] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-09-15T18:20:44.430948] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-15T18:20:44.460524] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-09-15T18:20:44.571020] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-09-15T18:20:44.571171] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-09-15T18:20:44.572755] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-09-15T18:20:44.572872] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-09-15T18:20:44.575280] [DEBUG] [LOCAL ] ERJ: Trimmed 55401 records to 37326 (keeping 150 days of data) [2025-09-15T18:20:44.880317] [DEBUG] [LOCAL ] ERJ: Primary data saved (37326 records). [2025-09-15T18:20:44.880518] [INFO ] [MAIN ] ERJ: Full history saved. [2025-09-15T18:20:44.880623] [INFO ] [MAIN ] Update Progress: 764/2369 symbols completed. ERJ took 28.8s. Estimated remaining: 2h 49m 31s. Rate: 9.5 symbols/min [2025-09-15T18:20:45.067913] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:20:45.103998] [DEBUG] [LOCAL ] ESNT: Loaded 28299 existing records from primary storage. [2025-09-15T18:20:45.104178] [INFO ] [MAIN ] ESNT: Loaded 28299 existing records. [2025-09-15T18:20:45.288299] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-09-15T18:20:45.332620] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:20:45.332902] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-09-15T18:20:45.332963] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-09-15T18:20:45.333847] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-09-15T18:20:45.334487] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-09-15T18:20:45.336788] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T18:20:45.723129] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:20:45.734945] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-15T18:20:46.057903] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-09-15T18:20:46.857884] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-09-15T18:20:46.894413] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T18:20:47.657940] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-09-15T18:20:47.759182] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-15T18:20:47.774518] [INFO ] [REMOTE ] ES: Full fetch complete (57162 records). [2025-09-15T18:20:47.774714] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-09-15T18:20:48.132417] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-15T18:20:48.172135] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-09-15T18:20:48.172224] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-09-15T18:20:48.173137] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-09-15T18:20:48.173186] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-09-15T18:20:48.174423] [DEBUG] [LOCAL ] ES: Trimmed 57162 records to 38782 (keeping 150 days of data) [2025-09-15T18:20:48.416892] [DEBUG] [LOCAL ] ES: Primary data saved (38782 records). [2025-09-15T18:20:48.417056] [INFO ] [MAIN ] ES: Full history saved. [2025-09-15T18:20:48.417171] [INFO ] [MAIN ] Update Progress: 765/2369 symbols completed. ES took 32.4s. Estimated remaining: 2h 49m 19s. Rate: 9.5 symbols/min [2025-09-15T18:20:48.463100] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-09-15T18:20:48.596869] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:20:48.631785] [DEBUG] [LOCAL ] ESRT: Loaded 34810 existing records from primary storage. [2025-09-15T18:20:48.631947] [INFO ] [MAIN ] ESRT: Loaded 34810 existing records. [2025-09-15T18:20:48.822485] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:20:48.822793] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-09-15T18:20:48.822842] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-09-15T18:20:48.823613] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-09-15T18:20:48.823688] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-09-15T18:20:49.182854] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:20:49.198721] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-15T18:20:49.244263] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-15T18:20:49.257816] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-09-15T18:20:50.057976] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-09-15T18:20:50.495249] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T18:20:50.814711] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-15T18:20:50.857916] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-09-15T18:20:51.657990] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-09-15T18:20:52.457953] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-09-15T18:20:52.508138] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-15T18:20:52.528990] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-15T18:20:52.533182] [INFO ] [REMOTE ] ESE: Full fetch complete (17826 records). [2025-09-15T18:20:52.533298] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-09-15T18:20:52.899198] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-09-15T18:20:52.899287] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-09-15T18:20:52.899718] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-09-15T18:20:52.899762] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-09-15T18:20:52.900294] [DEBUG] [LOCAL ] ESE: Trimmed 17826 records to 12123 (keeping 150 days of data) [2025-09-15T18:20:52.983160] [DEBUG] [LOCAL ] ESE: Primary data saved (12123 records). [2025-09-15T18:20:52.983336] [INFO ] [MAIN ] ESE: Full history saved. [2025-09-15T18:20:52.983444] [INFO ] [MAIN ] Update Progress: 766/2369 symbols completed. ESE took 17.8s. Estimated remaining: 2h 49m 9s. Rate: 9.5 symbols/min [2025-09-15T18:20:53.151801] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:20:53.174407] [DEBUG] [LOCAL ] ESS: Loaded 22486 existing records from primary storage. [2025-09-15T18:20:53.174532] [INFO ] [MAIN ] ESS: Loaded 22486 existing records. [2025-09-15T18:20:53.263141] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-09-15T18:20:53.365517] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:20:53.365969] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-09-15T18:20:53.366050] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-09-15T18:20:53.366694] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-09-15T18:20:53.366751] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-09-15T18:20:53.734358] [INFO ] [REMOTE ] ESS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:20:53.792979] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-15T18:20:54.057884] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-09-15T18:20:54.742742] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T18:20:54.857859] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-09-15T18:20:55.582705] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T18:20:55.657915] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-09-15T18:20:56.463200] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-09-15T18:20:56.483349] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T18:20:56.753868] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-15T18:20:57.257917] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-09-15T18:20:58.057887] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-09-15T18:20:58.083939] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T18:20:58.625171] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-15T18:20:58.857863] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-09-15T18:20:59.515051] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-15T18:20:59.657879] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-09-15T18:21:00.106463] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-15T18:21:00.457881] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-09-15T18:21:01.257909] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-09-15T18:21:01.317692] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-15T18:21:01.323389] [INFO ] [REMOTE ] ESI: Full fetch complete (55163 records). [2025-09-15T18:21:01.323548] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-09-15T18:21:01.706699] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-09-15T18:21:01.706798] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-09-15T18:21:01.707612] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-09-15T18:21:01.707727] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-09-15T18:21:01.709108] [DEBUG] [LOCAL ] ESI: Trimmed 55163 records to 37061 (keeping 150 days of data) [2025-09-15T18:21:01.953907] [DEBUG] [LOCAL ] ESI: Primary data saved (37061 records). [2025-09-15T18:21:01.954091] [INFO ] [MAIN ] ESI: Full history saved. [2025-09-15T18:21:01.954291] [INFO ] [MAIN ] Update Progress: 767/2369 symbols completed. ESI took 20.0s. Estimated remaining: 2h 49m 8s. Rate: 9.5 symbols/min [2025-09-15T18:21:02.058864] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-09-15T18:21:02.131519] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:21:02.150817] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T18:21:02.190441] [DEBUG] [LOCAL ] ESTC: Loaded 37899 existing records from primary storage. [2025-09-15T18:21:02.190661] [INFO ] [MAIN ] ESTC: Loaded 37899 existing records. [2025-09-15T18:21:02.367413] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:21:02.367709] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-09-15T18:21:02.367757] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-09-15T18:21:02.368539] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-09-15T18:21:02.368586] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-09-15T18:21:02.717427] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:21:02.857853] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-09-15T18:21:03.342778] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-15T18:21:03.657870] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-09-15T18:21:04.457869] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-09-15T18:21:05.581167] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (3.52 seconds). [2025-09-15T18:21:05.591312] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-09-15T18:21:05.644209] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-15T18:21:05.805328] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-15T18:21:06.057872] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-09-15T18:21:06.857925] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-09-15T18:21:06.916036] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (4.06 seconds). [2025-09-15T18:21:07.109481] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-15T18:21:07.129536] [INFO ] [REMOTE ] ESNT: Full fetch complete (42537 records). [2025-09-15T18:21:07.139734] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-09-15T18:21:07.142335] [FATAL] [VALIDATOR ] ESNT: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:21:07.142005] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T18:21:07.142575] [FATAL] [MAIN ] ESNT: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:21:07.155663] [WARN ] [MAIN ] ESNT: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:21:07.155763] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-09-15T18:21:07.155861] [DEBUG] [LOCAL ] ESNT: No primary data file found to delete. [2025-09-15T18:21:07.156237] [INFO ] [LOCAL ] ESNT: Starting deletion of derivative data. [2025-09-15T18:21:07.156599] [DEBUG] [LOCAL ] ESNT: Deleted derivative data file. [2025-09-15T18:21:07.156742] [INFO ] [MAIN ] Update Progress: 768/2369 symbols completed. ESNT took 22.3s. Estimated remaining: 2h 48m 59s. Rate: 9.5 symbols/min [2025-09-15T18:21:07.326782] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:21:07.374368] [DEBUG] [LOCAL ] ET: Loaded 40530 existing records from primary storage. [2025-09-15T18:21:07.374532] [INFO ] [MAIN ] ET: Loaded 40530 existing records. [2025-09-15T18:21:07.556193] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:21:07.556462] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-09-15T18:21:07.556509] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-09-15T18:21:07.557405] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-09-15T18:21:07.557461] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-09-15T18:21:07.661696] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-09-15T18:21:07.918835] [INFO ] [REMOTE ] ET: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:21:07.965008] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T18:21:08.457902] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-09-15T18:21:09.257890] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-09-15T18:21:10.007424] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-15T18:21:10.057864] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-09-15T18:21:10.407486] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-15T18:21:10.452179] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-15T18:21:10.857884] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-09-15T18:21:11.417964] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-15T18:21:11.657875] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-09-15T18:21:12.279614] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T18:21:12.457873] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-09-15T18:21:12.861012] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-15T18:21:13.257842] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-09-15T18:21:13.297504] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-15T18:21:14.057873] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-09-15T18:21:14.838499] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T18:21:14.857843] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-09-15T18:21:15.657930] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-09-15T18:21:16.457991] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-09-15T18:21:17.204590] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (3.15 seconds). [2025-09-15T18:21:17.250979] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-15T18:21:17.261146] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-09-15T18:21:18.051358] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-15T18:21:18.054606] [INFO ] [REMOTE ] ESS: Full fetch complete (32699 records). [2025-09-15T18:21:18.054719] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-09-15T18:21:18.086486] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-09-15T18:21:18.425296] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-09-15T18:21:18.425378] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-09-15T18:21:18.426002] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-09-15T18:21:18.426047] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-09-15T18:21:18.426890] [DEBUG] [LOCAL ] ESS: Trimmed 32699 records to 21846 (keeping 150 days of data) [2025-09-15T18:21:18.570883] [DEBUG] [LOCAL ] ESS: Primary data saved (21846 records). [2025-09-15T18:21:18.571020] [INFO ] [MAIN ] ESS: Full history saved. [2025-09-15T18:21:18.571123] [INFO ] [MAIN ] Update Progress: 769/2369 symbols completed. ESS took 25.6s. Estimated remaining: 2h 49m 4s. Rate: 9.5 symbols/min [2025-09-15T18:21:18.752695] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:21:18.764087] [DEBUG] [LOCAL ] ETB: Loaded 8298 existing records from primary storage. [2025-09-15T18:21:18.764246] [INFO ] [MAIN ] ETB: Loaded 8298 existing records. [2025-09-15T18:21:18.946120] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:21:18.946839] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-09-15T18:21:18.946918] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-09-15T18:21:18.947283] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-09-15T18:21:18.947459] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-09-15T18:21:19.200087] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-09-15T18:21:19.307447] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-09-15T18:21:19.396164] [INFO ] [REMOTE ] ETB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:21:19.657938] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-09-15T18:21:19.868052] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-09-15T18:21:19.961696] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-15T18:21:20.457870] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-09-15T18:21:20.663957] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-15T18:21:20.705563] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-15T18:21:21.257884] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-09-15T18:21:21.809066] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-15T18:21:21.834746] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-15T18:21:22.057863] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-09-15T18:21:22.857935] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-09-15T18:21:23.000454] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-15T18:21:23.657923] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-09-15T18:21:24.457891] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-09-15T18:21:24.536629] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T18:21:25.257899] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-09-15T18:21:25.306790] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-15T18:21:25.857585] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-15T18:21:26.057870] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-09-15T18:21:26.857873] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-09-15T18:21:26.951427] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-15T18:21:27.178934] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-15T18:21:27.185372] [INFO ] [REMOTE ] ESTC: Full fetch complete (54528 records). [2025-09-15T18:21:27.185572] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-09-15T18:21:27.573949] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-09-15T18:21:27.574056] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-09-15T18:21:27.575099] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-09-15T18:21:27.575152] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-09-15T18:21:27.576698] [DEBUG] [LOCAL ] ESTC: Trimmed 54528 records to 37222 (keeping 150 days of data) [2025-09-15T18:21:27.664807] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-09-15T18:21:27.807163] [DEBUG] [LOCAL ] ESTC: Primary data saved (37222 records). [2025-09-15T18:21:27.807326] [INFO ] [MAIN ] ESTC: Full history saved. [2025-09-15T18:21:27.807418] [INFO ] [MAIN ] Update Progress: 770/2369 symbols completed. ESTC took 25.9s. Estimated remaining: 2h 49m 3s. Rate: 9.5 symbols/min [2025-09-15T18:21:27.992277] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:21:28.011757] [DEBUG] [LOCAL ] ETD: Loaded 20670 existing records from primary storage. [2025-09-15T18:21:28.011877] [INFO ] [MAIN ] ETD: Loaded 20670 existing records. [2025-09-15T18:21:28.184780] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:21:28.185024] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-09-15T18:21:28.185070] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-09-15T18:21:28.185565] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-09-15T18:21:28.185611] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-09-15T18:21:28.461278] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-09-15T18:21:28.540881] [INFO ] [REMOTE ] ETD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:21:28.649773] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-15T18:21:29.257845] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-09-15T18:21:29.344410] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-09-15T18:21:30.057865] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-09-15T18:21:30.203880] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T18:21:30.486483] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-15T18:21:30.491412] [INFO ] [REMOTE ] ESRT: Full fetch complete (50103 records). [2025-09-15T18:21:30.491505] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-09-15T18:21:30.869917] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-09-15T18:21:30.872829] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-09-15T18:21:30.873891] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-09-15T18:21:30.874884] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-09-15T18:21:30.875052] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-09-15T18:21:30.876397] [DEBUG] [LOCAL ] ESRT: Trimmed 50103 records to 34095 (keeping 150 days of data) [2025-09-15T18:21:31.079873] [DEBUG] [LOCAL ] ESRT: Primary data saved (34095 records). [2025-09-15T18:21:31.080044] [INFO ] [MAIN ] ESRT: Full history saved. [2025-09-15T18:21:31.080152] [INFO ] [MAIN ] Update Progress: 771/2369 symbols completed. ESRT took 42.7s. Estimated remaining: 2h 48m 51s. Rate: 9.5 symbols/min [2025-09-15T18:21:31.276019] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:21:31.297004] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T18:21:31.315416] [DEBUG] [LOCAL ] ETG: Loaded 12352 existing records from primary storage. [2025-09-15T18:21:31.315607] [INFO ] [MAIN ] ETG: Loaded 12352 existing records. [2025-09-15T18:21:31.502130] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:21:31.502402] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-09-15T18:21:31.502473] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-09-15T18:21:31.503026] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-09-15T18:21:31.503097] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-09-15T18:21:31.665059] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-09-15T18:21:31.894043] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T18:21:31.893901] [INFO ] [REMOTE ] ETG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:21:31.895636] [INFO ] [REMOTE ] ETB: Full fetch complete (13809 records). [2025-09-15T18:21:31.895730] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-09-15T18:21:31.896100] [FATAL] [VALIDATOR ] ETB: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:21:31.896175] [FATAL] [MAIN ] ETB: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:21:31.896211] [WARN ] [MAIN ] ETB: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:21:31.896254] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-09-15T18:21:31.896310] [DEBUG] [LOCAL ] ETB: No primary data file found to delete. [2025-09-15T18:21:31.896386] [INFO ] [LOCAL ] ETB: Starting deletion of derivative data. [2025-09-15T18:21:31.896686] [DEBUG] [LOCAL ] ETB: Deleted derivative data file. [2025-09-15T18:21:31.896773] [INFO ] [MAIN ] Update Progress: 772/2369 symbols completed. ETB took 13.3s. Estimated remaining: 2h 48m 33s. Rate: 9.5 symbols/min [2025-09-15T18:21:32.063139] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:21:32.074312] [DEBUG] [LOCAL ] ETJ: Loaded 11407 existing records from primary storage. [2025-09-15T18:21:32.074405] [INFO ] [MAIN ] ETJ: Loaded 11407 existing records. [2025-09-15T18:21:32.250625] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:21:32.250915] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-09-15T18:21:32.250962] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-09-15T18:21:32.251301] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-09-15T18:21:32.251348] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-09-15T18:21:32.465226] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-09-15T18:21:32.625895] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:21:32.878540] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-15T18:21:33.257913] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-09-15T18:21:34.057899] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-09-15T18:21:34.384595] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-15T18:21:34.471859] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T18:21:34.857892] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-09-15T18:21:35.185058] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-15T18:21:35.657881] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-09-15T18:21:36.457918] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-09-15T18:21:36.674603] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-15T18:21:36.902044] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-15T18:21:37.229479] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-15T18:21:37.258000] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-09-15T18:21:38.057937] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-09-15T18:21:38.614436] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-15T18:21:38.857897] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-09-15T18:21:39.657965] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-09-15T18:21:39.768423] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-15T18:21:39.774856] [INFO ] [REMOTE ] ET: Full fetch complete (58470 records). [2025-09-15T18:21:39.774983] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-09-15T18:21:40.168282] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-09-15T18:21:40.168424] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-09-15T18:21:40.169223] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-09-15T18:21:40.169275] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-09-15T18:21:40.171357] [DEBUG] [LOCAL ] ET: Trimmed 58470 records to 39750 (keeping 150 days of data) [2025-09-15T18:21:40.434186] [DEBUG] [LOCAL ] ET: Primary data saved (39750 records). [2025-09-15T18:21:40.434554] [INFO ] [MAIN ] ET: Full history saved. [2025-09-15T18:21:40.436270] [INFO ] [MAIN ] Update Progress: 773/2369 symbols completed. ET took 33.3s. Estimated remaining: 2h 48m 31s. Rate: 9.5 symbols/min [2025-09-15T18:21:40.473327] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-09-15T18:21:40.564198] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-15T18:21:40.646352] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:21:40.660774] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-15T18:21:40.702358] [DEBUG] [LOCAL ] ETN: Loaded 39663 existing records from primary storage. [2025-09-15T18:21:40.702530] [INFO ] [MAIN ] ETN: Loaded 39663 existing records. [2025-09-15T18:21:40.892885] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:21:40.893237] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-09-15T18:21:40.893294] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-09-15T18:21:40.894309] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-09-15T18:21:40.894362] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-09-15T18:21:41.245301] [INFO ] [REMOTE ] ETN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:21:41.257873] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-09-15T18:21:41.386155] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-15T18:21:42.057880] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-09-15T18:21:42.857877] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-09-15T18:21:43.005804] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-15T18:21:43.397840] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-15T18:21:43.661026] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-09-15T18:21:43.661976] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-15T18:21:44.457888] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-09-15T18:21:44.754999] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-15T18:21:45.257903] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-09-15T18:21:45.415479] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-15T18:21:46.057871] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-09-15T18:21:46.181723] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-15T18:21:46.857879] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-09-15T18:21:47.085312] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-15T18:21:47.619802] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-15T18:21:47.657922] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-09-15T18:21:48.457888] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-09-15T18:21:49.233008] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T18:21:49.257838] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-09-15T18:21:49.378700] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-15T18:21:50.057910] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-09-15T18:21:50.857891] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-09-15T18:21:50.880576] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-15T18:21:50.882621] [INFO ] [REMOTE ] ETG: Full fetch complete (18405 records). [2025-09-15T18:21:50.882714] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-09-15T18:21:51.259881] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-09-15T18:21:51.260137] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-09-15T18:21:51.260699] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-09-15T18:21:51.260790] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-09-15T18:21:51.261963] [DEBUG] [LOCAL ] ETG: Trimmed 18405 records to 12094 (keeping 150 days of data) [2025-09-15T18:21:51.366409] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-15T18:21:51.382676] [DEBUG] [LOCAL ] ETG: Primary data saved (12094 records). [2025-09-15T18:21:51.382796] [INFO ] [MAIN ] ETG: Full history saved. [2025-09-15T18:21:51.382875] [INFO ] [MAIN ] Update Progress: 774/2369 symbols completed. ETG took 20.3s. Estimated remaining: 2h 48m 34s. Rate: 9.5 symbols/min [2025-09-15T18:21:51.556970] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:21:51.568490] [DEBUG] [LOCAL ] ETO: Loaded 4919 existing records from primary storage. [2025-09-15T18:21:51.568627] [INFO ] [MAIN ] ETO: Loaded 4919 existing records. [2025-09-15T18:21:51.662980] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-09-15T18:21:51.791236] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:21:51.791539] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-09-15T18:21:51.791591] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-09-15T18:21:51.791952] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-09-15T18:21:51.792005] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-09-15T18:21:52.180300] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T18:21:52.183910] [INFO ] [REMOTE ] ETO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:21:52.457885] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-09-15T18:21:52.704813] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-15T18:21:53.257876] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-09-15T18:21:53.798400] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-15T18:21:53.984531] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-15T18:21:54.057892] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-09-15T18:21:54.857928] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-09-15T18:21:55.420481] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-15T18:21:55.424002] [INFO ] [REMOTE ] ETD: Full fetch complete (29582 records). [2025-09-15T18:21:55.424106] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-09-15T18:21:55.669629] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-09-15T18:21:55.803470] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-09-15T18:21:55.803553] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-09-15T18:21:55.804100] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-09-15T18:21:55.804144] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-09-15T18:21:55.805008] [DEBUG] [LOCAL ] ETD: Trimmed 29582 records to 20372 (keeping 150 days of data) [2025-09-15T18:21:55.929499] [DEBUG] [LOCAL ] ETD: Primary data saved (20372 records). [2025-09-15T18:21:55.929631] [INFO ] [MAIN ] ETD: Full history saved. [2025-09-15T18:21:55.929730] [INFO ] [MAIN ] Update Progress: 775/2369 symbols completed. ETD took 28.1s. Estimated remaining: 2h 48m 24s. Rate: 9.5 symbols/min [2025-09-15T18:21:56.099816] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:21:56.136673] [DEBUG] [LOCAL ] ETR: Loaded 40047 existing records from primary storage. [2025-09-15T18:21:56.136814] [INFO ] [MAIN ] ETR: Loaded 40047 existing records. [2025-09-15T18:21:56.318178] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:21:56.318548] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-09-15T18:21:56.322667] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-09-15T18:21:56.323298] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-15T18:21:56.324802] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-09-15T18:21:56.325378] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-09-15T18:21:56.464743] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-09-15T18:21:56.688248] [INFO ] [REMOTE ] ETR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:21:56.720791] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-15T18:21:57.257867] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-09-15T18:21:57.326785] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-15T18:21:58.057928] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-09-15T18:21:58.770162] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-15T18:21:58.857876] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-09-15T18:21:58.990274] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-15T18:21:59.439293] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-15T18:21:59.657878] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-09-15T18:22:00.457869] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-09-15T18:22:00.737344] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-15T18:22:01.257916] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-09-15T18:22:02.057929] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-09-15T18:22:02.587452] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-15T18:22:02.659868] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-15T18:22:02.857898] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-09-15T18:22:03.656011] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-15T18:22:03.667090] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-09-15T18:22:04.457881] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-09-15T18:22:04.493635] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-15T18:22:04.572964] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-15T18:22:05.257905] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-09-15T18:22:06.057924] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-09-15T18:22:06.388667] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-15T18:22:06.652323] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-15T18:22:06.653499] [INFO ] [REMOTE ] ETO: Full fetch complete (7165 records). [2025-09-15T18:22:06.653572] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-09-15T18:22:06.864862] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-09-15T18:22:07.020046] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-09-15T18:22:07.020139] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-09-15T18:22:07.020351] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-09-15T18:22:07.020391] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-09-15T18:22:07.020815] [DEBUG] [LOCAL ] ETO: Trimmed 7165 records to 4841 (keeping 150 days of data) [2025-09-15T18:22:07.053523] [DEBUG] [LOCAL ] ETO: Primary data saved (4841 records). [2025-09-15T18:22:07.053676] [INFO ] [MAIN ] ETO: Full history saved. [2025-09-15T18:22:07.053791] [INFO ] [MAIN ] Update Progress: 776/2369 symbols completed. ETO took 15.7s. Estimated remaining: 2h 48m 28s. Rate: 9.5 symbols/min [2025-09-15T18:22:07.223698] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:22:07.240537] [DEBUG] [LOCAL ] ETV: Loaded 15357 existing records from primary storage. [2025-09-15T18:22:07.240694] [INFO ] [MAIN ] ETV: Loaded 15357 existing records. [2025-09-15T18:22:07.416095] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:22:07.416460] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-09-15T18:22:07.416572] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-09-15T18:22:07.417096] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-09-15T18:22:07.417153] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-09-15T18:22:07.501365] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-15T18:22:07.553206] [INFO ] [REMOTE ] ETN: Full fetch complete (57558 records). [2025-09-15T18:22:07.568678] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-09-15T18:22:07.659524] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-09-15T18:22:07.842472] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T18:22:07.861022] [INFO ] [REMOTE ] ETJ: Full fetch complete (18512 records). [2025-09-15T18:22:07.888108] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-09-15T18:22:08.019323] [INFO ] [REMOTE ] ETV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:22:08.461313] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-09-15T18:22:08.486723] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-09-15T18:22:08.492579] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-09-15T18:22:08.493455] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-09-15T18:22:08.498615] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-09-15T18:22:08.568887] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-09-15T18:22:08.569014] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-09-15T18:22:08.569311] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-09-15T18:22:08.569085] [DEBUG] [LOCAL ] ETN: Trimmed 57558 records to 38883 (keeping 150 days of data) [2025-09-15T18:22:08.569377] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-09-15T18:22:08.570491] [DEBUG] [LOCAL ] ETJ: Trimmed 18512 records to 10939 (keeping 150 days of data) [2025-09-15T18:22:08.745845] [DEBUG] [LOCAL ] ETJ: Primary data saved (10939 records). [2025-09-15T18:22:08.753535] [INFO ] [MAIN ] ETJ: Full history saved. [2025-09-15T18:22:08.753889] [INFO ] [MAIN ] Update Progress: 777/2369 symbols completed. ETJ took 36.9s. Estimated remaining: 2h 48m 12s. Rate: 9.5 symbols/min [2025-09-15T18:22:09.004828] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:22:09.057253] [DEBUG] [LOCAL ] ETW: Loaded 18395 existing records from primary storage. [2025-09-15T18:22:09.058174] [INFO ] [MAIN ] ETW: Loaded 18395 existing records. [2025-09-15T18:22:09.243942] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:22:09.245672] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-09-15T18:22:09.245953] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-09-15T18:22:09.247510] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-09-15T18:22:09.247573] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-09-15T18:22:09.410704] [DEBUG] [LOCAL ] ETN: Primary data saved (38883 records). [2025-09-15T18:22:09.463944] [INFO ] [MAIN ] ETN: Full history saved. [2025-09-15T18:22:09.501153] [INFO ] [MAIN ] Update Progress: 778/2369 symbols completed. ETN took 29.1s. Estimated remaining: 2h 47m 54s. Rate: 9.5 symbols/min [2025-09-15T18:22:09.719659] [INFO ] [REMOTE ] ETW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:22:09.725747] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-09-15T18:22:09.802536] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:22:09.805693] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-15T18:22:09.832586] [DEBUG] [LOCAL ] ETX: Loaded 4115 existing records from primary storage. [2025-09-15T18:22:09.842331] [INFO ] [MAIN ] ETX: Loaded 4115 existing records. [2025-09-15T18:22:09.937652] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-15T18:22:10.032944] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:22:10.033224] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-09-15T18:22:10.033272] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-09-15T18:22:10.033564] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-09-15T18:22:10.033610] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-09-15T18:22:10.063697] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-09-15T18:22:10.382694] [INFO ] [REMOTE ] ETX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:22:10.577286] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-15T18:22:10.857931] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-09-15T18:22:11.034066] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-15T18:22:11.657876] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-09-15T18:22:12.176759] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T18:22:12.457917] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-09-15T18:22:12.877593] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-15T18:22:13.257862] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-09-15T18:22:13.839084] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-15T18:22:14.057843] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-09-15T18:22:14.332867] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-15T18:22:14.857884] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-09-15T18:22:15.433625] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-15T18:22:15.657936] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-09-15T18:22:16.003215] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-15T18:22:16.443519] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-15T18:22:16.457820] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-09-15T18:22:17.257867] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-09-15T18:22:17.743069] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-15T18:22:18.057898] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-09-15T18:22:18.552519] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T18:22:18.558620] [INFO ] [REMOTE ] ETR: Full fetch complete (57927 records). [2025-09-15T18:22:18.558796] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-09-15T18:22:18.858152] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-09-15T18:22:18.951538] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-09-15T18:22:18.951622] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-09-15T18:22:18.952466] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-09-15T18:22:18.952513] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-09-15T18:22:18.953799] [DEBUG] [LOCAL ] ETR: Trimmed 57927 records to 39268 (keeping 150 days of data) [2025-09-15T18:22:19.086124] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-15T18:22:19.230437] [DEBUG] [LOCAL ] ETR: Primary data saved (39268 records). [2025-09-15T18:22:19.230588] [INFO ] [MAIN ] ETR: Full history saved. [2025-09-15T18:22:19.230696] [INFO ] [MAIN ] Update Progress: 779/2369 symbols completed. ETR took 23.3s. Estimated remaining: 2h 47m 55s. Rate: 9.5 symbols/min [2025-09-15T18:22:19.399109] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:22:19.415664] [DEBUG] [LOCAL ] ETY: Loaded 16489 existing records from primary storage. [2025-09-15T18:22:19.415796] [INFO ] [MAIN ] ETY: Loaded 16489 existing records. [2025-09-15T18:22:19.602845] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:22:19.603083] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-09-15T18:22:19.603128] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-09-15T18:22:19.603700] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-09-15T18:22:19.603751] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-09-15T18:22:19.666291] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-09-15T18:22:19.987722] [INFO ] [REMOTE ] ETY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:22:19.991688] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-15T18:22:20.457873] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-09-15T18:22:20.865406] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-15T18:22:21.257841] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-09-15T18:22:21.590731] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-15T18:22:22.057869] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-09-15T18:22:22.260556] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-15T18:22:22.511841] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-15T18:22:22.857867] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-09-15T18:22:23.657914] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-09-15T18:22:23.996960] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-15T18:22:24.106720] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-15T18:22:24.457905] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-09-15T18:22:25.257877] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-09-15T18:22:25.514745] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T18:22:25.845032] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-15T18:22:26.057887] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-09-15T18:22:26.775848] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-15T18:22:26.857880] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-09-15T18:22:27.438921] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-15T18:22:27.657885] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-09-15T18:22:28.457905] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-09-15T18:22:28.596183] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-15T18:22:28.599149] [INFO ] [REMOTE ] ETV: Full fetch complete (23232 records). [2025-09-15T18:22:28.599244] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-09-15T18:22:28.946961] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-15T18:22:28.992904] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-09-15T18:22:28.992999] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-09-15T18:22:28.993529] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-09-15T18:22:28.993572] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-09-15T18:22:28.994535] [DEBUG] [LOCAL ] ETV: Trimmed 23232 records to 14880 (keeping 150 days of data) [2025-09-15T18:22:29.088456] [DEBUG] [LOCAL ] ETV: Primary data saved (14880 records). [2025-09-15T18:22:29.088605] [INFO ] [MAIN ] ETV: Full history saved. [2025-09-15T18:22:29.088715] [INFO ] [MAIN ] Update Progress: 780/2369 symbols completed. ETV took 22.0s. Estimated remaining: 2h 47m 55s. Rate: 9.5 symbols/min [2025-09-15T18:22:29.258666] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:22:29.258795] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-09-15T18:22:29.274402] [DEBUG] [LOCAL ] EVC: Loaded 14021 existing records from primary storage. [2025-09-15T18:22:29.274526] [INFO ] [MAIN ] EVC: Loaded 14021 existing records. [2025-09-15T18:22:29.450763] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:22:29.451053] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-09-15T18:22:29.451100] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-09-15T18:22:29.451517] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-09-15T18:22:29.451570] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-09-15T18:22:29.816995] [INFO ] [REMOTE ] EVC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:22:30.057886] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-09-15T18:22:30.109152] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-15T18:22:30.857842] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-09-15T18:22:31.114203] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T18:22:31.657899] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-09-15T18:22:31.699820] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-15T18:22:32.397483] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-15T18:22:32.398706] [INFO ] [REMOTE ] ETX: Full fetch complete (5251 records). [2025-09-15T18:22:32.398774] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-09-15T18:22:32.399154] [FATAL] [VALIDATOR ] ETX: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:22:32.399230] [FATAL] [MAIN ] ETX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:22:32.399326] [WARN ] [MAIN ] ETX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:22:32.399377] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-09-15T18:22:32.399449] [DEBUG] [LOCAL ] ETX: No primary data file found to delete. [2025-09-15T18:22:32.399500] [INFO ] [LOCAL ] ETX: Starting deletion of derivative data. [2025-09-15T18:22:32.399869] [DEBUG] [LOCAL ] ETX: Deleted derivative data file. [2025-09-15T18:22:32.399956] [INFO ] [MAIN ] Update Progress: 781/2369 symbols completed. ETX took 22.9s. Estimated remaining: 2h 47m 43s. Rate: 9.5 symbols/min [2025-09-15T18:22:32.463349] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-09-15T18:22:32.583785] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:22:32.608266] [DEBUG] [LOCAL ] EVEX: Loaded 22451 existing records from primary storage. [2025-09-15T18:22:32.608409] [INFO ] [MAIN ] EVEX: Loaded 22451 existing records. [2025-09-15T18:22:32.789329] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:22:32.789594] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-09-15T18:22:32.789658] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-09-15T18:22:32.790109] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-09-15T18:22:32.790153] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-09-15T18:22:33.136469] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:22:33.257870] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-09-15T18:22:33.545792] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-15T18:22:33.548973] [INFO ] [REMOTE ] ETW: Full fetch complete (27153 records). [2025-09-15T18:22:33.549046] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-09-15T18:22:33.908116] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-09-15T18:22:33.908190] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-09-15T18:22:33.908664] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-09-15T18:22:33.908715] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-09-15T18:22:33.909460] [DEBUG] [LOCAL ] ETW: Trimmed 27153 records to 17970 (keeping 150 days of data) [2025-09-15T18:22:34.018532] [DEBUG] [LOCAL ] ETW: Primary data saved (17970 records). [2025-09-15T18:22:34.018681] [INFO ] [MAIN ] ETW: Full history saved. [2025-09-15T18:22:34.018801] [INFO ] [MAIN ] Update Progress: 782/2369 symbols completed. ETW took 25.3s. Estimated remaining: 2h 47m 27s. Rate: 9.5 symbols/min [2025-09-15T18:22:34.063057] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-09-15T18:22:34.194095] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:22:34.202474] [DEBUG] [LOCAL ] EVF: Loaded 6509 existing records from primary storage. [2025-09-15T18:22:34.202562] [INFO ] [MAIN ] EVF: Loaded 6509 existing records. [2025-09-15T18:22:34.377900] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:22:34.378154] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-09-15T18:22:34.378207] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-09-15T18:22:34.383873] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-09-15T18:22:34.389841] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-09-15T18:22:34.433791] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-15T18:22:34.746198] [INFO ] [REMOTE ] EVF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:22:34.857855] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-09-15T18:22:35.357523] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-15T18:22:35.455015] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-15T18:22:35.657880] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-09-15T18:22:36.457900] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-09-15T18:22:36.956784] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-15T18:22:37.257886] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-09-15T18:22:37.745940] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-15T18:22:37.967078] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-15T18:22:38.057851] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-09-15T18:22:38.857864] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-09-15T18:22:39.064220] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-15T18:22:39.657874] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-09-15T18:22:39.797002] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-15T18:22:40.413242] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-15T18:22:40.457846] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-09-15T18:22:41.231477] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-15T18:22:41.257823] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-09-15T18:22:41.973348] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-15T18:22:42.057861] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-09-15T18:22:42.857869] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-09-15T18:22:43.299498] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T18:22:43.657859] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-09-15T18:22:43.882088] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-15T18:22:44.457908] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-09-15T18:22:44.624836] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-15T18:22:45.039813] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-15T18:22:45.257869] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-09-15T18:22:46.057886] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-09-15T18:22:46.140392] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-15T18:22:46.857899] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-09-15T18:22:47.151075] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-15T18:22:47.657871] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-09-15T18:22:47.790086] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-15T18:22:48.457873] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-09-15T18:22:49.217935] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-15T18:22:49.257872] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-09-15T18:22:49.532333] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-15T18:22:50.057943] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-09-15T18:22:50.225954] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-15T18:22:50.857949] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-09-15T18:22:51.619426] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-15T18:22:51.657811] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-09-15T18:22:51.806754] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T18:22:52.457881] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-09-15T18:22:53.148837] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-15T18:22:53.154146] [INFO ] [REMOTE ] EVEX: Full fetch complete (30709 records). [2025-09-15T18:22:53.154294] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-09-15T18:22:53.262944] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-09-15T18:22:53.459254] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-15T18:22:53.561787] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-09-15T18:22:53.561892] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-09-15T18:22:53.562529] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-09-15T18:22:53.562594] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-09-15T18:22:53.564403] [DEBUG] [LOCAL ] EVEX: Trimmed 30709 records to 22449 (keeping 150 days of data) [2025-09-15T18:22:53.719506] [DEBUG] [LOCAL ] EVEX: Primary data saved (22449 records). [2025-09-15T18:22:53.719735] [INFO ] [MAIN ] EVEX: Full history saved. [2025-09-15T18:22:53.719881] [INFO ] [MAIN ] Update Progress: 783/2369 symbols completed. EVEX took 21.3s. Estimated remaining: 2h 47m 48s. Rate: 9.5 symbols/min [2025-09-15T18:22:53.893928] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:22:53.901138] [DEBUG] [LOCAL ] EVG: Loaded 4298 existing records from primary storage. [2025-09-15T18:22:53.901236] [INFO ] [MAIN ] EVG: Loaded 4298 existing records. [2025-09-15T18:22:54.070941] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-09-15T18:22:54.075408] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:22:54.076562] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-09-15T18:22:54.076610] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-09-15T18:22:54.076886] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-09-15T18:22:54.076935] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-09-15T18:22:54.422100] [INFO ] [REMOTE ] EVG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:22:54.496121] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T18:22:54.694863] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T18:22:54.696353] [INFO ] [REMOTE ] EVF: Full fetch complete (9497 records). [2025-09-15T18:22:54.696423] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-09-15T18:22:54.868151] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-09-15T18:22:55.059563] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-09-15T18:22:55.059659] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-09-15T18:22:55.059887] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-09-15T18:22:55.059928] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-09-15T18:22:55.060372] [DEBUG] [LOCAL ] EVF: Trimmed 9497 records to 6398 (keeping 150 days of data) [2025-09-15T18:22:55.098651] [DEBUG] [LOCAL ] EVF: Primary data saved (6398 records). [2025-09-15T18:22:55.098781] [INFO ] [MAIN ] EVF: Full history saved. [2025-09-15T18:22:55.098869] [INFO ] [MAIN ] Update Progress: 784/2369 symbols completed. EVF took 21.1s. Estimated remaining: 2h 47m 31s. Rate: 9.5 symbols/min [2025-09-15T18:22:55.267881] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:22:55.307186] [DEBUG] [LOCAL ] EVH: Loaded 37038 existing records from primary storage. [2025-09-15T18:22:55.307339] [INFO ] [MAIN ] EVH: Loaded 37038 existing records. [2025-09-15T18:22:55.485096] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:22:55.485383] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-09-15T18:22:55.485437] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-09-15T18:22:55.486226] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-09-15T18:22:55.486276] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-09-15T18:22:55.662983] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-09-15T18:22:55.847204] [INFO ] [REMOTE ] EVH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:22:55.995125] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-15T18:22:55.997607] [INFO ] [REMOTE ] EVC: Full fetch complete (22103 records). [2025-09-15T18:22:55.997720] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-09-15T18:22:56.364202] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-09-15T18:22:56.364302] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-09-15T18:22:56.364834] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-09-15T18:22:56.364880] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-09-15T18:22:56.365524] [DEBUG] [LOCAL ] EVC: Trimmed 22103 records to 13742 (keeping 150 days of data) [2025-09-15T18:22:56.451516] [DEBUG] [LOCAL ] EVC: Primary data saved (13742 records). [2025-09-15T18:22:56.451684] [INFO ] [MAIN ] EVC: Full history saved. [2025-09-15T18:22:56.451782] [INFO ] [MAIN ] Update Progress: 785/2369 symbols completed. EVC took 27.4s. Estimated remaining: 2h 47m 15s. Rate: 9.5 symbols/min [2025-09-15T18:22:56.463217] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-09-15T18:22:56.628489] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:22:56.635862] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-15T18:22:56.638401] [INFO ] [REMOTE ] ETY: Full fetch complete (25332 records). [2025-09-15T18:22:56.638480] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-09-15T18:22:56.641099] [FATAL] [VALIDATOR ] ETY: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:22:56.641211] [FATAL] [MAIN ] ETY: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:22:56.641251] [WARN ] [MAIN ] ETY: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:22:56.641289] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-09-15T18:22:56.641347] [DEBUG] [LOCAL ] ETY: No primary data file found to delete. [2025-09-15T18:22:56.641414] [INFO ] [LOCAL ] ETY: Starting deletion of derivative data. [2025-09-15T18:22:56.641739] [DEBUG] [LOCAL ] ETY: Deleted derivative data file. [2025-09-15T18:22:56.641861] [INFO ] [MAIN ] Update Progress: 786/2369 symbols completed. ETY took 37.4s. Estimated remaining: 2h 46m 56s. Rate: 9.5 symbols/min [2025-09-15T18:22:56.690057] [DEBUG] [LOCAL ] EVN: Loaded 7883 existing records from primary storage. [2025-09-15T18:22:56.725661] [INFO ] [MAIN ] EVN: Loaded 7883 existing records. [2025-09-15T18:22:56.950945] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:22:57.018982] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:22:57.019371] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-09-15T18:22:57.019426] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-09-15T18:22:57.019782] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-09-15T18:22:57.019834] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-09-15T18:22:57.211408] [DEBUG] [LOCAL ] EVR: Loaded 25593 existing records from primary storage. [2025-09-15T18:22:57.212146] [INFO ] [MAIN ] EVR: Loaded 25593 existing records. [2025-09-15T18:22:57.291092] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-09-15T18:22:57.497904] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-15T18:22:57.537885] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:22:57.548327] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-09-15T18:22:57.558570] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-09-15T18:22:57.593695] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-09-15T18:22:57.611031] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-09-15T18:22:57.614548] [INFO ] [REMOTE ] EVN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:22:57.992112] [INFO ] [REMOTE ] EVR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:22:58.057886] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-09-15T18:22:58.857865] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-09-15T18:22:58.999512] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T18:22:59.120198] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-15T18:22:59.657920] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-09-15T18:23:00.457897] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-09-15T18:23:01.257923] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-09-15T18:23:01.894557] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-15T18:23:02.020568] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T18:23:02.057832] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-09-15T18:23:02.857889] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-09-15T18:23:03.670075] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-15T18:23:03.680597] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-09-15T18:23:05.007383] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (6.15 seconds). [2025-09-15T18:23:05.009165] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-09-15T18:23:06.113939] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-15T18:23:06.116430] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-09-15T18:23:06.297488] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (6.64 seconds). [2025-09-15T18:23:06.315164] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-09-15T18:23:06.315571] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (3.46 seconds). [2025-09-15T18:23:06.495380] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (2.81 seconds). [2025-09-15T18:23:06.671134] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-15T18:23:06.857961] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-09-15T18:23:07.657931] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-09-15T18:23:07.969409] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-15T18:23:08.219662] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-15T18:23:08.457929] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-09-15T18:23:09.257892] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-09-15T18:23:09.291485] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-15T18:23:09.915520] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T18:23:10.057897] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-09-15T18:23:10.626778] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-15T18:23:10.857910] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-09-15T18:23:11.588293] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T18:23:11.657904] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-09-15T18:23:12.062727] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (5.20 seconds). [2025-09-15T18:23:12.457934] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-09-15T18:23:12.484197] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-15T18:23:13.257919] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-09-15T18:23:13.671126] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-15T18:23:14.057881] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-09-15T18:23:14.220014] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T18:23:14.497369] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-15T18:23:14.499361] [INFO ] [REMOTE ] EVG: Full fetch complete (6192 records). [2025-09-15T18:23:14.499474] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-09-15T18:23:14.871741] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-09-15T18:23:14.879404] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-09-15T18:23:14.879489] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-09-15T18:23:14.879690] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-09-15T18:23:14.879748] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-09-15T18:23:14.880178] [DEBUG] [LOCAL ] EVG: Trimmed 6192 records to 4289 (keeping 150 days of data) [2025-09-15T18:23:14.909589] [DEBUG] [LOCAL ] EVG: Primary data saved (4289 records). [2025-09-15T18:23:14.909704] [INFO ] [MAIN ] EVG: Full history saved. [2025-09-15T18:23:14.909805] [INFO ] [MAIN ] Update Progress: 787/2369 symbols completed. EVG took 21.2s. Estimated remaining: 2h 47m 14s. Rate: 9.5 symbols/min [2025-09-15T18:23:15.083912] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:23:15.098777] [DEBUG] [LOCAL ] EVT: Loaded 12781 existing records from primary storage. [2025-09-15T18:23:15.098933] [INFO ] [MAIN ] EVT: Loaded 12781 existing records. [2025-09-15T18:23:15.278384] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:23:15.278666] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-09-15T18:23:15.278716] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-09-15T18:23:15.279148] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-09-15T18:23:15.279195] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-09-15T18:23:15.628143] [INFO ] [REMOTE ] EVT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:23:15.657895] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-09-15T18:23:16.438625] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-15T18:23:16.438464] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T18:23:16.450836] [INFO ] [REMOTE ] EVN: Full fetch complete (11970 records). [2025-09-15T18:23:16.450952] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-09-15T18:23:16.451708] [FATAL] [VALIDATOR ] EVN: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:23:16.451783] [FATAL] [MAIN ] EVN: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:23:16.451820] [WARN ] [MAIN ] EVN: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:23:16.451865] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-09-15T18:23:16.451945] [DEBUG] [LOCAL ] EVN: No primary data file found to delete. [2025-09-15T18:23:16.451983] [INFO ] [LOCAL ] EVN: Starting deletion of derivative data. [2025-09-15T18:23:16.452339] [DEBUG] [LOCAL ] EVN: Deleted derivative data file. [2025-09-15T18:23:16.452421] [INFO ] [MAIN ] Update Progress: 788/2369 symbols completed. EVN took 20.0s. Estimated remaining: 2h 46m 58s. Rate: 9.5 symbols/min [2025-09-15T18:23:16.463197] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-09-15T18:23:16.625181] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:23:16.645951] [DEBUG] [LOCAL ] EVTC: Loaded 19605 existing records from primary storage. [2025-09-15T18:23:16.646097] [INFO ] [MAIN ] EVTC: Loaded 19605 existing records. [2025-09-15T18:23:16.820240] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:23:16.820525] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-09-15T18:23:16.820572] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-09-15T18:23:16.821137] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-09-15T18:23:16.821190] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-09-15T18:23:17.187289] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:23:17.257892] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-09-15T18:23:18.064438] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-09-15T18:23:18.067521] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-15T18:23:18.154709] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-15T18:23:18.857869] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-09-15T18:23:19.006279] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T18:23:19.657876] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-09-15T18:23:20.227991] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-15T18:23:20.457874] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-09-15T18:23:20.557825] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T18:23:21.257915] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-09-15T18:23:21.929546] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T18:23:21.935164] [INFO ] [REMOTE ] EVH: Full fetch complete (53729 records). [2025-09-15T18:23:21.935279] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-09-15T18:23:22.062944] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-09-15T18:23:22.314225] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-09-15T18:23:22.314348] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-09-15T18:23:22.315145] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-09-15T18:23:22.315192] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-09-15T18:23:22.316292] [DEBUG] [LOCAL ] EVH: Trimmed 53729 records to 36311 (keeping 150 days of data) [2025-09-15T18:23:22.523941] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-15T18:23:22.561069] [DEBUG] [LOCAL ] EVH: Primary data saved (36311 records). [2025-09-15T18:23:22.561229] [INFO ] [MAIN ] EVH: Full history saved. [2025-09-15T18:23:22.561324] [INFO ] [MAIN ] Update Progress: 789/2369 symbols completed. EVH took 27.5s. Estimated remaining: 2h 46m 51s. Rate: 9.5 symbols/min [2025-09-15T18:23:22.731346] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:23:22.759210] [DEBUG] [LOCAL ] EVTL: Loaded 29725 existing records from primary storage. [2025-09-15T18:23:22.759359] [INFO ] [MAIN ] EVTL: Loaded 29725 existing records. [2025-09-15T18:23:22.861326] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-09-15T18:23:22.944875] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:23:22.945149] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-09-15T18:23:22.945202] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-09-15T18:23:22.945872] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-09-15T18:23:22.945927] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-09-15T18:23:23.307593] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:23:23.339773] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T18:23:23.657869] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-09-15T18:23:23.957174] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-15T18:23:24.457916] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-09-15T18:23:24.698608] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-15T18:23:25.257898] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-09-15T18:23:25.720366] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-15T18:23:26.057907] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-09-15T18:23:26.857909] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-09-15T18:23:26.973778] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-15T18:23:27.657951] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-09-15T18:23:28.099788] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-15T18:23:28.327141] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-15T18:23:28.457847] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-09-15T18:23:28.556474] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (3.30 seconds). [2025-09-15T18:23:29.257881] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-09-15T18:23:29.786188] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-15T18:23:30.057874] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-09-15T18:23:30.248806] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T18:23:30.845039] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-15T18:23:30.857830] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-09-15T18:23:31.657907] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-09-15T18:23:31.827147] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-15T18:23:31.830441] [INFO ] [REMOTE ] EVTC: Full fetch complete (28941 records). [2025-09-15T18:23:31.830539] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-09-15T18:23:32.201506] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-09-15T18:23:32.201592] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-09-15T18:23:32.202160] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-09-15T18:23:32.202205] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-09-15T18:23:32.202994] [DEBUG] [LOCAL ] EVTC: Trimmed 28941 records to 19286 (keeping 150 days of data) [2025-09-15T18:23:32.328076] [DEBUG] [LOCAL ] EVTC: Primary data saved (19286 records). [2025-09-15T18:23:32.328263] [INFO ] [MAIN ] EVTC: Full history saved. [2025-09-15T18:23:32.328361] [INFO ] [MAIN ] Update Progress: 790/2369 symbols completed. EVTC took 15.9s. Estimated remaining: 2h 46m 52s. Rate: 9.5 symbols/min [2025-09-15T18:23:32.472149] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-09-15T18:23:32.503731] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:23:32.522431] [DEBUG] [LOCAL ] EVTR: Loaded 17332 existing records from primary storage. [2025-09-15T18:23:32.522584] [INFO ] [MAIN ] EVTR: Loaded 17332 existing records. [2025-09-15T18:23:32.698454] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:23:32.698891] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-09-15T18:23:32.698956] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-09-15T18:23:32.699577] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-09-15T18:23:32.699746] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-09-15T18:23:32.828298] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-15T18:23:33.078098] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:23:33.181590] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-15T18:23:33.257913] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-09-15T18:23:34.057890] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-09-15T18:23:34.177427] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-15T18:23:34.857868] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-09-15T18:23:35.093707] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-15T18:23:35.657894] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-09-15T18:23:36.457896] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-09-15T18:23:36.754956] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-15T18:23:37.182676] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T18:23:37.257828] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-09-15T18:23:38.057936] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-09-15T18:23:38.139947] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T18:23:38.403390] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T18:23:38.405666] [INFO ] [REMOTE ] EVT: Full fetch complete (19247 records). [2025-09-15T18:23:38.405741] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-09-15T18:23:38.768583] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-09-15T18:23:38.768719] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-09-15T18:23:38.769201] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-09-15T18:23:38.769245] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-09-15T18:23:38.769842] [DEBUG] [LOCAL ] EVT: Trimmed 19247 records to 12619 (keeping 150 days of data) [2025-09-15T18:23:38.848441] [DEBUG] [LOCAL ] EVT: Primary data saved (12619 records). [2025-09-15T18:23:38.848579] [INFO ] [MAIN ] EVT: Full history saved. [2025-09-15T18:23:38.848687] [INFO ] [MAIN ] Update Progress: 791/2369 symbols completed. EVT took 23.9s. Estimated remaining: 2h 46m 46s. Rate: 9.5 symbols/min [2025-09-15T18:23:38.862919] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-09-15T18:23:39.023855] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:23:39.033626] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T18:23:39.037281] [INFO ] [REMOTE ] EVR: Full fetch complete (39177 records). [2025-09-15T18:23:39.037392] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-09-15T18:23:39.038077] [FATAL] [VALIDATOR ] EVR: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:23:39.038172] [FATAL] [MAIN ] EVR: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:23:39.038213] [WARN ] [MAIN ] EVR: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:23:39.038251] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-09-15T18:23:39.038312] [DEBUG] [LOCAL ] EVR: No primary data file found to delete. [2025-09-15T18:23:39.038351] [INFO ] [LOCAL ] EVR: Starting deletion of derivative data. [2025-09-15T18:23:39.038760] [DEBUG] [LOCAL ] EVR: Deleted derivative data file. [2025-09-15T18:23:39.038859] [INFO ] [MAIN ] Update Progress: 792/2369 symbols completed. EVR took 42.4s. Estimated remaining: 2h 46m 27s. Rate: 9.5 symbols/min [2025-09-15T18:23:39.221713] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:23:39.235566] [DEBUG] [LOCAL ] EW: Loaded 40167 existing records from primary storage. [2025-09-15T18:23:39.235774] [INFO ] [MAIN ] EW: Loaded 40167 existing records. [2025-09-15T18:23:39.446197] [DEBUG] [LOCAL ] EXG: Loaded 25562 existing records from primary storage. [2025-09-15T18:23:39.446383] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:23:39.446730] [INFO ] [MAIN ] EXG: Loaded 25562 existing records. [2025-09-15T18:23:39.529218] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-09-15T18:23:39.550760] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-09-15T18:23:39.604458] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-09-15T18:23:39.630742] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-09-15T18:23:39.630941] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:23:39.654220] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-09-15T18:23:39.667626] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-09-15T18:23:39.667575] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-09-15T18:23:39.682003] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-09-15T18:23:39.691952] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-09-15T18:23:40.438887] [INFO ] [REMOTE ] EXG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:23:40.471164] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-09-15T18:23:40.475583] [INFO ] [REMOTE ] EW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:23:40.497817] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T18:23:40.704093] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-15T18:23:41.257914] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-09-15T18:23:41.891983] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T18:23:42.057893] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-09-15T18:23:42.792043] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-15T18:23:42.857873] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-09-15T18:23:42.964432] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-15T18:23:43.582792] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-15T18:23:43.657961] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-09-15T18:23:44.457932] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-09-15T18:23:44.649769] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-15T18:23:45.257868] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-09-15T18:23:45.989719] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-15T18:23:46.057863] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-09-15T18:23:46.144676] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-15T18:23:46.857879] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-09-15T18:23:47.440141] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-15T18:23:47.622298] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-15T18:23:47.626252] [INFO ] [REMOTE ] EVTR: Full fetch complete (24374 records). [2025-09-15T18:23:47.626354] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-09-15T18:23:47.662983] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-09-15T18:23:48.005092] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-09-15T18:23:48.005193] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-09-15T18:23:48.005806] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-09-15T18:23:48.005859] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-09-15T18:23:48.006608] [DEBUG] [LOCAL ] EVTR: Trimmed 24374 records to 17176 (keeping 150 days of data) [2025-09-15T18:23:48.113815] [DEBUG] [LOCAL ] EVTR: Primary data saved (17176 records). [2025-09-15T18:23:48.113969] [INFO ] [MAIN ] EVTR: Full history saved. [2025-09-15T18:23:48.114056] [INFO ] [MAIN ] Update Progress: 793/2369 symbols completed. EVTR took 15.8s. Estimated remaining: 2h 46m 26s. Rate: 9.5 symbols/min [2025-09-15T18:23:48.291678] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:23:48.333504] [DEBUG] [LOCAL ] EXK: Loaded 39936 existing records from primary storage. [2025-09-15T18:23:48.333669] [INFO ] [MAIN ] EXK: Loaded 39936 existing records. [2025-09-15T18:23:48.463016] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-09-15T18:23:48.521047] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:23:48.521447] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-09-15T18:23:48.521519] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-09-15T18:23:48.522534] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-09-15T18:23:48.522594] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-09-15T18:23:48.884829] [INFO ] [REMOTE ] EXK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:23:49.257936] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-09-15T18:23:50.057941] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-09-15T18:23:50.696775] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (3.03 seconds). [2025-09-15T18:23:50.791422] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-15T18:23:50.857860] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-09-15T18:23:50.942959] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-15T18:23:51.657889] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-09-15T18:23:51.819670] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-15T18:23:51.898125] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-15T18:23:52.457899] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-09-15T18:23:52.978660] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T18:23:53.257940] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-09-15T18:23:53.398288] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T18:23:54.057878] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-09-15T18:23:54.857854] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-09-15T18:23:55.007273] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-15T18:23:55.008615] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T18:23:55.657866] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-09-15T18:23:56.110431] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-15T18:23:56.115400] [INFO ] [REMOTE ] EVTL: Full fetch complete (39251 records). [2025-09-15T18:23:56.115510] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-09-15T18:23:56.458135] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-09-15T18:23:56.489576] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-09-15T18:23:56.489685] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-09-15T18:23:56.490328] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-09-15T18:23:56.490373] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-09-15T18:23:56.491266] [DEBUG] [LOCAL ] EVTL: Trimmed 39251 records to 29727 (keeping 150 days of data) [2025-09-15T18:23:56.661493] [DEBUG] [LOCAL ] EVTL: Primary data saved (29727 records). [2025-09-15T18:23:56.661631] [INFO ] [MAIN ] EVTL: Full history saved. [2025-09-15T18:23:56.661733] [INFO ] [MAIN ] Update Progress: 794/2369 symbols completed. EVTL took 34.1s. Estimated remaining: 2h 46m 24s. Rate: 9.5 symbols/min [2025-09-15T18:23:56.833173] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:23:56.854328] [DEBUG] [LOCAL ] EXP: Loaded 22227 existing records from primary storage. [2025-09-15T18:23:56.854461] [INFO ] [MAIN ] EXP: Loaded 22227 existing records. [2025-09-15T18:23:57.037988] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:23:57.038233] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-09-15T18:23:57.038281] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-09-15T18:23:57.039005] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-09-15T18:23:57.039058] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-09-15T18:23:57.263093] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-09-15T18:23:57.407951] [INFO ] [REMOTE ] EXP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:23:57.442588] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-15T18:23:58.057902] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-09-15T18:23:58.173293] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-15T18:23:58.453575] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-15T18:23:58.457199] [INFO ] [REMOTE ] EXG: Full fetch complete (37750 records). [2025-09-15T18:23:58.457314] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-09-15T18:23:58.458027] [FATAL] [VALIDATOR ] EXG: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:23:58.458107] [FATAL] [MAIN ] EXG: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:23:58.458144] [WARN ] [MAIN ] EXG: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:23:58.458183] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-09-15T18:23:58.458241] [DEBUG] [LOCAL ] EXG: No primary data file found to delete. [2025-09-15T18:23:58.458286] [INFO ] [LOCAL ] EXG: Starting deletion of derivative data. [2025-09-15T18:23:58.458570] [DEBUG] [LOCAL ] EXG: Deleted derivative data file. [2025-09-15T18:23:58.458679] [INFO ] [MAIN ] Update Progress: 795/2369 symbols completed. EXG took 19.4s. Estimated remaining: 2h 46m 9s. Rate: 9.5 symbols/min [2025-09-15T18:23:58.625098] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:23:58.664479] [DEBUG] [LOCAL ] EXPD: Loaded 36005 existing records from primary storage. [2025-09-15T18:23:58.664614] [INFO ] [MAIN ] EXPD: Loaded 36005 existing records. [2025-09-15T18:23:58.842694] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:23:58.842973] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-09-15T18:23:58.843032] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-09-15T18:23:58.843757] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-09-15T18:23:58.843806] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-09-15T18:23:58.864500] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-09-15T18:23:59.199454] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:23:59.374878] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T18:23:59.657877] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-09-15T18:24:00.414195] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T18:24:00.457858] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-09-15T18:24:01.037551] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T18:24:01.257920] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-09-15T18:24:01.841440] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T18:24:02.057874] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-09-15T18:24:02.790369] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-15T18:24:02.857863] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-09-15T18:24:03.657902] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-09-15T18:24:03.714229] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-15T18:24:04.375390] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-15T18:24:04.457826] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-09-15T18:24:04.803324] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-15T18:24:05.257872] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-09-15T18:24:05.774676] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T18:24:06.057870] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-09-15T18:24:06.857913] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-09-15T18:24:07.053195] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-15T18:24:07.288538] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-15T18:24:07.657917] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-09-15T18:24:08.169439] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-15T18:24:08.175415] [INFO ] [REMOTE ] EW: Full fetch complete (58059 records). [2025-09-15T18:24:08.175525] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-09-15T18:24:08.462974] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-09-15T18:24:08.584177] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-09-15T18:24:08.584303] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-09-15T18:24:08.585119] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-09-15T18:24:08.585166] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-09-15T18:24:08.586446] [DEBUG] [LOCAL ] EW: Trimmed 58059 records to 39389 (keeping 150 days of data) [2025-09-15T18:24:08.831953] [DEBUG] [LOCAL ] EW: Primary data saved (39389 records). [2025-09-15T18:24:08.832108] [INFO ] [MAIN ] EW: Full history saved. [2025-09-15T18:24:08.834229] [INFO ] [MAIN ] Update Progress: 796/2369 symbols completed. EW took 30.0s. Estimated remaining: 2h 46m 11s. Rate: 9.5 symbols/min [2025-09-15T18:24:09.016254] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:24:09.034087] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T18:24:09.080766] [DEBUG] [LOCAL ] EXR: Loaded 34050 existing records from primary storage. [2025-09-15T18:24:09.080987] [INFO ] [MAIN ] EXR: Loaded 34050 existing records. [2025-09-15T18:24:09.255770] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:24:09.256075] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-09-15T18:24:09.256146] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-09-15T18:24:09.257083] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-09-15T18:24:09.257148] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-09-15T18:24:09.268188] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-09-15T18:24:09.606923] [INFO ] [REMOTE ] EXR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:24:10.057868] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-09-15T18:24:10.161296] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-15T18:24:10.857924] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-09-15T18:24:10.915094] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T18:24:11.049494] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-15T18:24:11.657863] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-09-15T18:24:12.206500] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T18:24:12.457952] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-09-15T18:24:12.923412] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-15T18:24:13.257887] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-09-15T18:24:13.902065] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-15T18:24:14.057921] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-09-15T18:24:14.857935] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-09-15T18:24:15.221932] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-15T18:24:15.227552] [INFO ] [REMOTE ] EXK: Full fetch complete (57213 records). [2025-09-15T18:24:15.227692] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-09-15T18:24:15.228418] [FATAL] [VALIDATOR ] EXK: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:24:15.228496] [FATAL] [MAIN ] EXK: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:24:15.228532] [WARN ] [MAIN ] EXK: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:24:15.228571] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-09-15T18:24:15.228631] [DEBUG] [LOCAL ] EXK: No primary data file found to delete. [2025-09-15T18:24:15.228687] [INFO ] [LOCAL ] EXK: Starting deletion of derivative data. [2025-09-15T18:24:15.228967] [DEBUG] [LOCAL ] EXK: Deleted derivative data file. [2025-09-15T18:24:15.229560] [INFO ] [MAIN ] Update Progress: 797/2369 symbols completed. EXK took 27.1s. Estimated remaining: 2h 46m 4s. Rate: 9.5 symbols/min [2025-09-15T18:24:15.559119] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T18:24:15.657908] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-09-15T18:24:16.317436] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T18:24:16.457860] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-09-15T18:24:17.265612] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-09-15T18:24:17.284009] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T18:24:18.057886] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-09-15T18:24:18.357038] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-15T18:24:18.427765] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-15T18:24:18.857921] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-09-15T18:24:19.475064] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-15T18:24:19.647353] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-15T18:24:19.650847] [INFO ] [REMOTE ] EXP: Full fetch complete (32890 records). [2025-09-15T18:24:19.650936] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-09-15T18:24:19.663103] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-09-15T18:24:20.036060] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-09-15T18:24:20.036161] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-09-15T18:24:20.036827] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-09-15T18:24:20.036920] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-09-15T18:24:20.037865] [DEBUG] [LOCAL ] EXP: Trimmed 32890 records to 21794 (keeping 150 days of data) [2025-09-15T18:24:20.172778] [DEBUG] [LOCAL ] EXP: Primary data saved (21794 records). [2025-09-15T18:24:20.172915] [INFO ] [MAIN ] EXP: Full history saved. [2025-09-15T18:24:20.173000] [INFO ] [MAIN ] Update Progress: 798/2369 symbols completed. EXP took 23.5s. Estimated remaining: 2h 45m 55s. Rate: 9.5 symbols/min [2025-09-15T18:24:20.457895] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-09-15T18:24:21.279031] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-15T18:24:21.292893] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-09-15T18:24:21.711845] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-15T18:24:22.057875] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-09-15T18:24:22.767707] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T18:24:22.857822] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-09-15T18:24:23.160231] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T18:24:23.657933] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-09-15T18:24:24.431674] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T18:24:24.457863] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-09-15T18:24:25.068488] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T18:24:25.073795] [INFO ] [REMOTE ] EXR: Full fetch complete (49507 records). [2025-09-15T18:24:25.073895] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-09-15T18:24:25.447362] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-09-15T18:24:25.447445] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-09-15T18:24:25.448209] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-09-15T18:24:25.448256] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-09-15T18:24:25.449358] [DEBUG] [LOCAL ] EXR: Trimmed 49507 records to 33469 (keeping 150 days of data) [2025-09-15T18:24:25.676329] [DEBUG] [LOCAL ] EXR: Primary data saved (33469 records). [2025-09-15T18:24:25.676501] [INFO ] [MAIN ] EXR: Full history saved. [2025-09-15T18:24:25.676604] [INFO ] [MAIN ] Update Progress: 799/2369 symbols completed. EXR took 16.8s. Estimated remaining: 2h 45m 47s. Rate: 9.5 symbols/min [2025-09-15T18:24:25.937943] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-15T18:24:25.950492] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-09-15T18:24:27.493279] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-15T18:24:27.498828] [INFO ] [REMOTE ] EXPD: Full fetch complete (52526 records). [2025-09-15T18:24:27.498988] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-09-15T18:24:27.895297] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-09-15T18:24:27.895377] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-09-15T18:24:27.896113] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-09-15T18:24:27.896159] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-09-15T18:24:27.897320] [DEBUG] [LOCAL ] EXPD: Trimmed 52526 records to 35289 (keeping 150 days of data) [2025-09-15T18:24:28.142867] [DEBUG] [LOCAL ] EXPD: Primary data saved (35289 records). [2025-09-15T18:24:28.143036] [INFO ] [MAIN ] EXPD: Full history saved. [2025-09-15T18:24:28.143929] [INFO ] [MAIN ] Update Progress: 800/2369 symbols completed. EXPD took 29.7s. Estimated remaining: 2h 45m 33s. Rate: 9.5 symbols/min [2025-09-15T18:24:28.764209] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:24:28.786165] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:24:28.820518] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:24:28.844364] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:24:28.896284] [DEBUG] [LOCAL ] FBK: Loaded 19646 existing records from primary storage. [2025-09-15T18:24:28.896437] [INFO ] [MAIN ] FBK: Loaded 19646 existing records. [2025-09-15T18:24:29.031251] [DEBUG] [LOCAL ] FAF: Loaded 31749 existing records from primary storage. [2025-09-15T18:24:29.037128] [DEBUG] [LOCAL ] FBIN: Loaded 38076 existing records from primary storage. [2025-09-15T18:24:29.049586] [DEBUG] [LOCAL ] F: Loaded 40560 existing records from primary storage. [2025-09-15T18:24:29.049844] [INFO ] [MAIN ] FAF: Loaded 31749 existing records. [2025-09-15T18:24:29.049773] [INFO ] [MAIN ] F: Loaded 40560 existing records. [2025-09-15T18:24:29.071397] [INFO ] [MAIN ] FBIN: Loaded 38076 existing records. [2025-09-15T18:24:29.268053] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:24:29.393433] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-09-15T18:24:29.425841] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-09-15T18:24:29.472634] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-09-15T18:24:29.537255] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-09-15T18:24:29.691454] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:24:29.695033] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:24:29.719813] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-09-15T18:24:29.770333] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-09-15T18:24:29.808345] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-09-15T18:24:29.853376] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:24:29.830964] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-09-15T18:24:29.853701] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-09-15T18:24:29.864508] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-09-15T18:24:29.864429] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-09-15T18:24:29.911561] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-09-15T18:24:29.929759] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-09-15T18:24:29.929892] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-09-15T18:24:29.911625] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-09-15T18:24:30.019505] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-09-15T18:24:30.691698] [INFO ] [REMOTE ] FBK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:24:30.730428] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-09-15T18:24:31.068251] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:24:31.123518] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-09-15T18:24:31.127943] [INFO ] [REMOTE ] F: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:24:31.177406] [INFO ] [REMOTE ] FAF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:24:31.177995] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-09-15T18:24:31.177681] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-09-15T18:24:31.522235] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-15T18:24:31.525629] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-09-15T18:24:32.192573] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-15T18:24:32.199472] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-09-15T18:24:32.465934] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-15T18:24:32.470155] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-09-15T18:24:32.782828] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-15T18:24:32.792674] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-09-15T18:24:33.188998] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-15T18:24:33.197681] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-09-15T18:24:33.295929] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-15T18:24:33.305792] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-09-15T18:24:33.689002] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-15T18:24:34.057926] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-09-15T18:24:34.459367] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-15T18:24:34.545595] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T18:24:34.857871] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-09-15T18:24:35.113619] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-15T18:24:35.208548] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-15T18:24:35.657877] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-09-15T18:24:36.336389] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T18:24:36.457983] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-09-15T18:24:37.257892] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-09-15T18:24:37.853374] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-15T18:24:38.057851] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-09-15T18:24:38.212728] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-09-15T18:24:38.470938] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-15T18:24:38.857887] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-09-15T18:24:39.122322] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-15T18:24:39.657881] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-09-15T18:24:40.086203] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T18:24:40.457876] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-09-15T18:24:40.958008] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-15T18:24:41.257922] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-09-15T18:24:42.057882] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-09-15T18:24:42.450395] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-15T18:24:42.580264] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-15T18:24:42.857883] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-09-15T18:24:43.444880] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-15T18:24:43.631620] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-15T18:24:43.657839] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-09-15T18:24:44.457915] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-09-15T18:24:45.026878] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-15T18:24:45.257917] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-09-15T18:24:45.766674] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-15T18:24:46.057907] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-09-15T18:24:46.574549] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T18:24:46.579344] [INFO ] [REMOTE ] FAF: Full fetch complete (45163 records). [2025-09-15T18:24:46.579438] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-09-15T18:24:46.865286] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-09-15T18:24:46.956348] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-09-15T18:24:46.956444] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-09-15T18:24:46.957165] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-09-15T18:24:46.957233] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-09-15T18:24:46.958470] [DEBUG] [LOCAL ] FAF: Trimmed 45163 records to 31072 (keeping 150 days of data) [2025-09-15T18:24:47.156911] [DEBUG] [LOCAL ] FAF: Primary data saved (31072 records). [2025-09-15T18:24:47.157095] [INFO ] [MAIN ] FAF: Full history saved. [2025-09-15T18:24:47.157235] [INFO ] [MAIN ] Update Progress: 801/2369 symbols completed. FAF took 19.0s. Estimated remaining: 2h 45m 52s. Rate: 9.5 symbols/min [2025-09-15T18:24:47.335535] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:24:47.352884] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T18:24:47.360482] [INFO ] [REMOTE ] FBIN: Full fetch complete (54900 records). [2025-09-15T18:24:47.360613] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-09-15T18:24:47.554210] [DEBUG] [LOCAL ] FBP: Loaded 34097 existing records from primary storage. [2025-09-15T18:24:47.601417] [INFO ] [MAIN ] FBP: Loaded 34097 existing records. [2025-09-15T18:24:47.662946] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-09-15T18:24:47.946560] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:24:47.946755] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-09-15T18:24:47.946980] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-09-15T18:24:47.947943] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-09-15T18:24:47.948350] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-09-15T18:24:47.948255] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-09-15T18:24:47.948499] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-09-15T18:24:47.956336] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-09-15T18:24:47.967301] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-09-15T18:24:47.990039] [DEBUG] [LOCAL ] FBIN: Trimmed 54900 records to 37347 (keeping 150 days of data) [2025-09-15T18:24:47.980254] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-15T18:24:48.454765] [INFO ] [REMOTE ] FBP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:24:48.460917] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-09-15T18:24:48.580663] [DEBUG] [LOCAL ] FBIN: Primary data saved (37347 records). [2025-09-15T18:24:48.580811] [INFO ] [MAIN ] FBIN: Full history saved. [2025-09-15T18:24:48.580933] [INFO ] [MAIN ] Update Progress: 802/2369 symbols completed. FBIN took 20.4s. Estimated remaining: 2h 45m 36s. Rate: 9.5 symbols/min [2025-09-15T18:24:48.747633] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:24:48.774369] [DEBUG] [LOCAL ] FBRT: Loaded 25573 existing records from primary storage. [2025-09-15T18:24:48.774517] [INFO ] [MAIN ] FBRT: Loaded 25573 existing records. [2025-09-15T18:24:48.951314] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:24:48.951605] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-09-15T18:24:48.951673] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-09-15T18:24:48.952280] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-09-15T18:24:48.952332] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-09-15T18:24:49.263309] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-09-15T18:24:49.354150] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:24:49.592161] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-15T18:24:49.594804] [INFO ] [REMOTE ] FBK: Full fetch complete (26240 records). [2025-09-15T18:24:49.594896] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-09-15T18:24:49.595460] [FATAL] [VALIDATOR ] FBK: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:24:49.595550] [FATAL] [MAIN ] FBK: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:24:49.595613] [WARN ] [MAIN ] FBK: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:24:49.595702] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-09-15T18:24:49.595767] [DEBUG] [LOCAL ] FBK: No primary data file found to delete. [2025-09-15T18:24:49.595803] [INFO ] [LOCAL ] FBK: Starting deletion of derivative data. [2025-09-15T18:24:49.596038] [DEBUG] [LOCAL ] FBK: Deleted derivative data file. [2025-09-15T18:24:49.596138] [INFO ] [MAIN ] Update Progress: 803/2369 symbols completed. FBK took 21.5s. Estimated remaining: 2h 45m 19s. Rate: 9.5 symbols/min [2025-09-15T18:24:49.769318] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:24:49.788022] [DEBUG] [LOCAL ] FC: Loaded 10642 existing records from primary storage. [2025-09-15T18:24:49.788171] [INFO ] [MAIN ] FC: Loaded 10642 existing records. [2025-09-15T18:24:49.962533] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:24:49.962858] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-09-15T18:24:49.962918] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-09-15T18:24:49.963269] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-09-15T18:24:49.963313] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-09-15T18:24:50.062957] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-09-15T18:24:50.330766] [INFO ] [REMOTE ] FC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:24:50.426309] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.76 seconds). [2025-09-15T18:24:50.496062] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-15T18:24:50.857878] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-09-15T18:24:51.657833] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-09-15T18:24:51.815230] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-15T18:24:52.118723] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-15T18:24:52.457881] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-09-15T18:24:53.257909] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-09-15T18:24:53.677816] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T18:24:54.057910] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-09-15T18:24:54.134461] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-15T18:24:54.675467] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-15T18:24:54.857887] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-09-15T18:24:55.030004] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-15T18:24:55.657952] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-09-15T18:24:56.457837] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-09-15T18:24:56.505216] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-15T18:24:56.911614] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-15T18:24:57.257945] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-09-15T18:24:57.424898] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-15T18:24:58.057887] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-09-15T18:24:58.713303] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-15T18:24:58.857904] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-09-15T18:24:59.341591] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-15T18:24:59.569719] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-15T18:24:59.577696] [INFO ] [REMOTE ] F: Full fetch complete (58500 records). [2025-09-15T18:24:59.577870] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-09-15T18:24:59.662954] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-09-15T18:24:59.966202] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-09-15T18:24:59.966294] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-09-15T18:24:59.967121] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-09-15T18:24:59.967201] [DEBUG] [LOCAL ] F: Saving primary data. [2025-09-15T18:24:59.968514] [DEBUG] [LOCAL ] F: Trimmed 58500 records to 39780 (keeping 150 days of data) [2025-09-15T18:25:00.235340] [DEBUG] [LOCAL ] F: Primary data saved (39780 records). [2025-09-15T18:25:00.235502] [INFO ] [MAIN ] F: Full history saved. [2025-09-15T18:25:00.237421] [INFO ] [MAIN ] Update Progress: 804/2369 symbols completed. F took 32.1s. Estimated remaining: 2h 45m 21s. Rate: 9.5 symbols/min [2025-09-15T18:25:00.406148] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:25:00.446922] [DEBUG] [LOCAL ] FCF: Loaded 28808 existing records from primary storage. [2025-09-15T18:25:00.447069] [INFO ] [MAIN ] FCF: Loaded 28808 existing records. [2025-09-15T18:25:00.467626] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-09-15T18:25:00.626349] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:25:00.626572] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-09-15T18:25:00.626617] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-09-15T18:25:00.627271] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-09-15T18:25:00.627320] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-09-15T18:25:00.983445] [INFO ] [REMOTE ] FCF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:25:01.077206] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T18:25:01.257946] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-09-15T18:25:02.042535] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-15T18:25:02.062955] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-09-15T18:25:02.090478] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-15T18:25:02.857883] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-09-15T18:25:03.169852] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-15T18:25:03.657895] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-09-15T18:25:04.360464] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T18:25:04.457869] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-09-15T18:25:04.895176] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T18:25:05.257884] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-09-15T18:25:05.340481] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-15T18:25:06.057903] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-09-15T18:25:06.602350] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T18:25:06.857917] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-09-15T18:25:07.371948] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-15T18:25:07.377406] [INFO ] [REMOTE ] FBRT: Full fetch complete (37183 records). [2025-09-15T18:25:07.377571] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-09-15T18:25:07.667699] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-09-15T18:25:07.763903] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-09-15T18:25:07.763985] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-09-15T18:25:07.764637] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-09-15T18:25:07.764699] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-09-15T18:25:07.765552] [DEBUG] [LOCAL ] FBRT: Trimmed 37183 records to 24991 (keeping 150 days of data) [2025-09-15T18:25:07.841025] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-15T18:25:07.935317] [DEBUG] [LOCAL ] FBRT: Primary data saved (24991 records). [2025-09-15T18:25:07.935464] [INFO ] [MAIN ] FBRT: Full history saved. [2025-09-15T18:25:07.935547] [INFO ] [MAIN ] Update Progress: 805/2369 symbols completed. FBRT took 19.4s. Estimated remaining: 2h 45m 18s. Rate: 9.5 symbols/min [2025-09-15T18:25:08.107598] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:25:08.130832] [DEBUG] [LOCAL ] FCN: Loaded 19410 existing records from primary storage. [2025-09-15T18:25:08.131039] [INFO ] [MAIN ] FCN: Loaded 19410 existing records. [2025-09-15T18:25:08.324420] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:25:08.324803] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-09-15T18:25:08.324853] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-09-15T18:25:08.325719] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-09-15T18:25:08.325974] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-09-15T18:25:08.462968] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-09-15T18:25:08.694318] [INFO ] [REMOTE ] FCN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:25:09.221561] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T18:25:09.257812] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-09-15T18:25:09.555104] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-15T18:25:09.557204] [INFO ] [REMOTE ] FC: Full fetch complete (16767 records). [2025-09-15T18:25:09.557274] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-09-15T18:25:09.924435] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-09-15T18:25:09.924588] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-09-15T18:25:09.925081] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-09-15T18:25:09.925131] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-09-15T18:25:09.925980] [DEBUG] [LOCAL ] FC: Trimmed 16767 records to 10433 (keeping 150 days of data) [2025-09-15T18:25:09.991220] [DEBUG] [LOCAL ] FC: Primary data saved (10433 records). [2025-09-15T18:25:09.991380] [INFO ] [MAIN ] FC: Full history saved. [2025-09-15T18:25:09.991487] [INFO ] [MAIN ] Update Progress: 806/2369 symbols completed. FC took 20.4s. Estimated remaining: 2h 45m 3s. Rate: 9.5 symbols/min [2025-09-15T18:25:10.065044] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-09-15T18:25:10.204818] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:25:10.231796] [DEBUG] [LOCAL ] FCPT: Loaded 27113 existing records from primary storage. [2025-09-15T18:25:10.231975] [INFO ] [MAIN ] FCPT: Loaded 27113 existing records. [2025-09-15T18:25:10.412581] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:25:10.412853] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-09-15T18:25:10.412903] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-09-15T18:25:10.413576] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-09-15T18:25:10.413630] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-09-15T18:25:10.773023] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:25:10.796603] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-15T18:25:10.857821] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-09-15T18:25:11.657936] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-09-15T18:25:11.801514] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-15T18:25:11.867186] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-15T18:25:12.457870] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-09-15T18:25:13.099416] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T18:25:13.257890] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-09-15T18:25:13.757958] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-15T18:25:14.057863] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-09-15T18:25:14.390125] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-15T18:25:14.857881] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-09-15T18:25:15.557667] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-15T18:25:15.657861] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-09-15T18:25:15.960061] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-15T18:25:16.457876] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-09-15T18:25:17.060733] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T18:25:17.257884] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-09-15T18:25:17.355845] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T18:25:18.057867] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-09-15T18:25:18.713199] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T18:25:18.857847] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-09-15T18:25:19.338855] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-15T18:25:19.657890] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-09-15T18:25:20.390284] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T18:25:20.395159] [INFO ] [REMOTE ] FBP: Full fetch complete (50226 records). [2025-09-15T18:25:20.395304] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-09-15T18:25:20.463122] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-09-15T18:25:20.779779] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-09-15T18:25:20.779861] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-09-15T18:25:20.780539] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-09-15T18:25:20.780579] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-09-15T18:25:20.781591] [DEBUG] [LOCAL ] FBP: Trimmed 50226 records to 33317 (keeping 150 days of data) [2025-09-15T18:25:21.009666] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-15T18:25:21.026290] [DEBUG] [LOCAL ] FBP: Primary data saved (33317 records). [2025-09-15T18:25:21.035838] [INFO ] [MAIN ] FBP: Full history saved. [2025-09-15T18:25:21.035988] [INFO ] [MAIN ] Update Progress: 807/2369 symbols completed. FBP took 33.9s. Estimated remaining: 2h 45m 6s. Rate: 9.5 symbols/min [2025-09-15T18:25:21.218180] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:25:21.218429] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-09-15T18:25:21.218471] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-09-15T18:25:21.218609] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-09-15T18:25:21.218677] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-15T18:25:21.218725] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-15T18:25:21.218760] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-09-15T18:25:21.263153] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-09-15T18:25:21.605479] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:25:21.627285] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-15T18:25:22.057880] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-09-15T18:25:22.403049] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-15T18:25:22.857867] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-09-15T18:25:23.204745] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-15T18:25:23.657881] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-09-15T18:25:24.188587] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-15T18:25:24.457889] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-09-15T18:25:24.817896] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-15T18:25:24.934297] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T18:25:25.257873] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-09-15T18:25:25.502548] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-09-15T18:25:26.057885] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-09-15T18:25:26.857879] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-09-15T18:25:27.271173] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T18:25:27.657912] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-09-15T18:25:28.379402] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-15T18:25:28.383776] [INFO ] [REMOTE ] FCF: Full fetch complete (43295 records). [2025-09-15T18:25:28.383862] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-09-15T18:25:28.462975] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-09-15T18:25:28.793770] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-09-15T18:25:28.794167] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-09-15T18:25:28.795285] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-09-15T18:25:28.795394] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-09-15T18:25:28.830209] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-15T18:25:28.834819] [DEBUG] [LOCAL ] FCF: Trimmed 43295 records to 28033 (keeping 150 days of data) [2025-09-15T18:25:29.047456] [DEBUG] [LOCAL ] FCF: Primary data saved (28033 records). [2025-09-15T18:25:29.047628] [INFO ] [MAIN ] FCF: Full history saved. [2025-09-15T18:25:29.047746] [INFO ] [MAIN ] Update Progress: 808/2369 symbols completed. FCF took 28.8s. Estimated remaining: 2h 45m 3s. Rate: 9.5 symbols/min [2025-09-15T18:25:29.256671] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:25:29.257846] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-09-15T18:25:29.271280] [DEBUG] [LOCAL ] FCT: Loaded 10451 existing records from primary storage. [2025-09-15T18:25:29.271448] [INFO ] [MAIN ] FCT: Loaded 10451 existing records. [2025-09-15T18:25:29.526554] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:25:29.527459] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-09-15T18:25:29.527570] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-09-15T18:25:29.528130] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-09-15T18:25:29.528273] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-09-15T18:25:29.630752] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-15T18:25:29.741824] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-15T18:25:30.052891] [INFO ] [REMOTE ] FCT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:25:30.057851] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-09-15T18:25:30.626151] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-15T18:25:30.857881] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-09-15T18:25:31.657879] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-09-15T18:25:31.877447] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-15T18:25:32.286363] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-15T18:25:32.457881] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-09-15T18:25:33.257874] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-09-15T18:25:33.434787] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T18:25:33.437347] [INFO ] [REMOTE ] FCN: Full fetch complete (28420 records). [2025-09-15T18:25:33.437421] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-09-15T18:25:33.437952] [FATAL] [VALIDATOR ] FCN: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:25:33.438029] [FATAL] [MAIN ] FCN: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:25:33.438065] [WARN ] [MAIN ] FCN: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:25:33.438102] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-09-15T18:25:33.438204] [DEBUG] [LOCAL ] FCN: No primary data file found to delete. [2025-09-15T18:25:33.438242] [INFO ] [LOCAL ] FCN: Starting deletion of derivative data. [2025-09-15T18:25:33.438589] [DEBUG] [LOCAL ] FCN: Deleted derivative data file. [2025-09-15T18:25:33.438685] [INFO ] [MAIN ] Update Progress: 809/2369 symbols completed. FCN took 25.5s. Estimated remaining: 2h 44m 52s. Rate: 9.5 symbols/min [2025-09-15T18:25:33.609100] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:25:33.648970] [DEBUG] [LOCAL ] FCX: Loaded 40442 existing records from primary storage. [2025-09-15T18:25:33.649149] [INFO ] [MAIN ] FCX: Loaded 40442 existing records. [2025-09-15T18:25:33.823752] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:25:33.823973] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-09-15T18:25:33.824018] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-09-15T18:25:33.824920] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-09-15T18:25:33.824971] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-09-15T18:25:33.991318] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-15T18:25:34.068232] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-09-15T18:25:34.202554] [INFO ] [REMOTE ] FCX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:25:34.457090] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-15T18:25:34.857871] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-09-15T18:25:35.657955] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-09-15T18:25:36.057607] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-15T18:25:36.062293] [INFO ] [REMOTE ] FCPT: Full fetch complete (40826 records). [2025-09-15T18:25:36.062459] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-09-15T18:25:36.439898] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-09-15T18:25:36.439979] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-09-15T18:25:36.440606] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-09-15T18:25:36.440671] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-09-15T18:25:36.441612] [DEBUG] [LOCAL ] FCPT: Trimmed 40826 records to 26579 (keeping 150 days of data) [2025-09-15T18:25:36.493352] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-09-15T18:25:36.603100] [DEBUG] [LOCAL ] FCPT: Primary data saved (26579 records). [2025-09-15T18:25:36.603235] [INFO ] [MAIN ] FCPT: Full history saved. [2025-09-15T18:25:36.603318] [INFO ] [MAIN ] Update Progress: 810/2369 symbols completed. FCPT took 26.6s. Estimated remaining: 2h 44m 40s. Rate: 9.5 symbols/min [2025-09-15T18:25:36.778841] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:25:36.801544] [DEBUG] [LOCAL ] FDP: Loaded 22780 existing records from primary storage. [2025-09-15T18:25:36.801716] [INFO ] [MAIN ] FDP: Loaded 22780 existing records. [2025-09-15T18:25:36.990755] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:25:36.991139] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-09-15T18:25:36.991197] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-09-15T18:25:36.992073] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-09-15T18:25:36.992128] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-09-15T18:25:37.149609] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T18:25:37.263945] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-09-15T18:25:37.364405] [INFO ] [REMOTE ] FDP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:25:37.430041] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-15T18:25:37.555989] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-15T18:25:38.057886] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-09-15T18:25:38.857899] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-09-15T18:25:39.318228] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-15T18:25:39.657905] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-09-15T18:25:39.685552] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-15T18:25:39.920531] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-09-15T18:25:40.457946] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-09-15T18:25:41.257954] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-09-15T18:25:41.617544] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-15T18:25:41.618382] [INFO ] [REMOTE ] FCRX: Full fetch complete (1254 records). [2025-09-15T18:25:41.618451] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-09-15T18:25:41.795828] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 140 unique days, need 150 days [2025-09-15T18:25:41.796021] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:25:41.796063] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:25:41.796122] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-15T18:25:41.796181] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-15T18:25:41.796217] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-09-15T18:25:41.796256] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-09-15T18:25:41.796327] [INFO ] [MAIN ] Update Progress: 811/2369 symbols completed. FCRX took 20.8s. Estimated remaining: 2h 44m 31s. Rate: 9.5 symbols/min [2025-09-15T18:25:41.977103] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:25:41.995046] [DEBUG] [LOCAL ] FDS: Loaded 18399 existing records from primary storage. [2025-09-15T18:25:41.995173] [INFO ] [MAIN ] FDS: Loaded 18399 existing records. [2025-09-15T18:25:42.063006] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-09-15T18:25:42.179996] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:25:42.180276] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-09-15T18:25:42.180327] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-09-15T18:25:42.180888] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-09-15T18:25:42.180941] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-09-15T18:25:42.544472] [INFO ] [REMOTE ] FDS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:25:42.581554] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-15T18:25:42.857879] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-09-15T18:25:43.085489] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T18:25:43.657920] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-09-15T18:25:44.457865] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-09-15T18:25:44.488433] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-15T18:25:44.536742] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-15T18:25:45.257883] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-09-15T18:25:45.405438] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T18:25:46.057872] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-09-15T18:25:46.081888] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-15T18:25:46.596886] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-15T18:25:46.857893] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-09-15T18:25:47.657919] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-09-15T18:25:47.806489] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-15T18:25:47.809455] [INFO ] [REMOTE ] FCT: Full fetch complete (15475 records). [2025-09-15T18:25:47.809545] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-09-15T18:25:48.192556] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-09-15T18:25:48.192659] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-09-15T18:25:48.193028] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-09-15T18:25:48.193071] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-09-15T18:25:48.193618] [DEBUG] [LOCAL ] FCT: Trimmed 15475 records to 10373 (keeping 150 days of data) [2025-09-15T18:25:48.256790] [DEBUG] [LOCAL ] FCT: Primary data saved (10373 records). [2025-09-15T18:25:48.256930] [INFO ] [MAIN ] FCT: Full history saved. [2025-09-15T18:25:48.257038] [INFO ] [MAIN ] Update Progress: 812/2369 symbols completed. FCT took 19.2s. Estimated remaining: 2h 44m 25s. Rate: 9.5 symbols/min [2025-09-15T18:25:48.426406] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:25:48.463441] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-09-15T18:25:48.466286] [DEBUG] [LOCAL ] FDX: Loaded 38650 existing records from primary storage. [2025-09-15T18:25:48.466486] [INFO ] [MAIN ] FDX: Loaded 38650 existing records. [2025-09-15T18:25:48.650443] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:25:48.650830] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-09-15T18:25:48.650987] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-09-15T18:25:48.652132] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-09-15T18:25:48.652190] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-09-15T18:25:48.816537] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-15T18:25:49.045273] [INFO ] [REMOTE ] FDX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:25:49.257928] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-09-15T18:25:50.057913] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-09-15T18:25:50.454801] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-15T18:25:50.857890] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-09-15T18:25:51.072492] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-15T18:25:51.386855] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-15T18:25:51.657904] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-09-15T18:25:52.401481] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-15T18:25:52.457884] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-09-15T18:25:52.967205] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-15T18:25:53.257877] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-09-15T18:25:54.057900] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-09-15T18:25:54.515085] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-15T18:25:54.545344] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-15T18:25:54.857887] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-09-15T18:25:55.310430] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-15T18:25:55.657874] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-09-15T18:25:56.457955] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-09-15T18:25:56.560892] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-15T18:25:56.583154] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-15T18:25:57.257892] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-09-15T18:25:57.696963] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-15T18:25:58.057890] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-09-15T18:25:58.144975] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-15T18:25:58.857839] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-09-15T18:25:59.326138] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-15T18:25:59.657890] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-09-15T18:26:00.457831] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-09-15T18:26:00.872718] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-15T18:26:00.933606] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T18:26:01.257919] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-09-15T18:26:02.057899] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-09-15T18:26:02.493757] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-15T18:26:02.681746] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-15T18:26:02.857868] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-09-15T18:26:03.171726] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-15T18:26:03.175264] [INFO ] [REMOTE ] FDS: Full fetch complete (27027 records). [2025-09-15T18:26:03.175340] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-09-15T18:26:03.582755] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-09-15T18:26:03.582872] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-09-15T18:26:03.583607] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-09-15T18:26:03.583681] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-09-15T18:26:03.584783] [DEBUG] [LOCAL ] FDS: Trimmed 27027 records to 18187 (keeping 150 days of data) [2025-09-15T18:26:03.671160] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-09-15T18:26:03.708008] [DEBUG] [LOCAL ] FDS: Primary data saved (18187 records). [2025-09-15T18:26:03.708227] [INFO ] [MAIN ] FDS: Full history saved. [2025-09-15T18:26:03.708353] [INFO ] [MAIN ] Update Progress: 813/2369 symbols completed. FDS took 21.9s. Estimated remaining: 2h 44m 36s. Rate: 9.5 symbols/min [2025-09-15T18:26:03.883047] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:26:03.920081] [DEBUG] [LOCAL ] FE: Loaded 40224 existing records from primary storage. [2025-09-15T18:26:03.920252] [INFO ] [MAIN ] FE: Loaded 40224 existing records. [2025-09-15T18:26:04.101629] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:26:04.102008] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-09-15T18:26:04.102073] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-09-15T18:26:04.108737] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-09-15T18:26:04.108957] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-09-15T18:26:04.145397] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T18:26:04.219599] [INFO ] [REMOTE ] FDP: Full fetch complete (32961 records). [2025-09-15T18:26:04.243707] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-09-15T18:26:04.257375] [FATAL] [VALIDATOR ] FDP: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:26:04.272780] [FATAL] [MAIN ] FDP: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:26:04.286990] [WARN ] [MAIN ] FDP: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:26:04.330393] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-09-15T18:26:04.400691] [DEBUG] [LOCAL ] FDP: No primary data file found to delete. [2025-09-15T18:26:04.427911] [INFO ] [LOCAL ] FDP: Starting deletion of derivative data. [2025-09-15T18:26:04.428319] [DEBUG] [LOCAL ] FDP: Deleted derivative data file. [2025-09-15T18:26:04.433757] [INFO ] [MAIN ] Update Progress: 814/2369 symbols completed. FDP took 27.8s. Estimated remaining: 2h 44m 19s. Rate: 9.5 symbols/min [2025-09-15T18:26:04.492887] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-09-15T18:26:04.540704] [INFO ] [REMOTE ] FE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:26:04.676164] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:26:04.676356] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-09-15T18:26:04.676393] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-09-15T18:26:04.676516] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-09-15T18:26:04.676554] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-15T18:26:04.676594] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-15T18:26:04.676626] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-09-15T18:26:05.032946] [INFO ] [REMOTE ] FENG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:26:05.257882] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-09-15T18:26:05.492285] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-15T18:26:05.497914] [INFO ] [REMOTE ] FCX: Full fetch complete (57989 records). [2025-09-15T18:26:05.498038] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-09-15T18:26:05.498883] [FATAL] [VALIDATOR ] FCX: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:26:05.498982] [FATAL] [MAIN ] FCX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:26:05.499020] [WARN ] [MAIN ] FCX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:26:05.499059] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-09-15T18:26:05.499117] [DEBUG] [LOCAL ] FCX: No primary data file found to delete. [2025-09-15T18:26:05.499152] [INFO ] [LOCAL ] FCX: Starting deletion of derivative data. [2025-09-15T18:26:05.499350] [DEBUG] [LOCAL ] FCX: Deleted derivative data file. [2025-09-15T18:26:05.500624] [INFO ] [MAIN ] Update Progress: 815/2369 symbols completed. FCX took 32.1s. Estimated remaining: 2h 44m 3s. Rate: 9.5 symbols/min [2025-09-15T18:26:05.679028] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:26:05.722845] [DEBUG] [LOCAL ] FERG: Loaded 36237 existing records from primary storage. [2025-09-15T18:26:05.722987] [INFO ] [MAIN ] FERG: Loaded 36237 existing records. [2025-09-15T18:26:05.829251] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-15T18:26:05.908381] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:26:05.908666] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-09-15T18:26:05.908716] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-09-15T18:26:05.909454] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-09-15T18:26:05.909502] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-09-15T18:26:06.062755] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-09-15T18:26:06.297060] [INFO ] [REMOTE ] FERG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:26:06.680373] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-15T18:26:06.857883] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-09-15T18:26:07.657875] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-09-15T18:26:07.773890] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-15T18:26:08.457881] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-09-15T18:26:08.731402] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-15T18:26:08.815522] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T18:26:08.869865] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-15T18:26:09.257894] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-09-15T18:26:10.057874] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-09-15T18:26:10.857876] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-09-15T18:26:11.071876] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-15T18:26:11.443453] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-15T18:26:11.657891] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-09-15T18:26:11.845146] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-15T18:26:11.972719] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-15T18:26:12.457912] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-09-15T18:26:13.257881] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-09-15T18:26:14.023145] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T18:26:14.057814] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-09-15T18:26:14.857903] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-09-15T18:26:15.142133] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-15T18:26:15.657871] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-09-15T18:26:16.007812] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-15T18:26:16.113529] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-15T18:26:16.457889] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-09-15T18:26:16.729591] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-15T18:26:17.257918] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-09-15T18:26:17.586010] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-15T18:26:18.057866] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-09-15T18:26:18.133813] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T18:26:18.343327] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-15T18:26:18.857944] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-09-15T18:26:19.300544] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-15T18:26:19.301419] [INFO ] [REMOTE ] FENG: Full fetch complete (1662 records). [2025-09-15T18:26:19.301486] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-09-15T18:26:19.301887] [FATAL] [VALIDATOR ] FENG: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:26:19.301978] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:26:19.302031] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:26:19.302075] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-15T18:26:19.302131] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-15T18:26:19.302166] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-09-15T18:26:19.302204] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-09-15T18:26:19.302256] [INFO ] [MAIN ] Update Progress: 816/2369 symbols completed. FENG took 14.9s. Estimated remaining: 2h 44m 11s. Rate: 9.5 symbols/min [2025-09-15T18:26:19.474788] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:26:19.484348] [DEBUG] [LOCAL ] FET: Loaded 9010 existing records from primary storage. [2025-09-15T18:26:19.484443] [INFO ] [MAIN ] FET: Loaded 9010 existing records. [2025-09-15T18:26:19.661898] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-09-15T18:26:19.687186] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:26:19.688199] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-09-15T18:26:19.688255] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-09-15T18:26:19.688594] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-09-15T18:26:19.688700] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-09-15T18:26:20.049000] [INFO ] [REMOTE ] FET: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:26:20.457881] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-09-15T18:26:20.949811] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-15T18:26:21.115323] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T18:26:21.257871] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-09-15T18:26:22.057883] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-09-15T18:26:22.674831] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T18:26:22.857886] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-09-15T18:26:22.963007] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-15T18:26:23.657910] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-09-15T18:26:24.395173] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-15T18:26:24.457905] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-09-15T18:26:25.257871] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-09-15T18:26:25.406241] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-15T18:26:25.425688] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-15T18:26:25.431415] [INFO ] [REMOTE ] FDX: Full fetch complete (55829 records). [2025-09-15T18:26:25.431520] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-09-15T18:26:25.806256] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-09-15T18:26:25.806352] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-09-15T18:26:25.807104] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-09-15T18:26:25.807150] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-09-15T18:26:25.808421] [DEBUG] [LOCAL ] FDX: Trimmed 55829 records to 37922 (keeping 150 days of data) [2025-09-15T18:26:26.059684] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-09-15T18:26:26.059586] [DEBUG] [LOCAL ] FDX: Primary data saved (37922 records). [2025-09-15T18:26:26.060623] [INFO ] [MAIN ] FDX: Full history saved. [2025-09-15T18:26:26.061771] [INFO ] [MAIN ] Update Progress: 817/2369 symbols completed. FDX took 37.8s. Estimated remaining: 2h 44m 5s. Rate: 9.5 symbols/min [2025-09-15T18:26:26.241624] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:26:26.263580] [DEBUG] [LOCAL ] FF: Loaded 18158 existing records from primary storage. [2025-09-15T18:26:26.263771] [INFO ] [MAIN ] FF: Loaded 18158 existing records. [2025-09-15T18:26:26.443850] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:26:26.444150] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-09-15T18:26:26.444208] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-09-15T18:26:26.444746] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-09-15T18:26:26.444806] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-09-15T18:26:26.817261] [INFO ] [REMOTE ] FF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:26:26.857815] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-09-15T18:26:26.865625] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-15T18:26:27.316234] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-15T18:26:27.657883] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-09-15T18:26:27.915697] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-15T18:26:28.457871] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-09-15T18:26:29.095956] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T18:26:29.247463] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-15T18:26:29.257813] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-09-15T18:26:29.824762] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-15T18:26:30.057869] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-09-15T18:26:30.857928] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-09-15T18:26:31.553070] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-15T18:26:31.657859] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-09-15T18:26:32.457847] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-09-15T18:26:32.569935] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-15T18:26:32.735929] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-15T18:26:33.210167] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-15T18:26:33.257869] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-09-15T18:26:34.057870] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-09-15T18:26:34.196707] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-15T18:26:34.857864] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-09-15T18:26:35.571740] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-15T18:26:35.657843] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-09-15T18:26:36.457886] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-09-15T18:26:36.516627] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-15T18:26:36.524435] [INFO ] [REMOTE ] FE: Full fetch complete (58099 records). [2025-09-15T18:26:36.524555] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-09-15T18:26:36.910896] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-09-15T18:26:36.910993] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-09-15T18:26:36.911764] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-09-15T18:26:36.911832] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-09-15T18:26:36.913135] [DEBUG] [LOCAL ] FE: Trimmed 58099 records to 39450 (keeping 150 days of data) [2025-09-15T18:26:37.185069] [DEBUG] [LOCAL ] FE: Primary data saved (39450 records). [2025-09-15T18:26:37.185261] [INFO ] [MAIN ] FE: Full history saved. [2025-09-15T18:26:37.185408] [INFO ] [MAIN ] Update Progress: 818/2369 symbols completed. FE took 33.5s. Estimated remaining: 2h 44m 8s. Rate: 9.4 symbols/min [2025-09-15T18:26:37.262931] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-09-15T18:26:37.365630] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:26:37.382796] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-15T18:26:37.390969] [DEBUG] [LOCAL ] FFA: Loaded 3498 existing records from primary storage. [2025-09-15T18:26:37.391110] [INFO ] [MAIN ] FFA: Loaded 3498 existing records. [2025-09-15T18:26:37.433559] [INFO ] [REMOTE ] FERG: Full fetch complete (52822 records). [2025-09-15T18:26:37.465364] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-09-15T18:26:37.494468] [FATAL] [VALIDATOR ] FERG: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:26:37.494639] [FATAL] [MAIN ] FERG: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:26:37.494961] [WARN ] [MAIN ] FERG: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:26:37.505480] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-09-15T18:26:37.515772] [DEBUG] [LOCAL ] FERG: No primary data file found to delete. [2025-09-15T18:26:37.520946] [INFO ] [LOCAL ] FERG: Starting deletion of derivative data. [2025-09-15T18:26:37.550411] [DEBUG] [LOCAL ] FERG: Deleted derivative data file. [2025-09-15T18:26:37.553625] [INFO ] [MAIN ] Update Progress: 819/2369 symbols completed. FERG took 32.1s. Estimated remaining: 2h 43m 50s. Rate: 9.5 symbols/min [2025-09-15T18:26:37.573793] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:26:37.630698] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-09-15T18:26:37.644826] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-09-15T18:26:37.686633] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T18:26:37.686383] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-09-15T18:26:37.697186] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-09-15T18:26:37.709680] [INFO ] [REMOTE ] FET: Full fetch complete (13581 records). [2025-09-15T18:26:37.797139] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:26:37.804047] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-09-15T18:26:38.007591] [DEBUG] [LOCAL ] FFC: Loaded 12077 existing records from primary storage. [2025-09-15T18:26:38.012921] [INFO ] [MAIN ] FFC: Loaded 12077 existing records. [2025-09-15T18:26:38.673830] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:26:38.724781] [INFO ] [REMOTE ] FFA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:26:38.728637] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-09-15T18:26:38.729191] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-09-15T18:26:38.729083] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-09-15T18:26:38.729614] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-09-15T18:26:38.729462] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-09-15T18:26:38.730067] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-09-15T18:26:38.731271] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-09-15T18:26:38.731351] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-09-15T18:26:38.742824] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-09-15T18:26:38.801879] [DEBUG] [LOCAL ] FET: Trimmed 13581 records to 8868 (keeping 150 days of data) [2025-09-15T18:26:38.919443] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-15T18:26:39.027140] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-09-15T18:26:39.179841] [INFO ] [REMOTE ] FFC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:26:39.184382] [DEBUG] [LOCAL ] FET: Primary data saved (8868 records). [2025-09-15T18:26:39.184877] [INFO ] [MAIN ] FET: Full history saved. [2025-09-15T18:26:39.185004] [INFO ] [MAIN ] Update Progress: 820/2369 symbols completed. FET took 19.9s. Estimated remaining: 2h 43m 35s. Rate: 9.5 symbols/min [2025-09-15T18:26:39.358296] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:26:39.384945] [DEBUG] [LOCAL ] FFWM: Loaded 26759 existing records from primary storage. [2025-09-15T18:26:39.385088] [INFO ] [MAIN ] FFWM: Loaded 26759 existing records. [2025-09-15T18:26:39.500034] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T18:26:39.565550] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:26:39.565831] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-09-15T18:26:39.565879] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-09-15T18:26:39.566502] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-09-15T18:26:39.566553] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-09-15T18:26:39.664955] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-09-15T18:26:39.927575] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:26:39.966577] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T18:26:40.409597] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-15T18:26:40.457892] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-09-15T18:26:41.257956] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-09-15T18:26:41.583129] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T18:26:41.942918] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-15T18:26:42.057906] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-09-15T18:26:42.857886] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-09-15T18:26:43.120090] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T18:26:43.123041] [INFO ] [REMOTE ] FF: Full fetch complete (28119 records). [2025-09-15T18:26:43.123122] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-09-15T18:26:43.493320] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-09-15T18:26:43.493401] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-09-15T18:26:43.493939] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-09-15T18:26:43.493983] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-09-15T18:26:43.494678] [DEBUG] [LOCAL ] FF: Trimmed 28119 records to 17610 (keeping 150 days of data) [2025-09-15T18:26:43.601246] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-15T18:26:43.620414] [DEBUG] [LOCAL ] FF: Primary data saved (17610 records). [2025-09-15T18:26:43.620547] [INFO ] [MAIN ] FF: Full history saved. [2025-09-15T18:26:43.620663] [INFO ] [MAIN ] Update Progress: 821/2369 symbols completed. FF took 17.6s. Estimated remaining: 2h 43m 25s. Rate: 9.5 symbols/min [2025-09-15T18:26:43.663041] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-09-15T18:26:43.791667] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:26:43.807949] [DEBUG] [LOCAL ] FG: Loaded 15506 existing records from primary storage. [2025-09-15T18:26:43.808073] [INFO ] [MAIN ] FG: Loaded 15506 existing records. [2025-09-15T18:26:43.988738] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:26:43.989110] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-09-15T18:26:43.989173] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-09-15T18:26:43.989667] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-09-15T18:26:43.989721] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-09-15T18:26:44.347458] [INFO ] [REMOTE ] FG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:26:44.457917] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-09-15T18:26:45.096312] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-15T18:26:45.257866] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-09-15T18:26:45.267868] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-15T18:26:46.057892] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-09-15T18:26:46.622081] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T18:26:46.635349] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-15T18:26:46.857927] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-09-15T18:26:47.657901] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-09-15T18:26:48.309969] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-15T18:26:48.430800] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T18:26:48.457911] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-09-15T18:26:49.257920] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-09-15T18:26:49.773509] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T18:26:50.057840] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-09-15T18:26:50.294565] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-15T18:26:50.857889] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-09-15T18:26:50.993885] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T18:26:51.657862] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-09-15T18:26:52.064950] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T18:26:52.340945] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-15T18:26:52.457874] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-09-15T18:26:53.257883] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-09-15T18:26:53.522206] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-15T18:26:53.800393] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-15T18:26:54.057886] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-09-15T18:26:54.857854] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-09-15T18:26:55.283406] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-15T18:26:55.449963] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-15T18:26:55.657925] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-09-15T18:26:56.457921] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-09-15T18:26:56.876952] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T18:26:57.257910] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-09-15T18:26:57.570048] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T18:26:58.057898] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-09-15T18:26:58.655417] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T18:26:58.802707] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-15T18:26:58.857818] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-09-15T18:26:59.657898] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-09-15T18:26:59.842445] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-15T18:27:00.457958] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-09-15T18:27:00.898444] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-15T18:27:00.902359] [INFO ] [REMOTE ] FFWM: Full fetch complete (39468 records). [2025-09-15T18:27:00.902470] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-09-15T18:27:00.998214] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-15T18:27:01.011347] [INFO ] [REMOTE ] FFA: Full fetch complete (5990 records). [2025-09-15T18:27:01.027829] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-09-15T18:27:01.264098] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-09-15T18:27:01.641045] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-09-15T18:27:01.652860] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-09-15T18:27:01.662018] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-09-15T18:27:01.664846] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-09-15T18:27:01.721760] [DEBUG] [LOCAL ] FFWM: Trimmed 39468 records to 26071 (keeping 150 days of data) [2025-09-15T18:27:01.748281] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-09-15T18:27:01.748382] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-09-15T18:27:01.748497] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-09-15T18:27:01.803582] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-09-15T18:27:01.837497] [DEBUG] [LOCAL ] FFA: Trimmed 5990 records to 3377 (keeping 150 days of data) [2025-09-15T18:27:01.877389] [DEBUG] [LOCAL ] FFA: Primary data saved (3377 records). [2025-09-15T18:27:01.883454] [INFO ] [MAIN ] FFA: Full history saved. [2025-09-15T18:27:01.885769] [INFO ] [MAIN ] Update Progress: 822/2369 symbols completed. FFA took 24.7s. Estimated remaining: 2h 43m 41s. Rate: 9.5 symbols/min [2025-09-15T18:27:02.062149] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-09-15T18:27:02.111790] [DEBUG] [LOCAL ] FFWM: Primary data saved (26071 records). [2025-09-15T18:27:02.113131] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:27:02.113337] [INFO ] [MAIN ] FFWM: Full history saved. [2025-09-15T18:27:02.113479] [INFO ] [MAIN ] Update Progress: 823/2369 symbols completed. FFWM took 22.9s. Estimated remaining: 2h 43m 23s. Rate: 9.5 symbols/min [2025-09-15T18:27:02.220342] [DEBUG] [LOCAL ] FGN: Loaded 2766 existing records from primary storage. [2025-09-15T18:27:02.220530] [INFO ] [MAIN ] FGN: Loaded 2766 existing records. [2025-09-15T18:27:02.415872] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:27:02.474599] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:27:02.475010] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-09-15T18:27:02.475096] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-09-15T18:27:02.477795] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-09-15T18:27:02.478001] [DEBUG] [LOCAL ] FGSN: Loaded 3585 existing records from primary storage. [2025-09-15T18:27:02.478068] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-09-15T18:27:02.478235] [INFO ] [MAIN ] FGSN: Loaded 3585 existing records. [2025-09-15T18:27:02.875301] [WARN ] [MAIN ] FGSN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:27:02.937111] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-09-15T18:27:02.947451] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-15T18:27:02.958537] [DEBUG] [LOCAL ] FGSN: Deleted primary data file. [2025-09-15T18:27:02.968914] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-09-15T18:27:03.070946] [INFO ] [REMOTE ] FGN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:27:03.081866] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-09-15T18:27:03.349273] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-15T18:27:03.431898] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:27:03.657871] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-09-15T18:27:04.182062] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-15T18:27:04.457879] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-09-15T18:27:04.790398] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-15T18:27:04.864539] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-15T18:27:05.257879] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-09-15T18:27:05.719979] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T18:27:05.722415] [INFO ] [REMOTE ] FG: Full fetch complete (23156 records). [2025-09-15T18:27:05.722491] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-09-15T18:27:05.852605] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-15T18:27:06.063036] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-09-15T18:27:06.111876] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-09-15T18:27:06.111974] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-09-15T18:27:06.112528] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-09-15T18:27:06.112574] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-09-15T18:27:06.114026] [DEBUG] [LOCAL ] FG: Trimmed 23156 records to 15163 (keeping 150 days of data) [2025-09-15T18:27:06.207362] [DEBUG] [LOCAL ] FG: Primary data saved (15163 records). [2025-09-15T18:27:06.207522] [INFO ] [MAIN ] FG: Full history saved. [2025-09-15T18:27:06.207615] [INFO ] [MAIN ] Update Progress: 824/2369 symbols completed. FG took 22.6s. Estimated remaining: 2h 43m 13s. Rate: 9.5 symbols/min [2025-09-15T18:27:06.381517] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:27:06.417024] [DEBUG] [LOCAL ] FHI: Loaded 30397 existing records from primary storage. [2025-09-15T18:27:06.417202] [INFO ] [MAIN ] FHI: Loaded 30397 existing records. [2025-09-15T18:27:06.595450] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:27:06.595710] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-09-15T18:27:06.595779] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-09-15T18:27:06.596437] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-09-15T18:27:06.596485] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-09-15T18:27:06.863124] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-09-15T18:27:06.971624] [INFO ] [REMOTE ] FHI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:27:07.136496] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-15T18:27:07.464057] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-15T18:27:07.657885] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-09-15T18:27:08.457885] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-09-15T18:27:08.609635] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T18:27:08.972351] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-15T18:27:09.257877] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-09-15T18:27:09.792274] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-15T18:27:10.057871] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-09-15T18:27:10.431235] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-15T18:27:10.857905] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-09-15T18:27:11.657908] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-09-15T18:27:11.771822] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-15T18:27:11.773872] [INFO ] [REMOTE ] FFC: Full fetch complete (18073 records). [2025-09-15T18:27:11.773947] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-09-15T18:27:12.152483] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-09-15T18:27:12.152592] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-09-15T18:27:12.153227] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-09-15T18:27:12.153275] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-09-15T18:27:12.154045] [DEBUG] [LOCAL ] FFC: Trimmed 18073 records to 11958 (keeping 150 days of data) [2025-09-15T18:27:12.228803] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-15T18:27:12.251581] [DEBUG] [LOCAL ] FFC: Primary data saved (11958 records). [2025-09-15T18:27:12.251842] [INFO ] [MAIN ] FFC: Full history saved. [2025-09-15T18:27:12.251976] [INFO ] [MAIN ] Update Progress: 825/2369 symbols completed. FFC took 34.7s. Estimated remaining: 2h 43m 6s. Rate: 9.5 symbols/min [2025-09-15T18:27:12.429374] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:27:12.463843] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-09-15T18:27:12.481660] [DEBUG] [LOCAL ] FHN: Loaded 40144 existing records from primary storage. [2025-09-15T18:27:12.481807] [INFO ] [MAIN ] FHN: Loaded 40144 existing records. [2025-09-15T18:27:12.660853] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:27:12.661132] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-09-15T18:27:12.661181] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-09-15T18:27:12.662135] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-09-15T18:27:12.662188] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-09-15T18:27:13.012049] [INFO ] [REMOTE ] FHN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:27:13.051656] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-15T18:27:13.257880] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-09-15T18:27:14.057892] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-09-15T18:27:14.353665] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-15T18:27:14.354885] [INFO ] [REMOTE ] FGSN: Full fetch complete (5558 records). [2025-09-15T18:27:14.354957] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-09-15T18:27:14.705724] [DEBUG] [VALIDATOR ] FGSN: All expected trading days are present. [2025-09-15T18:27:14.705805] [DEBUG] [VALIDATOR ] FGSN: Primary data validation passed. [2025-09-15T18:27:14.705980] [INFO ] [MAIN ] FGSN: Fetched primary data is valid. [2025-09-15T18:27:14.706019] [DEBUG] [LOCAL ] FGSN: Saving primary data. [2025-09-15T18:27:14.706403] [DEBUG] [LOCAL ] FGSN: Trimmed 5558 records to 3496 (keeping 150 days of data) [2025-09-15T18:27:14.727840] [DEBUG] [LOCAL ] FGSN: Primary data saved (3496 records). [2025-09-15T18:27:14.727934] [INFO ] [MAIN ] FGSN: Full history saved. [2025-09-15T18:27:14.728017] [INFO ] [MAIN ] Update Progress: 826/2369 symbols completed. FGSN took 12.6s. Estimated remaining: 2h 42m 52s. Rate: 9.5 symbols/min [2025-09-15T18:27:14.866416] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-09-15T18:27:14.899205] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:27:14.943088] [DEBUG] [LOCAL ] FI: Loaded 40371 existing records from primary storage. [2025-09-15T18:27:14.943263] [INFO ] [MAIN ] FI: Loaded 40371 existing records. [2025-09-15T18:27:15.119234] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:27:15.119508] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-09-15T18:27:15.119576] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-09-15T18:27:15.120498] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-09-15T18:27:15.120561] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-09-15T18:27:15.465783] [INFO ] [REMOTE ] FI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:27:15.550695] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-15T18:27:15.657859] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-09-15T18:27:15.980627] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-15T18:27:16.457896] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-09-15T18:27:17.257952] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-09-15T18:27:17.336006] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T18:27:18.058768] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-09-15T18:27:18.058690] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-15T18:27:18.535446] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T18:27:18.857881] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-09-15T18:27:19.453131] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-15T18:27:19.657887] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-09-15T18:27:20.003299] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-15T18:27:20.457887] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-09-15T18:27:21.257861] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-09-15T18:27:21.429659] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T18:27:21.523250] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T18:27:21.714581] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-15T18:27:22.057870] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-09-15T18:27:22.857876] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-09-15T18:27:23.481005] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-15T18:27:23.513243] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T18:27:23.657868] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-09-15T18:27:24.457906] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-09-15T18:27:25.262979] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-09-15T18:27:25.280921] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-15T18:27:25.698962] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-15T18:27:26.057879] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-09-15T18:27:26.300191] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-15T18:27:26.387029] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-15T18:27:26.857872] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-09-15T18:27:27.657894] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-09-15T18:27:28.149908] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-15T18:27:28.457916] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-09-15T18:27:29.124193] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T18:27:29.257870] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-09-15T18:27:30.057853] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-09-15T18:27:30.120381] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-15T18:27:30.575460] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-15T18:27:30.576406] [INFO ] [REMOTE ] FGN: Full fetch complete (4350 records). [2025-09-15T18:27:30.576473] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-09-15T18:27:30.863051] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-09-15T18:27:30.931445] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-09-15T18:27:30.931620] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-09-15T18:27:30.931814] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-09-15T18:27:30.931866] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-09-15T18:27:30.932396] [DEBUG] [LOCAL ] FGN: Trimmed 4350 records to 2723 (keeping 150 days of data) [2025-09-15T18:27:30.953767] [DEBUG] [LOCAL ] FGN: Primary data saved (2723 records). [2025-09-15T18:27:30.953872] [INFO ] [MAIN ] FGN: Full history saved. [2025-09-15T18:27:30.953955] [INFO ] [MAIN ] Update Progress: 827/2369 symbols completed. FGN took 29.1s. Estimated remaining: 2h 43m 5s. Rate: 9.5 symbols/min [2025-09-15T18:27:31.126733] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:27:31.165506] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-15T18:27:31.193469] [DEBUG] [LOCAL ] FICO: Loaded 16252 existing records from primary storage. [2025-09-15T18:27:31.193672] [INFO ] [MAIN ] FICO: Loaded 16252 existing records. [2025-09-15T18:27:31.374632] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:27:31.374913] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-09-15T18:27:31.374960] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-09-15T18:27:31.375487] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-09-15T18:27:31.375535] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-09-15T18:27:31.663011] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-09-15T18:27:31.722575] [INFO ] [REMOTE ] FICO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:27:32.329174] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-15T18:27:32.457883] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-09-15T18:27:33.257872] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-09-15T18:27:33.516772] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-15T18:27:33.555045] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T18:27:34.057869] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-09-15T18:27:34.857882] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-09-15T18:27:35.384100] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-15T18:27:35.657928] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-09-15T18:27:35.735588] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T18:27:35.959951] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-15T18:27:36.457878] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-09-15T18:27:37.158038] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-15T18:27:37.257856] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-09-15T18:27:37.616140] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-15T18:27:38.057928] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-09-15T18:27:38.457937] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T18:27:38.857889] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-09-15T18:27:39.412805] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T18:27:39.418577] [INFO ] [REMOTE ] FHN: Full fetch complete (58019 records). [2025-09-15T18:27:39.418707] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-09-15T18:27:39.664557] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-09-15T18:27:39.804930] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-09-15T18:27:39.805010] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-09-15T18:27:39.805894] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-09-15T18:27:39.805940] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-09-15T18:27:39.807101] [DEBUG] [LOCAL ] FHN: Trimmed 58019 records to 39364 (keeping 150 days of data) [2025-09-15T18:27:40.056480] [DEBUG] [LOCAL ] FHN: Primary data saved (39364 records). [2025-09-15T18:27:40.056625] [INFO ] [MAIN ] FHN: Full history saved. [2025-09-15T18:27:40.057669] [INFO ] [MAIN ] Update Progress: 828/2369 symbols completed. FHN took 27.8s. Estimated remaining: 2h 43m 3s. Rate: 9.5 symbols/min [2025-09-15T18:27:40.239122] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:27:40.240202] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-09-15T18:27:40.240097] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-15T18:27:40.240279] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-09-15T18:27:40.244454] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-09-15T18:27:40.244514] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-15T18:27:40.244566] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-15T18:27:40.244607] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-09-15T18:27:40.249902] [INFO ] [REMOTE ] FHI: Full fetch complete (43909 records). [2025-09-15T18:27:40.282412] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-09-15T18:27:40.461773] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-09-15T18:27:41.030554] [INFO ] [REMOTE ] FIG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:27:41.046114] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-09-15T18:27:41.046178] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-09-15T18:27:41.047055] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-09-15T18:27:41.047102] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-09-15T18:27:41.048113] [DEBUG] [LOCAL ] FHI: Trimmed 43909 records to 29782 (keeping 150 days of data) [2025-09-15T18:27:41.233804] [DEBUG] [LOCAL ] FHI: Primary data saved (29782 records). [2025-09-15T18:27:41.233960] [INFO ] [MAIN ] FHI: Full history saved. [2025-09-15T18:27:41.234069] [INFO ] [MAIN ] Update Progress: 829/2369 symbols completed. FHI took 35.0s. Estimated remaining: 2h 42m 47s. Rate: 9.5 symbols/min [2025-09-15T18:27:41.267771] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-09-15T18:27:41.415193] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:27:41.450139] [DEBUG] [LOCAL ] FIGS: Loaded 36665 existing records from primary storage. [2025-09-15T18:27:41.450314] [INFO ] [MAIN ] FIGS: Loaded 36665 existing records. [2025-09-15T18:27:41.636555] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:27:41.636925] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-09-15T18:27:41.637047] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-09-15T18:27:41.637774] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-09-15T18:27:41.637824] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-09-15T18:27:41.757629] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-15T18:27:41.781533] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-15T18:27:41.856457] [INFO ] [REMOTE ] FI: Full fetch complete (58125 records). [2025-09-15T18:27:41.876017] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-09-15T18:27:42.127868] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:27:42.107149] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-09-15T18:27:42.215308] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-15T18:27:42.423661] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-09-15T18:27:42.423741] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-09-15T18:27:42.424512] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-09-15T18:27:42.424554] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-09-15T18:27:42.425799] [DEBUG] [LOCAL ] FI: Trimmed 58125 records to 39603 (keeping 150 days of data) [2025-09-15T18:27:42.525241] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-15T18:27:42.685904] [DEBUG] [LOCAL ] FI: Primary data saved (39603 records). [2025-09-15T18:27:42.686106] [INFO ] [MAIN ] FI: Full history saved. [2025-09-15T18:27:42.686773] [INFO ] [MAIN ] Update Progress: 830/2369 symbols completed. FI took 28.0s. Estimated remaining: 2h 42m 32s. Rate: 9.5 symbols/min [2025-09-15T18:27:42.855591] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:27:42.857899] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-09-15T18:27:42.887879] [DEBUG] [LOCAL ] FIHL: Loaded 29260 existing records from primary storage. [2025-09-15T18:27:42.888042] [INFO ] [MAIN ] FIHL: Loaded 29260 existing records. [2025-09-15T18:27:43.061681] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:27:43.061928] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-09-15T18:27:43.061975] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-09-15T18:27:43.062667] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-09-15T18:27:43.062718] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-09-15T18:27:43.412827] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:27:43.657899] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-09-15T18:27:43.968815] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-15T18:27:43.985142] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-15T18:27:44.457888] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-09-15T18:27:45.257922] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-09-15T18:27:45.788871] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-15T18:27:46.057924] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-09-15T18:27:46.815878] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T18:27:46.857812] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-09-15T18:27:47.620000] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T18:27:47.657845] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-09-15T18:27:48.082485] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-15T18:27:48.457937] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-09-15T18:27:48.821857] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-15T18:27:49.257937] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-09-15T18:27:49.565295] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-15T18:27:49.855861] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-15T18:27:50.057873] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-09-15T18:27:50.159957] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-15T18:27:50.160243] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-09-15T18:27:50.857897] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-09-15T18:27:51.657877] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-07. [2025-09-15T18:27:51.996759] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-15T18:27:52.260968] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-15T18:27:52.457935] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-09-15T18:27:53.257908] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-09-15T18:27:53.681261] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-15T18:27:54.057871] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-09-15T18:27:54.633867] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T18:27:54.857920] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-09-15T18:27:55.454970] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T18:27:55.657868] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-09-15T18:27:56.136329] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T18:27:56.457869] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-09-15T18:27:57.205358] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T18:27:57.257888] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-09-15T18:27:57.818589] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-15T18:27:58.057906] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-09-15T18:27:58.865250] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-08. [2025-09-15T18:27:58.883786] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T18:27:59.203950] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-15T18:27:59.657889] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-09-15T18:28:00.457884] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-09-15T18:28:01.169089] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-15T18:28:01.257921] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-09-15T18:28:01.647901] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-08 (2.78 seconds). [2025-09-15T18:28:02.057930] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-09-15T18:28:02.420704] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-15T18:28:02.423241] [INFO ] [REMOTE ] FICO: Full fetch complete (21761 records). [2025-09-15T18:28:02.423362] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-09-15T18:28:02.800546] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-09-15T18:28:02.800662] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-09-15T18:28:02.801171] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-09-15T18:28:02.801219] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-09-15T18:28:02.801869] [DEBUG] [LOCAL ] FICO: Trimmed 21761 records to 16098 (keeping 150 days of data) [2025-09-15T18:28:02.879432] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-09. [2025-09-15T18:28:02.901787] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T18:28:02.908443] [INFO ] [REMOTE ] FIHL: Full fetch complete (43764 records). [2025-09-15T18:28:02.909060] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-09-15T18:28:03.334795] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-09-15T18:28:03.338260] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-09-15T18:28:03.338212] [DEBUG] [LOCAL ] FICO: Primary data saved (16098 records). [2025-09-15T18:28:03.339097] [INFO ] [MAIN ] FICO: Full history saved. [2025-09-15T18:28:03.339029] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-09-15T18:28:03.339269] [INFO ] [MAIN ] Update Progress: 831/2369 symbols completed. FICO took 32.4s. Estimated remaining: 2h 42m 52s. Rate: 9.4 symbols/min [2025-09-15T18:28:03.339177] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-09-15T18:28:03.441599] [DEBUG] [LOCAL ] FIHL: Trimmed 43764 records to 28558 (keeping 150 days of data) [2025-09-15T18:28:03.622099] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:28:03.644937] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-15T18:28:03.657374] [INFO ] [REMOTE ] FIGS: Full fetch complete (53264 records). [2025-09-15T18:28:03.658069] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-09-15T18:28:03.657663] [DEBUG] [LOCAL ] FINS: Loaded 6552 existing records from primary storage. [2025-09-15T18:28:03.659400] [INFO ] [MAIN ] FINS: Loaded 6552 existing records. [2025-09-15T18:28:04.040680] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:28:04.075576] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-09-15T18:28:04.075957] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-09-15T18:28:04.092497] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-09-15T18:28:04.099947] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-09-15T18:28:04.388256] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-09-15T18:28:04.408574] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-09-15T18:28:04.418497] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-09-15T18:28:04.441927] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-09-15T18:28:04.523188] [DEBUG] [LOCAL ] FIGS: Trimmed 53264 records to 36014 (keeping 150 days of data) [2025-09-15T18:28:04.754040] [INFO ] [REMOTE ] FINS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:28:04.757883] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-09-15T18:28:04.875980] [DEBUG] [LOCAL ] FIHL: Primary data saved (28558 records). [2025-09-15T18:28:04.876704] [INFO ] [MAIN ] FIHL: Full history saved. [2025-09-15T18:28:04.877140] [INFO ] [MAIN ] Update Progress: 832/2369 symbols completed. FIHL took 22.2s. Estimated remaining: 2h 42m 37s. Rate: 9.5 symbols/min [2025-09-15T18:28:05.071078] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:28:05.080825] [DEBUG] [LOCAL ] FIGS: Primary data saved (36014 records). [2025-09-15T18:28:05.080951] [INFO ] [MAIN ] FIGS: Full history saved. [2025-09-15T18:28:05.081067] [INFO ] [MAIN ] Update Progress: 833/2369 symbols completed. FIGS took 23.8s. Estimated remaining: 2h 42m 19s. Rate: 9.5 symbols/min [2025-09-15T18:28:05.277783] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:28:05.279571] [DEBUG] [LOCAL ] FINV: Loaded 33673 existing records from primary storage. [2025-09-15T18:28:05.279747] [INFO ] [MAIN ] FINV: Loaded 33673 existing records. [2025-09-15T18:28:05.409731] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-15T18:28:05.441739] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-09-15T18:28:05.482924] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:28:05.483165] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-09-15T18:28:05.483212] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-09-15T18:28:05.483951] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-09-15T18:28:05.484005] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-09-15T18:28:05.612126] [DEBUG] [LOCAL ] FIS: Loaded 40130 existing records from primary storage. [2025-09-15T18:28:05.628253] [INFO ] [MAIN ] FIS: Loaded 40130 existing records. [2025-09-15T18:28:05.978261] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:28:05.979123] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-09-15T18:28:05.994703] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-09-15T18:28:06.036365] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-09-15T18:28:06.036531] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-09-15T18:28:06.066375] [INFO ] [REMOTE ] FINV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:28:06.117479] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-09 (3.24 seconds). [2025-09-15T18:28:06.117949] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-09-15T18:28:06.155322] [INFO ] [REMOTE ] FIG: Full fetch complete (12562 records). [2025-09-15T18:28:06.190153] [DEBUG] [VALIDATOR ] FIG: Validating primary data. [2025-09-15T18:28:06.191081] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-15T18:28:06.193152] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-09-15T18:28:06.624103] [WARN ] [VALIDATOR ] FIG: Validation failed - insufficient historical data. Have 102 unique days, need 150 days [2025-09-15T18:28:06.650782] [FATAL] [MAIN ] FIG: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:28:06.656156] [INFO ] [REMOTE ] FIS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:28:06.656345] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:28:06.656713] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-15T18:28:06.656792] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-15T18:28:06.656833] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-09-15T18:28:06.656885] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-09-15T18:28:06.656960] [INFO ] [MAIN ] Update Progress: 834/2369 symbols completed. FIG took 26.6s. Estimated remaining: 2h 42m 4s. Rate: 9.5 symbols/min [2025-09-15T18:28:06.835785] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:28:06.858097] [DEBUG] [LOCAL ] FIX: Loaded 21542 existing records from primary storage. [2025-09-15T18:28:06.858213] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-09-15T18:28:06.858532] [INFO ] [MAIN ] FIX: Loaded 21542 existing records. [2025-09-15T18:28:07.034500] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:28:07.034768] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-09-15T18:28:07.034847] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-09-15T18:28:07.035380] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-09-15T18:28:07.035427] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-09-15T18:28:07.224546] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-15T18:28:07.399449] [INFO ] [REMOTE ] FIX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:28:07.657938] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-09-15T18:28:07.835958] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-15T18:28:08.457879] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-09-15T18:28:08.684170] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-15T18:28:08.832947] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-15T18:28:09.257903] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-09-15T18:28:10.046381] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-15T18:28:10.063498] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-09-15T18:28:10.074902] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T18:28:10.837776] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-15T18:28:10.857866] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-09-15T18:28:11.657889] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-09-15T18:28:12.390862] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-15T18:28:12.457859] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-09-15T18:28:13.262948] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-09-15T18:28:13.277824] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T18:28:14.057880] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-09-15T18:28:14.317745] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-15T18:28:14.471664] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-15T18:28:14.857890] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-09-15T18:28:14.928882] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T18:28:15.657877] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-09-15T18:28:16.457860] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-09-15T18:28:16.686893] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-15T18:28:16.832775] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-15T18:28:17.254770] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-15T18:28:17.257818] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-09-15T18:28:17.792794] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-15T18:28:17.794278] [INFO ] [REMOTE ] FINS: Full fetch complete (8851 records). [2025-09-15T18:28:17.794357] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-09-15T18:28:18.063093] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-09-15T18:28:18.164668] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-09-15T18:28:18.164768] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-09-15T18:28:18.165020] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-09-15T18:28:18.165061] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-09-15T18:28:18.165482] [DEBUG] [LOCAL ] FINS: Trimmed 8851 records to 6401 (keeping 150 days of data) [2025-09-15T18:28:18.205270] [DEBUG] [LOCAL ] FINS: Primary data saved (6401 records). [2025-09-15T18:28:18.205373] [INFO ] [MAIN ] FINS: Full history saved. [2025-09-15T18:28:18.205487] [INFO ] [MAIN ] Update Progress: 835/2369 symbols completed. FINS took 14.9s. Estimated remaining: 2h 42m 7s. Rate: 9.5 symbols/min [2025-09-15T18:28:18.372811] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:28:18.372990] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-09-15T18:28:18.373030] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-09-15T18:28:18.373151] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-09-15T18:28:18.373189] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-15T18:28:18.373239] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-15T18:28:18.373288] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-09-15T18:28:18.734966] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:28:18.857932] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-09-15T18:28:19.377953] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-15T18:28:19.657928] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-09-15T18:28:20.290356] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T18:28:20.457882] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-09-15T18:28:21.008063] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T18:28:21.257875] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-09-15T18:28:21.763916] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T18:28:22.057873] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-02. [2025-09-15T18:28:22.250916] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T18:28:22.251237] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-02 [2025-09-15T18:28:22.315286] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-15T18:28:22.857880] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-03. [2025-09-15T18:28:23.093740] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T18:28:23.094062] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-03 [2025-09-15T18:28:23.657924] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-09-15T18:28:24.457984] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-04. [2025-09-15T18:28:24.687123] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T18:28:24.687580] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-04 [2025-09-15T18:28:24.987091] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-15T18:28:25.257881] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-09-15T18:28:26.057878] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-05. [2025-09-15T18:28:26.270470] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T18:28:26.270896] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-05 [2025-09-15T18:28:26.777248] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T18:28:26.857852] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-09-15T18:28:27.657939] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-09-15T18:28:28.119340] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T18:28:28.129923] [INFO ] [REMOTE ] FINV: Full fetch complete (48877 records). [2025-09-15T18:28:28.130169] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-09-15T18:28:28.463152] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-06. [2025-09-15T18:28:28.656617] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-09-15T18:28:28.656839] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-09-15T18:28:28.657838] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-09-15T18:28:28.657915] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-09-15T18:28:28.659461] [DEBUG] [LOCAL ] FINV: Trimmed 48877 records to 32958 (keeping 150 days of data) [2025-09-15T18:28:28.874026] [DEBUG] [LOCAL ] FINV: Primary data saved (32958 records). [2025-09-15T18:28:28.874217] [INFO ] [MAIN ] FINV: Full history saved. [2025-09-15T18:28:28.875104] [INFO ] [MAIN ] Update Progress: 836/2369 symbols completed. FINV took 24.0s. Estimated remaining: 2h 42m 9s. Rate: 9.5 symbols/min [2025-09-15T18:28:29.054222] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:28:29.064602] [DEBUG] [LOCAL ] FLC: Loaded 3956 existing records from primary storage. [2025-09-15T18:28:29.064858] [INFO ] [MAIN ] FLC: Loaded 3956 existing records. [2025-09-15T18:28:29.186841] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-15T18:28:29.269291] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-07. [2025-09-15T18:28:29.304036] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:28:29.258846] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-15T18:28:29.311065] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-09-15T18:28:29.311868] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-09-15T18:28:29.312566] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-09-15T18:28:29.312634] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-09-15T18:28:29.679670] [INFO ] [REMOTE ] FLC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:28:29.869447] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-15T18:28:30.057918] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-08. [2025-09-15T18:28:30.482309] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-15T18:28:30.857948] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-09. [2025-09-15T18:28:31.583387] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-15T18:28:31.584554] [INFO ] [REMOTE ] FIXT: Full fetch complete (1634 records). [2025-09-15T18:28:31.584634] [DEBUG] [VALIDATOR ] FIXT: Validating primary data. [2025-09-15T18:28:31.663061] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-09-15T18:28:31.775939] [WARN ] [VALIDATOR ] FIXT: Validation failed - insufficient historical data. Have 63 unique days, need 150 days [2025-09-15T18:28:31.776151] [FATAL] [MAIN ] FIXT: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:28:31.776203] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:28:31.776252] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-15T18:28:31.776316] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-15T18:28:31.776370] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-09-15T18:28:31.776415] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-09-15T18:28:31.776479] [INFO ] [MAIN ] Update Progress: 837/2369 symbols completed. FIXT took 13.6s. Estimated remaining: 2h 41m 56s. Rate: 9.5 symbols/min [2025-09-15T18:28:32.457881] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-09-15T18:28:32.793770] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T18:28:33.257884] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-09-15T18:28:33.953445] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-15T18:28:34.057860] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-09-15T18:28:34.400635] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-15T18:28:34.551790] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-15T18:28:34.857895] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-09-15T18:28:35.324824] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-15T18:28:35.657932] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-09-15T18:28:36.457879] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-09-15T18:28:37.257925] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-09-15T18:28:37.448310] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-15T18:28:37.834169] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-15T18:28:37.841129] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-15T18:28:37.843024] [INFO ] [REMOTE ] FIX: Full fetch complete (34782 records). [2025-09-15T18:28:37.843341] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-09-15T18:28:38.066960] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-09-15T18:28:38.228669] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-09-15T18:28:38.228754] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-09-15T18:28:38.229388] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-09-15T18:28:38.229431] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-09-15T18:28:38.230367] [DEBUG] [LOCAL ] FIX: Trimmed 34782 records to 21071 (keeping 150 days of data) [2025-09-15T18:28:38.375762] [DEBUG] [LOCAL ] FIX: Primary data saved (21071 records). [2025-09-15T18:28:38.375898] [INFO ] [MAIN ] FIX: Full history saved. [2025-09-15T18:28:38.375987] [INFO ] [MAIN ] Update Progress: 838/2369 symbols completed. FIX took 31.7s. Estimated remaining: 2h 41m 50s. Rate: 9.5 symbols/min [2025-09-15T18:28:38.776628] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-15T18:28:38.857872] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-09-15T18:28:39.211524] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-15T18:28:39.657897] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-09-15T18:28:40.457954] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-09-15T18:28:40.873476] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-15T18:28:41.257878] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-09-15T18:28:41.437374] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-15T18:28:41.443513] [INFO ] [REMOTE ] FIS: Full fetch complete (58053 records). [2025-09-15T18:28:41.443707] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-09-15T18:28:41.753672] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-15T18:28:41.790052] [INFO ] [REMOTE ] FLC: Full fetch complete (6105 records). [2025-09-15T18:28:41.808046] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-09-15T18:28:41.929772] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-09-15T18:28:41.952690] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-09-15T18:28:41.953827] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-09-15T18:28:41.954181] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-09-15T18:28:42.080079] [DEBUG] [LOCAL ] FIS: Trimmed 58053 records to 39350 (keeping 150 days of data) [2025-09-15T18:28:42.319176] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-09-15T18:28:42.319521] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-09-15T18:28:42.320076] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-09-15T18:28:42.320341] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-09-15T18:28:42.322022] [DEBUG] [LOCAL ] FLC: Trimmed 6105 records to 3882 (keeping 150 days of data) [2025-09-15T18:28:42.350628] [DEBUG] [LOCAL ] FLC: Primary data saved (3882 records). [2025-09-15T18:28:42.351514] [INFO ] [MAIN ] FLC: Full history saved. [2025-09-15T18:28:42.351963] [INFO ] [MAIN ] Update Progress: 839/2369 symbols completed. FLC took 13.5s. Estimated remaining: 2h 41m 40s. Rate: 9.5 symbols/min [2025-09-15T18:28:42.507834] [DEBUG] [LOCAL ] FIS: Primary data saved (39350 records). [2025-09-15T18:28:42.507996] [INFO ] [MAIN ] FIS: Full history saved. [2025-09-15T18:28:42.508511] [INFO ] [MAIN ] Update Progress: 840/2369 symbols completed. FIS took 37.4s. Estimated remaining: 2h 41m 22s. Rate: 9.5 symbols/min [2025-09-15T18:28:43.055871] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:28:43.153960] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:28:43.185350] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:28:43.241580] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:28:43.268089] [DEBUG] [LOCAL ] FLOC: Loaded 20938 existing records from primary storage. [2025-09-15T18:28:43.268743] [INFO ] [MAIN ] FLOC: Loaded 20938 existing records. [2025-09-15T18:28:43.344282] [DEBUG] [LOCAL ] FLNG: Loaded 25164 existing records from primary storage. [2025-09-15T18:28:43.355375] [INFO ] [MAIN ] FLNG: Loaded 25164 existing records. [2025-09-15T18:28:43.606208] [DEBUG] [LOCAL ] FLG: Loaded 40127 existing records from primary storage. [2025-09-15T18:28:43.611052] [WARN ] [MAIN ] FLOC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:28:43.612438] [DEBUG] [LOCAL ] FLO: Loaded 39052 existing records from primary storage. [2025-09-15T18:28:43.611221] [INFO ] [MAIN ] FLG: Loaded 40127 existing records. [2025-09-15T18:28:43.628187] [INFO ] [MAIN ] FLO: Loaded 39052 existing records. [2025-09-15T18:28:43.628244] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-09-15T18:28:43.706406] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-15T18:28:43.776552] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:28:43.823998] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-09-15T18:28:43.823944] [DEBUG] [LOCAL ] FLOC: Deleted primary data file. [2025-09-15T18:28:43.872900] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-09-15T18:28:43.867749] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-09-15T18:28:43.919164] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-09-15T18:28:43.944694] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-09-15T18:28:44.242325] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:28:44.258624] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:28:44.301340] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-09-15T18:28:44.348314] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-09-15T18:28:44.348160] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-09-15T18:28:44.378480] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-09-15T18:28:44.420265] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-09-15T18:28:44.430798] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-09-15T18:28:44.516109] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-09-15T18:28:44.613589] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-09-15T18:28:45.024314] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:28:45.092827] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-09-15T18:28:45.240167] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:28:45.293814] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-09-15T18:28:45.592319] [INFO ] [REMOTE ] FLO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:28:45.594401] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-09-15T18:28:45.614299] [INFO ] [REMOTE ] FLG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:28:45.614709] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-09-15T18:28:46.388135] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-15T18:28:46.394032] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-09-15T18:28:46.570743] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T18:28:46.578540] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-09-15T18:28:46.901983] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-15T18:28:46.915605] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-09-15T18:28:47.393263] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-15T18:28:47.657855] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-09-15T18:28:47.792005] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T18:28:48.036473] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T18:28:48.261048] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T18:28:48.457876] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-09-15T18:28:49.257839] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-09-15T18:28:49.382958] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-15T18:28:49.797854] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T18:28:50.057906] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-09-15T18:28:50.383098] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-15T18:28:50.857956] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-09-15T18:28:51.657904] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-09-15T18:28:51.792232] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-15T18:28:52.457929] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-09-15T18:28:52.687444] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-15T18:28:52.700807] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-15T18:28:53.257921] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-09-15T18:28:54.057935] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-09-15T18:28:54.243797] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-15T18:28:54.629938] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T18:28:54.857913] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-09-15T18:28:55.515767] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T18:28:55.657872] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-09-15T18:28:56.234303] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-15T18:28:56.457914] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-09-15T18:28:57.257903] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-09-15T18:28:57.354934] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-15T18:28:57.585692] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-15T18:28:58.057894] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-09-15T18:28:58.857896] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-09-15T18:28:59.112229] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-15T18:28:59.144915] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-15T18:28:59.657903] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-09-15T18:29:00.457877] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-09-15T18:29:00.775025] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-15T18:29:00.798221] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-15T18:29:00.802991] [INFO ] [REMOTE ] FLNG: Full fetch complete (37676 records). [2025-09-15T18:29:00.803101] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-09-15T18:29:01.178588] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-09-15T18:29:01.178719] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-09-15T18:29:01.179427] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-09-15T18:29:01.179485] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-09-15T18:29:01.180823] [DEBUG] [LOCAL ] FLNG: Trimmed 37676 records to 24804 (keeping 150 days of data) [2025-09-15T18:29:01.276547] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-09-15T18:29:01.343605] [DEBUG] [LOCAL ] FLNG: Primary data saved (24804 records). [2025-09-15T18:29:01.343784] [INFO ] [MAIN ] FLNG: Full history saved. [2025-09-15T18:29:01.343887] [INFO ] [MAIN ] Update Progress: 841/2369 symbols completed. FLNG took 18.8s. Estimated remaining: 2h 41m 39s. Rate: 9.5 symbols/min [2025-09-15T18:29:01.516212] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:29:01.554816] [DEBUG] [LOCAL ] FLR: Loaded 40081 existing records from primary storage. [2025-09-15T18:29:01.554997] [INFO ] [MAIN ] FLR: Loaded 40081 existing records. [2025-09-15T18:29:01.744402] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:29:01.744725] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-09-15T18:29:01.744776] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-09-15T18:29:01.745558] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-09-15T18:29:01.745613] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-09-15T18:29:02.073690] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-09-15T18:29:02.113380] [INFO ] [REMOTE ] FLR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:29:02.193943] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-15T18:29:02.869114] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-09-15T18:29:02.875318] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-15T18:29:03.187492] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T18:29:03.657911] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-09-15T18:29:04.457882] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-09-15T18:29:04.775255] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-15T18:29:04.781111] [INFO ] [REMOTE ] FLO: Full fetch complete (56353 records). [2025-09-15T18:29:04.781219] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-09-15T18:29:05.172807] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-09-15T18:29:05.172928] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-09-15T18:29:05.174045] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-09-15T18:29:05.174124] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-09-15T18:29:05.190304] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T18:29:05.195906] [DEBUG] [LOCAL ] FLO: Trimmed 56353 records to 38409 (keeping 150 days of data) [2025-09-15T18:29:05.196877] [INFO ] [REMOTE ] FLG: Full fetch complete (58013 records). [2025-09-15T18:29:05.197259] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-09-15T18:29:05.262561] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-09-15T18:29:05.779153] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T18:29:05.773327] [DEBUG] [LOCAL ] FLO: Primary data saved (38409 records). [2025-09-15T18:29:05.789572] [INFO ] [MAIN ] FLO: Full history saved. [2025-09-15T18:29:05.859992] [INFO ] [MAIN ] Update Progress: 842/2369 symbols completed. FLO took 23.3s. Estimated remaining: 2h 41m 29s. Rate: 9.5 symbols/min [2025-09-15T18:29:05.863146] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-09-15T18:29:05.863591] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-09-15T18:29:05.895492] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-09-15T18:29:05.927580] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-09-15T18:29:05.971700] [DEBUG] [LOCAL ] FLG: Trimmed 58013 records to 39349 (keeping 150 days of data) [2025-09-15T18:29:06.037117] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:29:06.096112] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-09-15T18:29:06.183184] [DEBUG] [LOCAL ] FLS: Loaded 37556 existing records from primary storage. [2025-09-15T18:29:06.191902] [INFO ] [MAIN ] FLS: Loaded 37556 existing records. [2025-09-15T18:29:06.484667] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:29:06.494683] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-09-15T18:29:06.497705] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-09-15T18:29:06.504273] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-09-15T18:29:06.505017] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-09-15T18:29:06.654885] [DEBUG] [LOCAL ] FLG: Primary data saved (39349 records). [2025-09-15T18:29:06.672846] [INFO ] [MAIN ] FLG: Full history saved. [2025-09-15T18:29:06.712460] [INFO ] [MAIN ] Update Progress: 843/2369 symbols completed. FLG took 24.2s. Estimated remaining: 2h 41m 13s. Rate: 9.5 symbols/min [2025-09-15T18:29:06.976865] [INFO ] [REMOTE ] FLS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:29:06.982736] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-09-15T18:29:07.051405] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:29:07.096056] [DEBUG] [LOCAL ] FLUT: Loaded 38069 existing records from primary storage. [2025-09-15T18:29:07.096238] [INFO ] [MAIN ] FLUT: Loaded 38069 existing records. [2025-09-15T18:29:07.318547] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-15T18:29:07.318844] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:29:07.329991] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-09-15T18:29:07.330112] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-09-15T18:29:07.336172] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-09-15T18:29:07.345602] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-09-15T18:29:07.353200] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-15T18:29:07.663022] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-09-15T18:29:07.723127] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:29:08.354926] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T18:29:08.457863] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-09-15T18:29:09.257905] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-09-15T18:29:09.575147] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-15T18:29:10.057843] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-09-15T18:29:10.157350] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-15T18:29:10.630174] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T18:29:10.857872] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-09-15T18:29:11.511716] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T18:29:11.657885] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-09-15T18:29:12.457900] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-09-15T18:29:12.764001] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-15T18:29:13.257885] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-09-15T18:29:13.320756] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T18:29:13.801006] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T18:29:14.057911] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-09-15T18:29:14.812074] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T18:29:14.857899] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-09-15T18:29:15.611000] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-15T18:29:15.657860] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-09-15T18:29:16.457936] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-09-15T18:29:16.531224] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-15T18:29:17.257886] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-09-15T18:29:17.384354] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-15T18:29:18.057903] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-09-15T18:29:18.173496] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-15T18:29:18.857859] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-09-15T18:29:18.906171] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-15T18:29:19.113445] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T18:29:19.657870] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-09-15T18:29:20.457937] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-09-15T18:29:20.578865] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-15T18:29:20.905525] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-15T18:29:20.911144] [INFO ] [REMOTE ] FLOC: Full fetch complete (31646 records). [2025-09-15T18:29:20.911360] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-09-15T18:29:21.266265] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-09-15T18:29:21.404069] [DEBUG] [VALIDATOR ] FLOC: All expected trading days are present. [2025-09-15T18:29:21.404162] [DEBUG] [VALIDATOR ] FLOC: Primary data validation passed. [2025-09-15T18:29:21.404820] [INFO ] [MAIN ] FLOC: Fetched primary data is valid. [2025-09-15T18:29:21.404869] [DEBUG] [LOCAL ] FLOC: Saving primary data. [2025-09-15T18:29:21.406422] [DEBUG] [LOCAL ] FLOC: Trimmed 31646 records to 20511 (keeping 150 days of data) [2025-09-15T18:29:21.540720] [DEBUG] [LOCAL ] FLOC: Primary data saved (20511 records). [2025-09-15T18:29:21.540878] [INFO ] [MAIN ] FLOC: Full history saved. [2025-09-15T18:29:21.541010] [INFO ] [MAIN ] Update Progress: 844/2369 symbols completed. FLOC took 39.0s. Estimated remaining: 2h 41m 22s. Rate: 9.5 symbols/min [2025-09-15T18:29:21.709662] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:29:21.730131] [DEBUG] [LOCAL ] FLXR: Loaded 15326 existing records from primary storage. [2025-09-15T18:29:21.730266] [INFO ] [MAIN ] FLXR: Loaded 15326 existing records. [2025-09-15T18:29:21.907481] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:29:21.907756] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-09-15T18:29:21.907803] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-09-15T18:29:21.908231] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-09-15T18:29:21.908276] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-09-15T18:29:22.059257] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-09-15T18:29:22.260417] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:29:22.447435] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-15T18:29:22.857836] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-09-15T18:29:23.196690] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-15T18:29:23.501484] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T18:29:23.657869] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-09-15T18:29:24.230479] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-15T18:29:24.457888] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-09-15T18:29:25.126163] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T18:29:25.131768] [INFO ] [REMOTE ] FLR: Full fetch complete (57363 records). [2025-09-15T18:29:25.131943] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-09-15T18:29:25.134217] [FATAL] [VALIDATOR ] FLR: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:29:25.134343] [FATAL] [MAIN ] FLR: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:29:25.134391] [WARN ] [MAIN ] FLR: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:29:25.134439] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-09-15T18:29:25.134497] [DEBUG] [LOCAL ] FLR: No primary data file found to delete. [2025-09-15T18:29:25.134534] [INFO ] [LOCAL ] FLR: Starting deletion of derivative data. [2025-09-15T18:29:25.134902] [DEBUG] [LOCAL ] FLR: Deleted derivative data file. [2025-09-15T18:29:25.135866] [INFO ] [MAIN ] Update Progress: 845/2369 symbols completed. FLR took 23.8s. Estimated remaining: 2h 41m 10s. Rate: 9.5 symbols/min [2025-09-15T18:29:25.262983] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-09-15T18:29:25.321283] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:29:25.372756] [DEBUG] [LOCAL ] FMC: Loaded 38798 existing records from primary storage. [2025-09-15T18:29:25.372932] [INFO ] [MAIN ] FMC: Loaded 38798 existing records. [2025-09-15T18:29:25.548255] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:29:25.548553] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-09-15T18:29:25.548612] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-09-15T18:29:25.549552] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-09-15T18:29:25.549602] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-09-15T18:29:25.898164] [INFO ] [REMOTE ] FMC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:29:26.057867] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-09-15T18:29:26.134961] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-15T18:29:26.140603] [INFO ] [REMOTE ] FLUT: Full fetch complete (55462 records). [2025-09-15T18:29:26.140761] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-09-15T18:29:26.526015] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-09-15T18:29:26.526129] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-09-15T18:29:26.527065] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-09-15T18:29:26.527128] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-09-15T18:29:26.528551] [DEBUG] [LOCAL ] FLUT: Trimmed 55462 records to 37330 (keeping 150 days of data) [2025-09-15T18:29:26.657261] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-15T18:29:26.802554] [DEBUG] [LOCAL ] FLUT: Primary data saved (37330 records). [2025-09-15T18:29:26.802727] [INFO ] [MAIN ] FLUT: Full history saved. [2025-09-15T18:29:26.802829] [INFO ] [MAIN ] Update Progress: 846/2369 symbols completed. FLUT took 20.1s. Estimated remaining: 2h 40m 56s. Rate: 9.5 symbols/min [2025-09-15T18:29:26.865790] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-09-15T18:29:26.974302] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:29:26.980089] [DEBUG] [LOCAL ] FMN: Loaded 3943 existing records from primary storage. [2025-09-15T18:29:26.980192] [INFO ] [MAIN ] FMN: Loaded 3943 existing records. [2025-09-15T18:29:27.159235] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:29:27.159492] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-09-15T18:29:27.159537] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-09-15T18:29:27.159782] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-09-15T18:29:27.159840] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-09-15T18:29:27.514139] [INFO ] [REMOTE ] FMN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:29:27.657875] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-09-15T18:29:28.038916] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-15T18:29:28.158604] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T18:29:28.164537] [INFO ] [REMOTE ] FLS: Full fetch complete (54263 records). [2025-09-15T18:29:28.164665] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-09-15T18:29:28.440578] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-15T18:29:28.458936] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-09-15T18:29:28.552914] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-09-15T18:29:28.553000] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-09-15T18:29:28.553878] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-09-15T18:29:28.553960] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-09-15T18:29:28.555326] [DEBUG] [LOCAL ] FLS: Trimmed 54263 records to 36835 (keeping 150 days of data) [2025-09-15T18:29:28.784589] [DEBUG] [LOCAL ] FLS: Primary data saved (36835 records). [2025-09-15T18:29:28.784749] [INFO ] [MAIN ] FLS: Full history saved. [2025-09-15T18:29:28.784856] [INFO ] [MAIN ] Update Progress: 847/2369 symbols completed. FLS took 22.9s. Estimated remaining: 2h 40m 41s. Rate: 9.5 symbols/min [2025-09-15T18:29:28.958720] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:29:28.982832] [DEBUG] [LOCAL ] FMS: Loaded 22575 existing records from primary storage. [2025-09-15T18:29:28.983009] [INFO ] [MAIN ] FMS: Loaded 22575 existing records. [2025-09-15T18:29:29.161213] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:29:29.161438] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-09-15T18:29:29.161483] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-09-15T18:29:29.162061] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-09-15T18:29:29.162124] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-09-15T18:29:29.262098] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-09-15T18:29:29.503084] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-15T18:29:29.527503] [INFO ] [REMOTE ] FMS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:29:30.017988] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-15T18:29:30.057871] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-09-15T18:29:30.753355] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-15T18:29:30.857838] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-09-15T18:29:31.657870] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-09-15T18:29:31.849909] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-15T18:29:32.208695] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-15T18:29:32.457876] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-09-15T18:29:33.257871] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-09-15T18:29:33.467492] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-15T18:29:34.057865] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-09-15T18:29:34.759391] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-15T18:29:34.857865] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-09-15T18:29:35.134207] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-15T18:29:35.657907] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-09-15T18:29:35.922066] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-15T18:29:36.244517] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-15T18:29:36.457896] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-09-15T18:29:37.257873] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-09-15T18:29:37.779195] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-15T18:29:38.057928] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-09-15T18:29:38.225127] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-15T18:29:38.702695] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-15T18:29:38.857882] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-09-15T18:29:39.517050] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-15T18:29:39.657891] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-09-15T18:29:40.457897] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-09-15T18:29:40.734044] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-15T18:29:41.118988] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-15T18:29:41.120202] [INFO ] [REMOTE ] FMN: Full fetch complete (6821 records). [2025-09-15T18:29:41.120269] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-09-15T18:29:41.262959] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-09-15T18:29:41.485533] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-09-15T18:29:41.485619] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-09-15T18:29:41.485828] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-09-15T18:29:41.485868] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-09-15T18:29:41.486257] [DEBUG] [LOCAL ] FMN: Trimmed 6821 records to 3809 (keeping 150 days of data) [2025-09-15T18:29:41.512632] [DEBUG] [LOCAL ] FMN: Primary data saved (3809 records). [2025-09-15T18:29:41.512829] [INFO ] [MAIN ] FMN: Full history saved. [2025-09-15T18:29:41.512930] [INFO ] [MAIN ] Update Progress: 848/2369 symbols completed. FMN took 14.7s. Estimated remaining: 2h 40m 46s. Rate: 9.5 symbols/min [2025-09-15T18:29:41.682780] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:29:41.712772] [DEBUG] [LOCAL ] FMX: Loaded 30463 existing records from primary storage. [2025-09-15T18:29:41.712926] [INFO ] [MAIN ] FMX: Loaded 30463 existing records. [2025-09-15T18:29:41.891238] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:29:41.891505] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-09-15T18:29:41.891550] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-09-15T18:29:41.892328] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-09-15T18:29:41.892378] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-09-15T18:29:42.063599] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-09-15T18:29:42.255064] [INFO ] [REMOTE ] FMX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:29:42.753162] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T18:29:42.857841] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-09-15T18:29:43.457505] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-15T18:29:43.657872] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-09-15T18:29:44.457869] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-09-15T18:29:44.507945] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-15T18:29:44.748574] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-15T18:29:45.257870] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-09-15T18:29:45.659365] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-15T18:29:46.023532] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-15T18:29:46.057887] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-09-15T18:29:46.857934] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-09-15T18:29:47.631726] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-15T18:29:47.657884] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-09-15T18:29:47.816820] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-15T18:29:48.457870] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-09-15T18:29:49.257891] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-09-15T18:29:49.364193] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-15T18:29:49.588364] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T18:29:50.057888] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-09-15T18:29:50.358203] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T18:29:50.857919] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-09-15T18:29:51.475893] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T18:29:51.657896] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-09-15T18:29:52.448892] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-15T18:29:52.457961] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-09-15T18:29:53.150373] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-15T18:29:53.257832] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-09-15T18:29:53.611634] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T18:29:53.615497] [INFO ] [REMOTE ] FMS: Full fetch complete (32830 records). [2025-09-15T18:29:53.615595] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-09-15T18:29:53.981308] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-09-15T18:29:53.981392] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-09-15T18:29:53.981957] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-09-15T18:29:53.982030] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-09-15T18:29:53.982806] [DEBUG] [LOCAL ] FMS: Trimmed 32830 records to 22098 (keeping 150 days of data) [2025-09-15T18:29:54.070743] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-09-15T18:29:54.118987] [DEBUG] [LOCAL ] FMS: Primary data saved (22098 records). [2025-09-15T18:29:54.119154] [INFO ] [MAIN ] FMS: Full history saved. [2025-09-15T18:29:54.119252] [INFO ] [MAIN ] Update Progress: 849/2369 symbols completed. FMS took 25.3s. Estimated remaining: 2h 40m 51s. Rate: 9.4 symbols/min [2025-09-15T18:29:54.294182] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:29:54.297350] [DEBUG] [LOCAL ] FMY: Loaded 1043 existing records from primary storage. [2025-09-15T18:29:54.297461] [INFO ] [MAIN ] FMY: Loaded 1043 existing records. [2025-09-15T18:29:54.477714] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:29:54.478020] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-09-15T18:29:54.478070] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-09-15T18:29:54.478271] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-09-15T18:29:54.478316] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-09-15T18:29:54.833682] [INFO ] [REMOTE ] FMY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:29:54.852795] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-15T18:29:54.859481] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-09-15T18:29:54.861739] [INFO ] [REMOTE ] FMC: Full fetch complete (56503 records). [2025-09-15T18:29:54.861974] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-09-15T18:29:55.260402] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-09-15T18:29:55.260670] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-09-15T18:29:55.261596] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-09-15T18:29:55.261764] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-09-15T18:29:55.276179] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-15T18:29:55.280293] [INFO ] [REMOTE ] FLXR: Full fetch complete (20518 records). [2025-09-15T18:29:55.280422] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-09-15T18:29:55.280561] [DEBUG] [LOCAL ] FMC: Trimmed 56503 records to 38090 (keeping 150 days of data) [2025-09-15T18:29:55.661143] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-09-15T18:29:55.896678] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-09-15T18:29:55.896770] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-09-15T18:29:55.897226] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-09-15T18:29:55.898320] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-09-15T18:29:55.916023] [DEBUG] [LOCAL ] FMC: Primary data saved (38090 records). [2025-09-15T18:29:55.916420] [INFO ] [MAIN ] FMC: Full history saved. [2025-09-15T18:29:55.918352] [INFO ] [MAIN ] Update Progress: 850/2369 symbols completed. FMC took 30.8s. Estimated remaining: 2h 40m 37s. Rate: 9.5 symbols/min [2025-09-15T18:29:55.916346] [DEBUG] [LOCAL ] FLXR: Trimmed 20518 records to 15177 (keeping 150 days of data) [2025-09-15T18:29:56.172022] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:29:56.196882] [DEBUG] [LOCAL ] FLXR: Primary data saved (15177 records). [2025-09-15T18:29:56.197211] [INFO ] [MAIN ] FLXR: Full history saved. [2025-09-15T18:29:56.204364] [INFO ] [MAIN ] Update Progress: 851/2369 symbols completed. FLXR took 34.7s. Estimated remaining: 2h 40m 20s. Rate: 9.5 symbols/min [2025-09-15T18:29:56.294550] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-15T18:29:56.339307] [DEBUG] [LOCAL ] FN: Loaded 28785 existing records from primary storage. [2025-09-15T18:29:56.364135] [INFO ] [MAIN ] FN: Loaded 28785 existing records. [2025-09-15T18:29:56.428780] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:29:56.473479] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-09-15T18:29:56.590000] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:29:56.590942] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-09-15T18:29:56.591003] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-09-15T18:29:56.591770] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-09-15T18:29:56.591843] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-09-15T18:29:56.800782] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-15T18:29:56.837558] [DEBUG] [LOCAL ] FNB: Loaded 39382 existing records from primary storage. [2025-09-15T18:29:56.868096] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-15T18:29:56.897407] [INFO ] [MAIN ] FNB: Loaded 39382 existing records. [2025-09-15T18:29:57.213398] [INFO ] [REMOTE ] FN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:29:57.218972] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:29:57.219539] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-09-15T18:29:57.219590] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-09-15T18:29:57.220503] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-09-15T18:29:57.220557] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-09-15T18:29:57.263043] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-09-15T18:29:57.582581] [INFO ] [REMOTE ] FNB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:29:58.057879] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-09-15T18:29:58.761141] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-15T18:29:58.857941] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-09-15T18:29:59.657894] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-09-15T18:29:59.789756] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-15T18:30:00.125968] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-15T18:30:00.162767] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-15T18:30:00.457887] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-09-15T18:30:01.257917] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-09-15T18:30:02.057980] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-09-15T18:30:02.100561] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T18:30:02.857981] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-09-15T18:30:03.521319] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-15T18:30:03.657965] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-09-15T18:30:04.457994] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-09-15T18:30:05.171844] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (3.11 seconds). [2025-09-15T18:30:05.207613] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-15T18:30:05.257882] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-09-15T18:30:05.998478] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-15T18:30:06.067282] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-09-15T18:30:06.070818] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (3.21 seconds). [2025-09-15T18:30:06.857934] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-09-15T18:30:07.141699] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-15T18:30:07.221334] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-15T18:30:07.657966] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-09-15T18:30:07.782366] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-15T18:30:08.457893] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-09-15T18:30:09.062390] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T18:30:09.257844] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-09-15T18:30:09.943215] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-15T18:30:10.057889] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-09-15T18:30:10.829689] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T18:30:10.834288] [INFO ] [REMOTE ] FMX: Full fetch complete (43544 records). [2025-09-15T18:30:10.834398] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-09-15T18:30:10.835238] [FATAL] [VALIDATOR ] FMX: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:30:10.835323] [FATAL] [MAIN ] FMX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:30:10.835366] [WARN ] [MAIN ] FMX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:30:10.835418] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-09-15T18:30:10.835484] [DEBUG] [LOCAL ] FMX: No primary data file found to delete. [2025-09-15T18:30:10.835523] [INFO ] [LOCAL ] FMX: Starting deletion of derivative data. [2025-09-15T18:30:10.836052] [DEBUG] [LOCAL ] FMX: Deleted derivative data file. [2025-09-15T18:30:10.836150] [INFO ] [MAIN ] Update Progress: 852/2369 symbols completed. FMX took 29.3s. Estimated remaining: 2h 40m 28s. Rate: 9.5 symbols/min [2025-09-15T18:30:10.867585] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-09-15T18:30:11.012500] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:30:11.049568] [DEBUG] [LOCAL ] FND: Loaded 39229 existing records from primary storage. [2025-09-15T18:30:11.049743] [INFO ] [MAIN ] FND: Loaded 39229 existing records. [2025-09-15T18:30:11.235251] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:30:11.235493] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-09-15T18:30:11.235542] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-09-15T18:30:11.236351] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-09-15T18:30:11.236404] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-09-15T18:30:11.419531] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-15T18:30:11.612728] [INFO ] [REMOTE ] FND: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:30:11.645863] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T18:30:11.657810] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-09-15T18:30:12.457936] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-09-15T18:30:12.909417] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-15T18:30:13.257977] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-09-15T18:30:13.437658] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-15T18:30:14.057930] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-09-15T18:30:14.857874] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-09-15T18:30:15.255223] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-15T18:30:15.657871] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-09-15T18:30:16.179935] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-15T18:30:16.457947] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-09-15T18:30:16.644147] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-15T18:30:16.828861] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-15T18:30:16.829670] [INFO ] [REMOTE ] FMY: Full fetch complete (1510 records). [2025-09-15T18:30:16.829742] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-09-15T18:30:17.213971] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-09-15T18:30:17.214108] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-09-15T18:30:17.214353] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-09-15T18:30:17.214453] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-09-15T18:30:17.215210] [DEBUG] [LOCAL ] FMY: Trimmed 1510 records to 1018 (keeping 150 days of data) [2025-09-15T18:30:17.223456] [DEBUG] [LOCAL ] FMY: Primary data saved (1018 records). [2025-09-15T18:30:17.223540] [INFO ] [MAIN ] FMY: Full history saved. [2025-09-15T18:30:17.223664] [INFO ] [MAIN ] Update Progress: 853/2369 symbols completed. FMY took 23.1s. Estimated remaining: 2h 40m 22s. Rate: 9.5 symbols/min [2025-09-15T18:30:17.262978] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-09-15T18:30:17.426679] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-15T18:30:17.457761] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:30:17.502909] [DEBUG] [LOCAL ] FNF: Loaded 36881 existing records from primary storage. [2025-09-15T18:30:17.503126] [INFO ] [MAIN ] FNF: Loaded 36881 existing records. [2025-09-15T18:30:17.691129] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:30:17.691516] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-09-15T18:30:17.691572] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-09-15T18:30:17.692479] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-09-15T18:30:17.692539] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-09-15T18:30:18.051679] [INFO ] [REMOTE ] FNF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:30:18.057834] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-09-15T18:30:18.857899] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-09-15T18:30:19.004365] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-15T18:30:19.010728] [INFO ] [REMOTE ] FNB: Full fetch complete (56924 records). [2025-09-15T18:30:19.010894] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-09-15T18:30:19.410061] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-09-15T18:30:19.410176] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-09-15T18:30:19.411200] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-09-15T18:30:19.411271] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-09-15T18:30:19.412814] [DEBUG] [LOCAL ] FNB: Trimmed 56924 records to 38602 (keeping 150 days of data) [2025-09-15T18:30:19.658139] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-09-15T18:30:19.665364] [DEBUG] [LOCAL ] FNB: Primary data saved (38602 records). [2025-09-15T18:30:19.665572] [INFO ] [MAIN ] FNB: Full history saved. [2025-09-15T18:30:19.666716] [INFO ] [MAIN ] Update Progress: 854/2369 symbols completed. FNB took 23.5s. Estimated remaining: 2h 40m 9s. Rate: 9.5 symbols/min [2025-09-15T18:30:19.843001] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:30:19.871447] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-15T18:30:19.916434] [DEBUG] [LOCAL ] FNV: Loaded 34341 existing records from primary storage. [2025-09-15T18:30:19.916702] [INFO ] [MAIN ] FNV: Loaded 34341 existing records. [2025-09-15T18:30:20.126561] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:30:20.126844] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-09-15T18:30:20.126895] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-09-15T18:30:20.127733] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-09-15T18:30:20.127794] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-09-15T18:30:20.462219] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-09-15T18:30:20.484702] [INFO ] [REMOTE ] FNV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:30:20.537760] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T18:30:21.209624] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-15T18:30:21.213790] [INFO ] [REMOTE ] FN: Full fetch complete (43173 records). [2025-09-15T18:30:21.213878] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-09-15T18:30:21.214529] [FATAL] [VALIDATOR ] FN: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:30:21.214613] [FATAL] [MAIN ] FN: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:30:21.214677] [WARN ] [MAIN ] FN: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:30:21.214727] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-09-15T18:30:21.214787] [DEBUG] [LOCAL ] FN: No primary data file found to delete. [2025-09-15T18:30:21.214834] [INFO ] [LOCAL ] FN: Starting deletion of derivative data. [2025-09-15T18:30:21.215144] [DEBUG] [LOCAL ] FN: Deleted derivative data file. [2025-09-15T18:30:21.215234] [INFO ] [MAIN ] Update Progress: 855/2369 symbols completed. FN took 25.3s. Estimated remaining: 2h 39m 54s. Rate: 9.5 symbols/min [2025-09-15T18:30:21.270015] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-09-15T18:30:21.389419] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:30:21.400039] [DEBUG] [LOCAL ] FOA: Loaded 9277 existing records from primary storage. [2025-09-15T18:30:21.400193] [INFO ] [MAIN ] FOA: Loaded 9277 existing records. [2025-09-15T18:30:21.580971] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:30:21.581239] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-09-15T18:30:21.581287] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-09-15T18:30:21.581619] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-09-15T18:30:21.581693] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-09-15T18:30:21.936996] [INFO ] [REMOTE ] FOA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:30:22.057895] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-09-15T18:30:22.183818] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-15T18:30:22.748240] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T18:30:22.857901] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-09-15T18:30:23.272254] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T18:30:23.657892] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-09-15T18:30:24.437116] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T18:30:24.457829] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-09-15T18:30:24.727313] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-15T18:30:25.257925] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-09-15T18:30:26.049782] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-15T18:30:26.057808] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-09-15T18:30:26.503198] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-15T18:30:26.857879] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-09-15T18:30:26.997591] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-15T18:30:27.657876] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-09-15T18:30:28.457871] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-09-15T18:30:28.546843] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-15T18:30:29.079192] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-15T18:30:29.099888] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-15T18:30:29.257857] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-09-15T18:30:30.057892] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-09-15T18:30:30.729128] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T18:30:30.857836] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-09-15T18:30:31.657864] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-09-15T18:30:31.871688] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-15T18:30:32.291238] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-15T18:30:32.434394] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-15T18:30:32.457874] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-09-15T18:30:33.257917] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-09-15T18:30:33.912623] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T18:30:34.057999] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-09-15T18:30:34.103578] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-15T18:30:34.858017] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-09-15T18:30:35.608415] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-15T18:30:35.643526] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-15T18:30:35.657815] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-09-15T18:30:36.457874] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-09-15T18:30:36.755669] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T18:30:37.257866] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-09-15T18:30:38.057851] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-09-15T18:30:38.098441] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-15T18:30:38.631882] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-15T18:30:38.637462] [INFO ] [REMOTE ] FNV: Full fetch complete (50341 records). [2025-09-15T18:30:38.637579] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-09-15T18:30:38.867177] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-09-15T18:30:39.054566] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-09-15T18:30:39.054763] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-09-15T18:30:39.055876] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-09-15T18:30:39.056045] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-09-15T18:30:39.057787] [DEBUG] [LOCAL ] FNV: Trimmed 50341 records to 33565 (keeping 150 days of data) [2025-09-15T18:30:39.287598] [DEBUG] [LOCAL ] FNV: Primary data saved (33565 records). [2025-09-15T18:30:39.287888] [INFO ] [MAIN ] FNV: Full history saved. [2025-09-15T18:30:39.288015] [INFO ] [MAIN ] Update Progress: 856/2369 symbols completed. FNV took 19.6s. Estimated remaining: 2h 40m 8s. Rate: 9.4 symbols/min [2025-09-15T18:30:39.463394] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:30:39.472625] [DEBUG] [LOCAL ] FOF: Loaded 5849 existing records from primary storage. [2025-09-15T18:30:39.472807] [INFO ] [MAIN ] FOF: Loaded 5849 existing records. [2025-09-15T18:30:39.660338] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-09-15T18:30:39.747175] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:30:39.748864] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-09-15T18:30:39.748949] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-09-15T18:30:39.749444] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-09-15T18:30:39.749512] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-09-15T18:30:40.060909] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-15T18:30:40.080692] [INFO ] [REMOTE ] FOA: Full fetch complete (14727 records). [2025-09-15T18:30:40.086017] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-09-15T18:30:40.307025] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-15T18:30:40.330892] [INFO ] [REMOTE ] FOF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:30:40.464784] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-09-15T18:30:40.604388] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-09-15T18:30:40.604471] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-09-15T18:30:40.604845] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-09-15T18:30:40.604893] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-09-15T18:30:40.605402] [DEBUG] [LOCAL ] FOA: Trimmed 14727 records to 9145 (keeping 150 days of data) [2025-09-15T18:30:40.659609] [DEBUG] [LOCAL ] FOA: Primary data saved (9145 records). [2025-09-15T18:30:40.659759] [INFO ] [MAIN ] FOA: Full history saved. [2025-09-15T18:30:40.659841] [INFO ] [MAIN ] Update Progress: 857/2369 symbols completed. FOA took 19.4s. Estimated remaining: 2h 39m 53s. Rate: 9.5 symbols/min [2025-09-15T18:30:40.828471] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:30:40.843439] [DEBUG] [LOCAL ] FOR: Loaded 14946 existing records from primary storage. [2025-09-15T18:30:40.843583] [INFO ] [MAIN ] FOR: Loaded 14946 existing records. [2025-09-15T18:30:41.027332] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:30:41.027632] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-09-15T18:30:41.027705] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-09-15T18:30:41.028113] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-09-15T18:30:41.028174] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-09-15T18:30:41.267587] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-09-15T18:30:41.403670] [INFO ] [REMOTE ] FOR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:30:41.593523] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-15T18:30:41.599354] [INFO ] [REMOTE ] FND: Full fetch complete (56667 records). [2025-09-15T18:30:41.599474] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-09-15T18:30:41.982886] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-09-15T18:30:41.982969] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-09-15T18:30:41.983721] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-09-15T18:30:41.983765] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-09-15T18:30:41.984972] [DEBUG] [LOCAL ] FND: Trimmed 56667 records to 38434 (keeping 150 days of data) [2025-09-15T18:30:42.074297] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-09-15T18:30:42.209737] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T18:30:42.247636] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-15T18:30:42.279084] [DEBUG] [LOCAL ] FND: Primary data saved (38434 records). [2025-09-15T18:30:42.279275] [INFO ] [MAIN ] FND: Full history saved. [2025-09-15T18:30:42.279377] [INFO ] [MAIN ] Update Progress: 858/2369 symbols completed. FND took 31.4s. Estimated remaining: 2h 39m 38s. Rate: 9.5 symbols/min [2025-09-15T18:30:42.469408] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:30:42.505488] [DEBUG] [LOCAL ] FOUR: Loaded 36977 existing records from primary storage. [2025-09-15T18:30:42.505697] [INFO ] [MAIN ] FOUR: Loaded 36977 existing records. [2025-09-15T18:30:42.694492] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:30:42.694816] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-09-15T18:30:42.694867] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-09-15T18:30:42.695900] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-09-15T18:30:42.695987] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-09-15T18:30:42.867924] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-09-15T18:30:43.070432] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:30:43.284735] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T18:30:43.657909] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-09-15T18:30:44.457891] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-09-15T18:30:44.694199] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-15T18:30:44.897457] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-15T18:30:45.262940] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-09-15T18:30:45.278601] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T18:30:46.057886] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-09-15T18:30:46.834450] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-15T18:30:46.851848] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-15T18:30:46.857807] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-09-15T18:30:47.603808] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-15T18:30:47.657895] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-09-15T18:30:48.457906] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-09-15T18:30:49.148522] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-15T18:30:49.257873] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-09-15T18:30:49.405607] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-15T18:30:49.412962] [INFO ] [REMOTE ] FNF: Full fetch complete (53492 records). [2025-09-15T18:30:49.413121] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-09-15T18:30:49.792869] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-09-15T18:30:49.792960] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-09-15T18:30:49.793716] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-09-15T18:30:49.793775] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-09-15T18:30:49.794908] [DEBUG] [LOCAL ] FNF: Trimmed 53492 records to 36151 (keeping 150 days of data) [2025-09-15T18:30:50.015618] [DEBUG] [LOCAL ] FNF: Primary data saved (36151 records). [2025-09-15T18:30:50.015782] [INFO ] [MAIN ] FNF: Full history saved. [2025-09-15T18:30:50.017222] [INFO ] [MAIN ] Update Progress: 859/2369 symbols completed. FNF took 32.8s. Estimated remaining: 2h 39m 34s. Rate: 9.5 symbols/min [2025-09-15T18:30:50.062954] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-09-15T18:30:50.190135] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:30:50.205842] [DEBUG] [LOCAL ] FPF: Loaded 13063 existing records from primary storage. [2025-09-15T18:30:50.205997] [INFO ] [MAIN ] FPF: Loaded 13063 existing records. [2025-09-15T18:30:50.388029] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:30:50.388308] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-09-15T18:30:50.388353] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-09-15T18:30:50.388750] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-09-15T18:30:50.388800] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-09-15T18:30:50.744908] [INFO ] [REMOTE ] FPF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:30:50.761333] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T18:30:50.857837] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-09-15T18:30:51.657873] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-09-15T18:30:51.720983] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T18:30:51.865076] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-15T18:30:52.457907] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-09-15T18:30:52.734121] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-15T18:30:53.257921] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-09-15T18:30:53.844407] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-15T18:30:54.057876] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-09-15T18:30:54.244717] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-15T18:30:54.693672] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-15T18:30:54.857881] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-09-15T18:30:55.657882] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-09-15T18:30:55.875851] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-15T18:30:56.457835] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-09-15T18:30:56.469340] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-15T18:30:57.257867] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-09-15T18:30:57.774672] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-15T18:30:58.057900] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-09-15T18:30:58.272397] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-15T18:30:58.654209] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-15T18:30:58.857882] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-09-15T18:30:59.579858] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-15T18:30:59.657855] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-09-15T18:31:00.457923] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-09-15T18:31:00.789315] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T18:31:01.257875] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-09-15T18:31:01.808387] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-15T18:31:02.057873] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-09-15T18:31:02.857862] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-09-15T18:31:02.928182] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-15T18:31:02.929961] [INFO ] [REMOTE ] FOF: Full fetch complete (8737 records). [2025-09-15T18:31:02.930034] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-09-15T18:31:03.267244] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (2.81 seconds). [2025-09-15T18:31:03.348249] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-09-15T18:31:03.348331] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-09-15T18:31:03.348684] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-09-15T18:31:03.348740] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-09-15T18:31:03.349245] [DEBUG] [LOCAL ] FOF: Trimmed 8737 records to 5732 (keeping 150 days of data) [2025-09-15T18:31:03.386886] [DEBUG] [LOCAL ] FOF: Primary data saved (5732 records). [2025-09-15T18:31:03.386998] [INFO ] [MAIN ] FOF: Full history saved. [2025-09-15T18:31:03.387118] [INFO ] [MAIN ] Update Progress: 860/2369 symbols completed. FOF took 24.1s. Estimated remaining: 2h 39m 40s. Rate: 9.5 symbols/min [2025-09-15T18:31:03.561334] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:31:03.578487] [DEBUG] [LOCAL ] FPH: Loaded 14659 existing records from primary storage. [2025-09-15T18:31:03.578616] [INFO ] [MAIN ] FPH: Loaded 14659 existing records. [2025-09-15T18:31:03.662957] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-09-15T18:31:03.762343] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:31:03.762624] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-09-15T18:31:03.762703] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-09-15T18:31:03.763144] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-09-15T18:31:03.763210] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-09-15T18:31:04.127032] [INFO ] [REMOTE ] FPH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:31:04.138834] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T18:31:04.349319] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-15T18:31:04.351729] [INFO ] [REMOTE ] FOR: Full fetch complete (22348 records). [2025-09-15T18:31:04.351803] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-09-15T18:31:04.462954] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-09-15T18:31:04.721860] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-09-15T18:31:04.721946] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-09-15T18:31:04.722488] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-09-15T18:31:04.722533] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-09-15T18:31:04.723394] [DEBUG] [LOCAL ] FOR: Trimmed 22348 records to 14480 (keeping 150 days of data) [2025-09-15T18:31:04.822829] [DEBUG] [LOCAL ] FOR: Primary data saved (14480 records). [2025-09-15T18:31:04.822992] [INFO ] [MAIN ] FOR: Full history saved. [2025-09-15T18:31:04.823100] [INFO ] [MAIN ] Update Progress: 861/2369 symbols completed. FOR took 24.2s. Estimated remaining: 2h 39m 26s. Rate: 9.5 symbols/min [2025-09-15T18:31:04.997975] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:31:05.028819] [DEBUG] [LOCAL ] FPI: Loaded 23691 existing records from primary storage. [2025-09-15T18:31:05.029047] [INFO ] [MAIN ] FPI: Loaded 23691 existing records. [2025-09-15T18:31:05.207952] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:31:05.208281] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-09-15T18:31:05.208348] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-09-15T18:31:05.208988] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-09-15T18:31:05.209042] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-09-15T18:31:05.263236] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-09-15T18:31:05.570359] [INFO ] [REMOTE ] FPI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:31:06.020081] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-15T18:31:06.057816] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-09-15T18:31:06.251254] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-15T18:31:06.857872] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-09-15T18:31:07.051344] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-15T18:31:07.657889] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-09-15T18:31:07.788626] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-15T18:31:08.457907] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-09-15T18:31:08.621560] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-15T18:31:08.624063] [INFO ] [REMOTE ] FPF: Full fetch complete (19020 records). [2025-09-15T18:31:08.624152] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-09-15T18:31:09.006409] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-09-15T18:31:09.006499] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-09-15T18:31:09.006954] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-09-15T18:31:09.007003] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-09-15T18:31:09.007730] [DEBUG] [LOCAL ] FPF: Trimmed 19020 records to 12774 (keeping 150 days of data) [2025-09-15T18:31:09.096065] [DEBUG] [LOCAL ] FPF: Primary data saved (12774 records). [2025-09-15T18:31:09.096221] [INFO ] [MAIN ] FPF: Full history saved. [2025-09-15T18:31:09.096319] [INFO ] [MAIN ] Update Progress: 862/2369 symbols completed. FPF took 19.1s. Estimated remaining: 2h 39m 16s. Rate: 9.5 symbols/min [2025-09-15T18:31:09.271694] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:31:09.268324] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-09-15T18:31:09.313291] [DEBUG] [LOCAL ] FR: Loaded 35051 existing records from primary storage. [2025-09-15T18:31:09.313435] [INFO ] [MAIN ] FR: Loaded 35051 existing records. [2025-09-15T18:31:09.512383] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:31:09.513141] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-09-15T18:31:09.529598] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-09-15T18:31:09.531250] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-15T18:31:09.531300] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-09-15T18:31:09.531503] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-09-15T18:31:09.905165] [INFO ] [REMOTE ] FR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:31:10.057883] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-09-15T18:31:10.857903] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-09-15T18:31:10.898207] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T18:31:11.063918] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-15T18:31:11.657878] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-09-15T18:31:11.853682] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-15T18:31:12.457892] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-09-15T18:31:12.631828] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-15T18:31:13.257917] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-09-15T18:31:14.057881] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-09-15T18:31:14.161700] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-15T18:31:14.228085] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-15T18:31:14.857871] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-09-15T18:31:15.657882] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-09-15T18:31:15.815216] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-15T18:31:15.820855] [INFO ] [REMOTE ] FOUR: Full fetch complete (54066 records). [2025-09-15T18:31:15.821002] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-09-15T18:31:16.128948] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-15T18:31:16.244793] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-09-15T18:31:16.244895] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-09-15T18:31:16.245689] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-09-15T18:31:16.245750] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-09-15T18:31:16.247152] [DEBUG] [LOCAL ] FOUR: Trimmed 54066 records to 36302 (keeping 150 days of data) [2025-09-15T18:31:16.458143] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-09-15T18:31:16.481556] [DEBUG] [LOCAL ] FOUR: Primary data saved (36302 records). [2025-09-15T18:31:16.481720] [INFO ] [MAIN ] FOUR: Full history saved. [2025-09-15T18:31:16.481841] [INFO ] [MAIN ] Update Progress: 863/2369 symbols completed. FOUR took 34.2s. Estimated remaining: 2h 39m 11s. Rate: 9.5 symbols/min [2025-09-15T18:31:16.658817] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:31:16.669861] [DEBUG] [LOCAL ] FRA: Loaded 10144 existing records from primary storage. [2025-09-15T18:31:16.669972] [INFO ] [MAIN ] FRA: Loaded 10144 existing records. [2025-09-15T18:31:16.853918] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:31:16.854201] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-09-15T18:31:16.854263] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-09-15T18:31:16.854828] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-09-15T18:31:16.854881] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-09-15T18:31:17.222309] [INFO ] [REMOTE ] FRA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:31:17.241817] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T18:31:17.257819] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-09-15T18:31:17.375832] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-15T18:31:18.057873] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-09-15T18:31:18.634377] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T18:31:18.857890] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-09-15T18:31:19.246719] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-15T18:31:19.657853] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-09-15T18:31:20.026336] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-15T18:31:20.457873] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-09-15T18:31:21.063293] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T18:31:21.257865] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-09-15T18:31:21.411915] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-15T18:31:21.414689] [INFO ] [REMOTE ] FPH: Full fetch complete (22142 records). [2025-09-15T18:31:21.414774] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-09-15T18:31:21.825246] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-09-15T18:31:21.825333] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-09-15T18:31:21.825855] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-09-15T18:31:21.825900] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-09-15T18:31:21.826547] [DEBUG] [LOCAL ] FPH: Trimmed 22142 records to 14437 (keeping 150 days of data) [2025-09-15T18:31:21.915203] [DEBUG] [LOCAL ] FPH: Primary data saved (14437 records). [2025-09-15T18:31:21.915358] [INFO ] [MAIN ] FPH: Full history saved. [2025-09-15T18:31:21.915446] [INFO ] [MAIN ] Update Progress: 864/2369 symbols completed. FPH took 18.5s. Estimated remaining: 2h 39m 3s. Rate: 9.5 symbols/min [2025-09-15T18:31:22.062988] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-09-15T18:31:22.087926] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:31:22.101235] [DEBUG] [LOCAL ] FRGE: Loaded 11995 existing records from primary storage. [2025-09-15T18:31:22.101428] [INFO ] [MAIN ] FRGE: Loaded 11995 existing records. [2025-09-15T18:31:22.286678] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:31:22.286936] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-09-15T18:31:22.287001] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-09-15T18:31:22.287420] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-09-15T18:31:22.287469] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-09-15T18:31:22.658663] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:31:22.679953] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T18:31:22.857901] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-09-15T18:31:22.973382] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-15T18:31:23.657928] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-09-15T18:31:24.141165] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T18:31:24.221754] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-15T18:31:24.457877] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-09-15T18:31:25.257936] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-09-15T18:31:25.534325] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-15T18:31:26.057973] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-09-15T18:31:26.212988] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-15T18:31:26.857879] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-09-15T18:31:27.657878] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-09-15T18:31:27.812101] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-15T18:31:27.939929] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-15T18:31:28.457860] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-09-15T18:31:28.893526] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-15T18:31:29.257864] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-09-15T18:31:29.441215] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-15T18:31:30.057832] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-09-15T18:31:30.076954] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-15T18:31:30.080070] [INFO ] [REMOTE ] FPI: Full fetch complete (33637 records). [2025-09-15T18:31:30.080145] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-09-15T18:31:30.080715] [FATAL] [VALIDATOR ] FPI: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:31:30.080793] [FATAL] [MAIN ] FPI: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:31:30.080829] [WARN ] [MAIN ] FPI: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:31:30.080865] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-09-15T18:31:30.080960] [DEBUG] [LOCAL ] FPI: No primary data file found to delete. [2025-09-15T18:31:30.081000] [INFO ] [LOCAL ] FPI: Starting deletion of derivative data. [2025-09-15T18:31:30.081324] [DEBUG] [LOCAL ] FPI: Deleted derivative data file. [2025-09-15T18:31:30.081403] [INFO ] [MAIN ] Update Progress: 865/2369 symbols completed. FPI took 25.3s. Estimated remaining: 2h 38m 60s. Rate: 9.5 symbols/min [2025-09-15T18:31:30.252635] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:31:30.295091] [DEBUG] [LOCAL ] FRO: Loaded 38882 existing records from primary storage. [2025-09-15T18:31:30.295233] [INFO ] [MAIN ] FRO: Loaded 38882 existing records. [2025-09-15T18:31:30.471568] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:31:30.471817] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-09-15T18:31:30.471863] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-09-15T18:31:30.472871] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-09-15T18:31:30.472927] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-09-15T18:31:30.827830] [INFO ] [REMOTE ] FRO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:31:30.857842] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-09-15T18:31:30.879964] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-15T18:31:31.657868] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-09-15T18:31:32.013680] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-15T18:31:32.457924] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-09-15T18:31:32.579929] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-15T18:31:33.257860] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-09-15T18:31:33.462459] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-15T18:31:34.057897] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-09-15T18:31:34.488093] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T18:31:34.857887] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-09-15T18:31:35.657845] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-09-15T18:31:35.800038] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-15T18:31:36.457855] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-09-15T18:31:36.501244] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-15T18:31:36.549938] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-15T18:31:37.257889] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-09-15T18:31:37.912526] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-15T18:31:38.057874] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-09-15T18:31:38.764225] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-15T18:31:38.857876] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-09-15T18:31:39.657879] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-09-15T18:31:39.703511] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T18:31:39.839183] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T18:31:39.844235] [INFO ] [REMOTE ] FR: Full fetch complete (50718 records). [2025-09-15T18:31:39.844346] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-09-15T18:31:40.252284] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-09-15T18:31:40.252372] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-09-15T18:31:40.253158] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-09-15T18:31:40.253213] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-09-15T18:31:40.254575] [DEBUG] [LOCAL ] FR: Trimmed 50718 records to 34195 (keeping 150 days of data) [2025-09-15T18:31:40.457971] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-09-15T18:31:40.487407] [DEBUG] [LOCAL ] FR: Primary data saved (34195 records). [2025-09-15T18:31:40.487805] [INFO ] [MAIN ] FR: Full history saved. [2025-09-15T18:31:40.489151] [INFO ] [MAIN ] Update Progress: 866/2369 symbols completed. FR took 31.4s. Estimated remaining: 2h 39m 1s. Rate: 9.5 symbols/min [2025-09-15T18:31:40.665353] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:31:40.675312] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-15T18:31:40.715452] [DEBUG] [LOCAL ] FRT: Loaded 31420 existing records from primary storage. [2025-09-15T18:31:40.715603] [INFO ] [MAIN ] FRT: Loaded 31420 existing records. [2025-09-15T18:31:40.900739] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:31:40.901129] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-09-15T18:31:40.901188] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-09-15T18:31:40.902320] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-09-15T18:31:40.902419] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-09-15T18:31:41.258290] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-09-15T18:31:41.278467] [INFO ] [REMOTE ] FRT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:31:42.057870] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-09-15T18:31:42.149321] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-15T18:31:42.183358] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-15T18:31:42.857884] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-09-15T18:31:43.495246] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-15T18:31:43.657877] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-09-15T18:31:44.457898] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-09-15T18:31:44.679726] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-15T18:31:44.869782] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-15T18:31:45.257890] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-09-15T18:31:45.384997] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-15T18:31:45.882074] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T18:31:45.883774] [INFO ] [REMOTE ] FRGE: Full fetch complete (22019 records). [2025-09-15T18:31:45.883851] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-09-15T18:31:45.884813] [FATAL] [VALIDATOR ] FRGE: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:31:45.885045] [FATAL] [MAIN ] FRGE: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:31:45.885099] [WARN ] [MAIN ] FRGE: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:31:45.885148] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-09-15T18:31:45.885220] [DEBUG] [LOCAL ] FRGE: No primary data file found to delete. [2025-09-15T18:31:45.885260] [INFO ] [LOCAL ] FRGE: Starting deletion of derivative data. [2025-09-15T18:31:45.885613] [DEBUG] [LOCAL ] FRGE: Deleted derivative data file. [2025-09-15T18:31:45.885743] [INFO ] [MAIN ] Update Progress: 867/2369 symbols completed. FRGE took 24.0s. Estimated remaining: 2h 38m 53s. Rate: 9.5 symbols/min [2025-09-15T18:31:46.058947] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-09-15T18:31:46.079066] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:31:46.106035] [DEBUG] [LOCAL ] FSCO: Loaded 27469 existing records from primary storage. [2025-09-15T18:31:46.106181] [INFO ] [MAIN ] FSCO: Loaded 27469 existing records. [2025-09-15T18:31:46.284358] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:31:46.284631] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-09-15T18:31:46.284698] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-09-15T18:31:46.285336] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-09-15T18:31:46.285385] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-09-15T18:31:46.636325] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:31:46.857907] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-09-15T18:31:46.923604] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-15T18:31:46.926092] [INFO ] [REMOTE ] FRA: Full fetch complete (16411 records). [2025-09-15T18:31:46.926231] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-09-15T18:31:47.304292] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-09-15T18:31:47.304422] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-09-15T18:31:47.304807] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-09-15T18:31:47.304850] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-09-15T18:31:47.305363] [DEBUG] [LOCAL ] FRA: Trimmed 16411 records to 9987 (keeping 150 days of data) [2025-09-15T18:31:47.368024] [DEBUG] [LOCAL ] FRA: Primary data saved (9987 records). [2025-09-15T18:31:47.368183] [INFO ] [MAIN ] FRA: Full history saved. [2025-09-15T18:31:47.368276] [INFO ] [MAIN ] Update Progress: 868/2369 symbols completed. FRA took 30.9s. Estimated remaining: 2h 38m 38s. Rate: 9.5 symbols/min [2025-09-15T18:31:47.538743] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:31:47.575289] [DEBUG] [LOCAL ] FSK: Loaded 36388 existing records from primary storage. [2025-09-15T18:31:47.575435] [INFO ] [MAIN ] FSK: Loaded 36388 existing records. [2025-09-15T18:31:47.664922] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-09-15T18:31:47.754703] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:31:47.754957] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-09-15T18:31:47.755002] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-09-15T18:31:47.755980] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-09-15T18:31:47.756032] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-09-15T18:31:48.102520] [INFO ] [REMOTE ] FSK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:31:48.184692] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-15T18:31:48.457880] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-09-15T18:31:49.257843] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-09-15T18:31:49.425738] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-15T18:31:49.493693] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-15T18:31:50.057889] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-09-15T18:31:50.857876] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-09-15T18:31:50.988185] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-15T18:31:51.664815] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-09-15T18:31:51.669687] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-15T18:31:52.277134] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-15T18:31:52.457874] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-09-15T18:31:52.560218] [DEBUG] [REMOTE ] FSCO: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-15T18:31:52.560584] [WARN ] [REMOTE ] FSCO: No data returned for month 2025-05 [2025-09-15T18:31:53.257868] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-09-15T18:31:53.307746] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T18:31:54.057872] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-09-15T18:31:54.857890] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-09-15T18:31:55.061505] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-15T18:31:55.350741] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-15T18:31:55.657880] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-09-15T18:31:56.424966] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T18:31:56.431072] [INFO ] [REMOTE ] FRO: Full fetch complete (56509 records). [2025-09-15T18:31:56.431224] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-09-15T18:31:56.464761] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-09-15T18:31:56.842012] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-09-15T18:31:56.842137] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-09-15T18:31:56.843121] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-09-15T18:31:56.843190] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-09-15T18:31:56.844662] [DEBUG] [LOCAL ] FRO: Trimmed 56509 records to 38124 (keeping 150 days of data) [2025-09-15T18:31:57.105425] [DEBUG] [LOCAL ] FRO: Primary data saved (38124 records). [2025-09-15T18:31:57.105689] [INFO ] [MAIN ] FRO: Full history saved. [2025-09-15T18:31:57.107780] [INFO ] [MAIN ] Update Progress: 869/2369 symbols completed. FRO took 27.0s. Estimated remaining: 2h 38m 37s. Rate: 9.5 symbols/min [2025-09-15T18:31:57.259355] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-09-15T18:31:57.304722] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:31:57.334670] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-15T18:31:57.379892] [DEBUG] [LOCAL ] FSLY: Loaded 38359 existing records from primary storage. [2025-09-15T18:31:57.380057] [INFO ] [MAIN ] FSLY: Loaded 38359 existing records. [2025-09-15T18:31:57.558007] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:31:57.558250] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-09-15T18:31:57.558310] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-09-15T18:31:57.559040] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-09-15T18:31:57.559092] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-09-15T18:31:57.920686] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:31:58.044257] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-15T18:31:58.057826] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-09-15T18:31:58.783660] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-15T18:31:58.857908] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-09-15T18:31:59.456400] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T18:31:59.657894] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-09-15T18:32:00.457965] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-09-15T18:32:01.258000] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-09-15T18:32:01.365773] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-09-15T18:32:01.824974] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-15T18:32:01.829396] [INFO ] [REMOTE ] FSCO: Full fetch complete (34270 records). [2025-09-15T18:32:01.829509] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-09-15T18:32:02.026170] [WARN ] [VALIDATOR ] FSCO: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-15T18:32:02.027036] [FATAL] [MAIN ] FSCO: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:32:02.027092] [WARN ] [MAIN ] FSCO: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:32:02.027134] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-09-15T18:32:02.027304] [DEBUG] [LOCAL ] FSCO: No primary data file found to delete. [2025-09-15T18:32:02.027346] [INFO ] [LOCAL ] FSCO: Starting deletion of derivative data. [2025-09-15T18:32:02.027884] [DEBUG] [LOCAL ] FSCO: Deleted derivative data file. [2025-09-15T18:32:02.027994] [INFO ] [MAIN ] Update Progress: 870/2369 symbols completed. FSCO took 16.1s. Estimated remaining: 2h 38m 29s. Rate: 9.5 symbols/min [2025-09-15T18:32:02.060634] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-09-15T18:32:02.221138] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:32:02.267098] [DEBUG] [LOCAL ] FSM: Loaded 40060 existing records from primary storage. [2025-09-15T18:32:02.267255] [INFO ] [MAIN ] FSM: Loaded 40060 existing records. [2025-09-15T18:32:02.467820] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:32:02.468120] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-09-15T18:32:02.468171] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-09-15T18:32:02.469081] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-09-15T18:32:02.469141] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-09-15T18:32:02.849305] [INFO ] [REMOTE ] FSM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:32:02.861832] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-09-15T18:32:02.885864] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-09-15T18:32:02.933874] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-15T18:32:03.535125] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T18:32:03.657888] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-09-15T18:32:04.457871] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-09-15T18:32:04.634903] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-15T18:32:05.258876] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-09-15T18:32:05.258739] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-15T18:32:05.910195] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T18:32:06.057884] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-09-15T18:32:06.723469] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T18:32:06.857818] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-09-15T18:32:07.512114] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-15T18:32:07.657821] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-09-15T18:32:08.457887] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-09-15T18:32:08.613315] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-15T18:32:09.257916] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-09-15T18:32:09.538818] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-15T18:32:09.908822] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-15T18:32:10.057861] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-09-15T18:32:10.668148] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-15T18:32:10.857857] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-09-15T18:32:11.657876] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-09-15T18:32:11.788876] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-15T18:32:12.457922] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-09-15T18:32:12.539963] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-15T18:32:12.544444] [INFO ] [REMOTE ] FRT: Full fetch complete (45666 records). [2025-09-15T18:32:12.544534] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-09-15T18:32:12.545327] [FATAL] [VALIDATOR ] FRT: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:32:12.545414] [FATAL] [MAIN ] FRT: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:32:12.545451] [WARN ] [MAIN ] FRT: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:32:12.545489] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-09-15T18:32:12.545563] [DEBUG] [LOCAL ] FRT: No primary data file found to delete. [2025-09-15T18:32:12.545609] [INFO ] [LOCAL ] FRT: Starting deletion of derivative data. [2025-09-15T18:32:12.545920] [DEBUG] [LOCAL ] FRT: Deleted derivative data file. [2025-09-15T18:32:12.546037] [INFO ] [MAIN ] Update Progress: 871/2369 symbols completed. FRT took 32.1s. Estimated remaining: 2h 38m 29s. Rate: 9.5 symbols/min [2025-09-15T18:32:12.718657] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:32:12.746223] [DEBUG] [LOCAL ] FSS: Loaded 25400 existing records from primary storage. [2025-09-15T18:32:12.746367] [INFO ] [MAIN ] FSS: Loaded 25400 existing records. [2025-09-15T18:32:12.925089] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:32:12.925444] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-09-15T18:32:12.925505] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-09-15T18:32:12.926237] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-09-15T18:32:12.926292] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-09-15T18:32:13.268014] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-09-15T18:32:13.303771] [INFO ] [REMOTE ] FSS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:32:13.671512] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-15T18:32:14.057885] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-09-15T18:32:14.188203] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-15T18:32:14.857837] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-09-15T18:32:14.968816] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-15T18:32:15.657861] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-09-15T18:32:16.457938] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-09-15T18:32:16.509747] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-09-15T18:32:16.763751] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-15T18:32:17.257740] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T18:32:17.257888] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-09-15T18:32:17.264423] [INFO ] [REMOTE ] FSK: Full fetch complete (53600 records). [2025-09-15T18:32:17.264525] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-09-15T18:32:17.671356] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-09-15T18:32:17.671532] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-09-15T18:32:17.672299] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-09-15T18:32:17.672411] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-09-15T18:32:17.673865] [DEBUG] [LOCAL ] FSK: Trimmed 53600 records to 35641 (keeping 150 days of data) [2025-09-15T18:32:17.692244] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-15T18:32:17.919105] [DEBUG] [LOCAL ] FSK: Primary data saved (35641 records). [2025-09-15T18:32:17.919264] [INFO ] [MAIN ] FSK: Full history saved. [2025-09-15T18:32:17.919373] [INFO ] [MAIN ] Update Progress: 872/2369 symbols completed. FSK took 30.6s. Estimated remaining: 2h 38m 21s. Rate: 9.5 symbols/min [2025-09-15T18:32:18.062995] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-09-15T18:32:18.094439] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:32:18.101042] [DEBUG] [LOCAL ] FT: Loaded 4756 existing records from primary storage. [2025-09-15T18:32:18.101198] [INFO ] [MAIN ] FT: Loaded 4756 existing records. [2025-09-15T18:32:18.279545] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:32:18.279809] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-09-15T18:32:18.279855] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-09-15T18:32:18.280161] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-09-15T18:32:18.280208] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-09-15T18:32:18.632306] [INFO ] [REMOTE ] FT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:32:18.786980] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-15T18:32:18.857844] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-09-15T18:32:19.546520] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T18:32:19.555983] [INFO ] [REMOTE ] FSLY: Full fetch complete (55901 records). [2025-09-15T18:32:19.556206] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-09-15T18:32:19.666758] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-09-15T18:32:20.157195] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-09-15T18:32:20.157319] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-09-15T18:32:20.158599] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-09-15T18:32:20.158703] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-09-15T18:32:20.160480] [DEBUG] [LOCAL ] FSLY: Trimmed 55901 records to 37625 (keeping 150 days of data) [2025-09-15T18:32:20.475636] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-09-15T18:32:20.479954] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-15T18:32:20.529098] [DEBUG] [LOCAL ] FSLY: Primary data saved (37625 records). [2025-09-15T18:32:20.529268] [INFO ] [MAIN ] FSLY: Full history saved. [2025-09-15T18:32:20.530409] [INFO ] [MAIN ] Update Progress: 873/2369 symbols completed. FSLY took 23.4s. Estimated remaining: 2h 38m 9s. Rate: 9.5 symbols/min [2025-09-15T18:32:20.743104] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:32:20.755262] [DEBUG] [LOCAL ] FTHY: Loaded 8675 existing records from primary storage. [2025-09-15T18:32:20.755396] [INFO ] [MAIN ] FTHY: Loaded 8675 existing records. [2025-09-15T18:32:20.938752] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:32:20.939076] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-09-15T18:32:20.939132] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-09-15T18:32:20.939498] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-09-15T18:32:20.939548] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-09-15T18:32:21.262928] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-09-15T18:32:21.269531] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-15T18:32:21.362292] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:32:21.394519] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-15T18:32:22.057867] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-09-15T18:32:22.652230] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-15T18:32:22.688134] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T18:32:22.694192] [INFO ] [REMOTE ] FSM: Full fetch complete (57907 records). [2025-09-15T18:32:22.694352] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-09-15T18:32:22.864845] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-09-15T18:32:23.099764] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-09-15T18:32:23.099857] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-09-15T18:32:23.100605] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-09-15T18:32:23.100669] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-09-15T18:32:23.101948] [DEBUG] [LOCAL ] FSM: Trimmed 57907 records to 39280 (keeping 150 days of data) [2025-09-15T18:32:23.351317] [DEBUG] [LOCAL ] FSM: Primary data saved (39280 records). [2025-09-15T18:32:23.351507] [INFO ] [MAIN ] FSM: Full history saved. [2025-09-15T18:32:23.352358] [INFO ] [MAIN ] Update Progress: 874/2369 symbols completed. FSM took 21.3s. Estimated remaining: 2h 37m 56s. Rate: 9.5 symbols/min [2025-09-15T18:32:23.535323] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:32:23.577093] [DEBUG] [LOCAL ] FTI: Loaded 40086 existing records from primary storage. [2025-09-15T18:32:23.577271] [INFO ] [MAIN ] FTI: Loaded 40086 existing records. [2025-09-15T18:32:23.663039] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-09-15T18:32:23.790769] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:32:23.791041] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-09-15T18:32:23.791091] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-09-15T18:32:23.791971] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-09-15T18:32:23.792025] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-09-15T18:32:23.983824] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-15T18:32:24.201780] [INFO ] [REMOTE ] FTI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:32:24.226404] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-15T18:32:24.457889] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-09-15T18:32:25.257852] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-09-15T18:32:25.816545] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-15T18:32:26.062559] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-09-15T18:32:26.067688] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-15T18:32:26.857867] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-09-15T18:32:27.584633] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-15T18:32:27.657852] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-09-15T18:32:27.809915] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-15T18:32:28.247382] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-15T18:32:28.457864] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-09-15T18:32:29.056767] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-15T18:32:29.257853] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-09-15T18:32:29.958165] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-15T18:32:30.057875] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-09-15T18:32:30.648243] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-15T18:32:30.857860] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-09-15T18:32:31.657886] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-09-15T18:32:31.713300] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-15T18:32:32.457895] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-09-15T18:32:33.257900] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-09-15T18:32:33.299334] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-15T18:32:33.471449] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-15T18:32:34.057909] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-09-15T18:32:34.811356] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T18:32:34.857829] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-09-15T18:32:35.657878] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-09-15T18:32:35.929572] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-15T18:32:36.181635] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T18:32:36.228750] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-15T18:32:36.457890] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-09-15T18:32:37.136740] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-15T18:32:37.139152] [INFO ] [REMOTE ] FTHY: Full fetch complete (12664 records). [2025-09-15T18:32:37.139311] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-09-15T18:32:37.262539] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-09-15T18:32:37.562339] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-09-15T18:32:37.562435] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-09-15T18:32:37.562774] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-09-15T18:32:37.562827] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-09-15T18:32:37.563471] [DEBUG] [LOCAL ] FTHY: Trimmed 12664 records to 8497 (keeping 150 days of data) [2025-09-15T18:32:37.621562] [DEBUG] [LOCAL ] FTHY: Primary data saved (8497 records). [2025-09-15T18:32:37.621757] [INFO ] [MAIN ] FTHY: Full history saved. [2025-09-15T18:32:37.621863] [INFO ] [MAIN ] Update Progress: 875/2369 symbols completed. FTHY took 17.1s. Estimated remaining: 2h 38m 4s. Rate: 9.5 symbols/min [2025-09-15T18:32:37.795472] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:32:37.821341] [DEBUG] [LOCAL ] FTK: Loaded 25122 existing records from primary storage. [2025-09-15T18:32:37.821490] [INFO ] [MAIN ] FTK: Loaded 25122 existing records. [2025-09-15T18:32:38.007195] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:32:38.007480] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-09-15T18:32:38.007541] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-09-15T18:32:38.008243] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-09-15T18:32:38.008316] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-09-15T18:32:38.069289] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-09-15T18:32:38.374434] [INFO ] [REMOTE ] FTK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:32:38.516096] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-15T18:32:38.857883] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-09-15T18:32:39.584400] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T18:32:39.657901] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-09-15T18:32:40.096285] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T18:32:40.457885] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-09-15T18:32:40.996813] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-15T18:32:41.258979] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-09-15T18:32:41.260697] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-15T18:32:42.054122] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-15T18:32:42.060210] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-09-15T18:32:42.737204] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-15T18:32:42.738575] [INFO ] [REMOTE ] FT: Full fetch complete (6682 records). [2025-09-15T18:32:42.738666] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-09-15T18:32:42.862992] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-09-15T18:32:43.103507] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-09-15T18:32:43.103600] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-09-15T18:32:43.103818] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-09-15T18:32:43.103862] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-09-15T18:32:43.104348] [DEBUG] [LOCAL ] FT: Trimmed 6682 records to 4670 (keeping 150 days of data) [2025-09-15T18:32:43.133953] [DEBUG] [LOCAL ] FT: Primary data saved (4670 records). [2025-09-15T18:32:43.134086] [INFO ] [MAIN ] FT: Full history saved. [2025-09-15T18:32:43.134196] [INFO ] [MAIN ] Update Progress: 876/2369 symbols completed. FT took 25.2s. Estimated remaining: 2h 37m 56s. Rate: 9.5 symbols/min [2025-09-15T18:32:43.303343] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:32:43.337556] [DEBUG] [LOCAL ] FTS: Loaded 31771 existing records from primary storage. [2025-09-15T18:32:43.337730] [INFO ] [MAIN ] FTS: Loaded 31771 existing records. [2025-09-15T18:32:43.512754] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:32:43.513029] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-09-15T18:32:43.513096] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-09-15T18:32:43.514727] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-09-15T18:32:43.514818] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-09-15T18:32:43.662990] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-09-15T18:32:43.876992] [INFO ] [REMOTE ] FTS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:32:44.058399] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-15T18:32:44.061895] [INFO ] [REMOTE ] FSS: Full fetch complete (38161 records). [2025-09-15T18:32:44.061984] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-09-15T18:32:44.440373] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-09-15T18:32:44.440484] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-09-15T18:32:44.441166] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-09-15T18:32:44.441214] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-09-15T18:32:44.442247] [DEBUG] [LOCAL ] FSS: Trimmed 38161 records to 24725 (keeping 150 days of data) [2025-09-15T18:32:44.504187] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-09-15T18:32:44.615226] [DEBUG] [LOCAL ] FSS: Primary data saved (24725 records). [2025-09-15T18:32:44.615387] [INFO ] [MAIN ] FSS: Full history saved. [2025-09-15T18:32:44.615499] [INFO ] [MAIN ] Update Progress: 877/2369 symbols completed. FSS took 32.1s. Estimated remaining: 2h 37m 41s. Rate: 9.5 symbols/min [2025-09-15T18:32:45.257910] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-09-15T18:32:45.535294] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-15T18:32:46.003463] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-15T18:32:46.057852] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-09-15T18:32:46.498757] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-15T18:32:46.857893] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-09-15T18:32:47.219975] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-15T18:32:47.657877] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-09-15T18:32:47.982530] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-15T18:32:48.457936] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-09-15T18:32:49.095800] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-15T18:32:49.257821] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-09-15T18:32:50.057969] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-09-15T18:32:50.229572] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-15T18:32:50.369272] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T18:32:50.857907] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-09-15T18:32:51.207223] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-15T18:32:51.657868] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-09-15T18:32:52.263975] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T18:32:52.457913] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-09-15T18:32:52.702680] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-15T18:32:53.257886] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-09-15T18:32:53.358301] [DEBUG] [REMOTE ] FTI: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-15T18:32:53.358602] [WARN ] [REMOTE ] FTI: No data returned for month 2025-09 [2025-09-15T18:32:53.358724] [INFO ] [REMOTE ] FTI: Full fetch complete (54060 records). [2025-09-15T18:32:53.358793] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-09-15T18:32:53.360468] [FATAL] [VALIDATOR ] FTI: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:32:53.360555] [FATAL] [MAIN ] FTI: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:32:53.360627] [WARN ] [MAIN ] FTI: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:32:53.360703] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-09-15T18:32:53.360772] [DEBUG] [LOCAL ] FTI: No primary data file found to delete. [2025-09-15T18:32:53.360811] [INFO ] [LOCAL ] FTI: Starting deletion of derivative data. [2025-09-15T18:32:53.361105] [DEBUG] [LOCAL ] FTI: Deleted derivative data file. [2025-09-15T18:32:53.361487] [INFO ] [MAIN ] Update Progress: 878/2369 symbols completed. FTI took 30.0s. Estimated remaining: 2h 37m 39s. Rate: 9.5 symbols/min [2025-09-15T18:32:54.069258] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-09-15T18:32:54.074816] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-15T18:32:54.857956] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-09-15T18:32:55.176624] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-15T18:32:55.657928] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-09-15T18:32:56.402995] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T18:32:56.457841] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-09-15T18:32:56.965949] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-15T18:32:57.257939] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-09-15T18:32:57.902672] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-15T18:32:57.908867] [INFO ] [REMOTE ] FTS: Full fetch complete (45925 records). [2025-09-15T18:32:57.909034] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-09-15T18:32:58.284982] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-09-15T18:32:58.285096] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-09-15T18:32:58.285781] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-09-15T18:32:58.285826] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-09-15T18:32:58.286832] [DEBUG] [LOCAL ] FTS: Trimmed 45925 records to 31167 (keeping 150 days of data) [2025-09-15T18:32:58.412181] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T18:32:58.436058] [INFO ] [REMOTE ] FTK: Full fetch complete (33328 records). [2025-09-15T18:32:58.436330] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-09-15T18:32:58.466400] [FATAL] [VALIDATOR ] FTK: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:32:58.488468] [FATAL] [MAIN ] FTK: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:32:58.493183] [WARN ] [MAIN ] FTK: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:32:58.493995] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-09-15T18:32:58.494350] [DEBUG] [LOCAL ] FTK: No primary data file found to delete. [2025-09-15T18:32:58.494735] [INFO ] [LOCAL ] FTK: Starting deletion of derivative data. [2025-09-15T18:32:58.495576] [DEBUG] [LOCAL ] FTK: Deleted derivative data file. [2025-09-15T18:32:58.496242] [INFO ] [MAIN ] Update Progress: 879/2369 symbols completed. FTK took 20.9s. Estimated remaining: 2h 37m 31s. Rate: 9.5 symbols/min [2025-09-15T18:32:58.510305] [DEBUG] [LOCAL ] FTS: Primary data saved (31167 records). [2025-09-15T18:32:58.510390] [INFO ] [MAIN ] FTS: Full history saved. [2025-09-15T18:32:58.510478] [INFO ] [MAIN ] Update Progress: 880/2369 symbols completed. FTS took 15.4s. Estimated remaining: 2h 37m 13s. Rate: 9.5 symbols/min [2025-09-15T18:32:59.189850] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:32:59.207403] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:32:59.228544] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:32:59.209697] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:32:59.237040] [DEBUG] [LOCAL ] FTWO: Loaded 1288 existing records from primary storage. [2025-09-15T18:32:59.237305] [INFO ] [MAIN ] FTWO: Loaded 1288 existing records. [2025-09-15T18:32:59.472179] [DEBUG] [LOCAL ] FUL: Loaded 23457 existing records from primary storage. [2025-09-15T18:32:59.476783] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:32:59.478015] [INFO ] [MAIN ] FUL: Loaded 23457 existing records. [2025-09-15T18:32:59.496867] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-09-15T18:32:59.496990] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-09-15T18:32:59.497244] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-09-15T18:32:59.527681] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-09-15T18:32:59.544513] [DEBUG] [LOCAL ] FUBO: Loaded 40467 existing records from primary storage. [2025-09-15T18:32:59.611034] [INFO ] [MAIN ] FUBO: Loaded 40467 existing records. [2025-09-15T18:32:59.645001] [DEBUG] [LOCAL ] FTV: Loaded 39924 existing records from primary storage. [2025-09-15T18:32:59.789731] [INFO ] [MAIN ] FTV: Loaded 39924 existing records. [2025-09-15T18:33:00.172772] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:33:00.277064] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:33:00.250756] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-09-15T18:33:00.291878] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-09-15T18:33:00.297515] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-09-15T18:33:00.324535] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-09-15T18:33:00.324666] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-09-15T18:33:00.372159] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-09-15T18:33:00.382572] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-09-15T18:33:00.382436] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-09-15T18:33:00.459344] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:33:00.505974] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-09-15T18:33:00.595274] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:33:00.569353] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-09-15T18:33:00.650843] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-09-15T18:33:00.676777] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-09-15T18:33:00.703274] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-09-15T18:33:01.347954] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-15T18:33:01.489423] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-09-15T18:33:01.526817] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:33:01.579687] [INFO ] [REMOTE ] FUL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:33:01.581227] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-09-15T18:33:01.581601] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-09-15T18:33:01.663124] [INFO ] [REMOTE ] FTV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:33:01.663473] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-09-15T18:33:03.931905] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-15T18:33:03.933156] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-09-15T18:33:04.129005] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-09-15T18:33:04.135756] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-09-15T18:33:04.604707] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (2.94 seconds). [2025-09-15T18:33:04.614597] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-09-15T18:33:05.084377] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-15T18:33:05.085574] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-09-15T18:33:05.121899] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (3.54 seconds). [2025-09-15T18:33:05.257920] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-09-15T18:33:05.436577] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-15T18:33:05.802780] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-15T18:33:06.057882] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-09-15T18:33:06.244034] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-15T18:33:06.504279] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-15T18:33:06.857833] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-09-15T18:33:07.354267] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-15T18:33:07.657878] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-09-15T18:33:08.275407] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-15T18:33:08.457865] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-09-15T18:33:09.049466] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-15T18:33:09.257869] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-09-15T18:33:09.579072] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-15T18:33:10.057893] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-09-15T18:33:10.255767] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-15T18:33:10.420226] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-15T18:33:10.857870] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-09-15T18:33:11.367659] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-15T18:33:11.368502] [INFO ] [REMOTE ] FTWO: Full fetch complete (2020 records). [2025-09-15T18:33:11.368573] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-09-15T18:33:11.662929] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-09-15T18:33:11.727990] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-09-15T18:33:11.728068] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-09-15T18:33:11.728165] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-09-15T18:33:11.728217] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-09-15T18:33:11.728570] [DEBUG] [LOCAL ] FTWO: Trimmed 2020 records to 1273 (keeping 150 days of data) [2025-09-15T18:33:11.737617] [DEBUG] [LOCAL ] FTWO: Primary data saved (1273 records). [2025-09-15T18:33:11.737725] [INFO ] [MAIN ] FTWO: Full history saved. [2025-09-15T18:33:11.737820] [INFO ] [MAIN ] Update Progress: 881/2369 symbols completed. FTWO took 13.2s. Estimated remaining: 2h 37m 19s. Rate: 9.5 symbols/min [2025-09-15T18:33:11.908998] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:33:11.954820] [DEBUG] [LOCAL ] FUN: Loaded 39041 existing records from primary storage. [2025-09-15T18:33:11.955021] [INFO ] [MAIN ] FUN: Loaded 39041 existing records. [2025-09-15T18:33:12.134309] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:33:12.134561] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-09-15T18:33:12.134609] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-09-15T18:33:12.135425] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-09-15T18:33:12.135491] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-09-15T18:33:12.463570] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-09-15T18:33:12.491492] [INFO ] [REMOTE ] FUN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:33:13.257956] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-09-15T18:33:14.048726] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-15T18:33:14.060005] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-09-15T18:33:14.516511] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-15T18:33:14.857926] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-09-15T18:33:14.970919] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-15T18:33:15.657917] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-09-15T18:33:16.457941] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-09-15T18:33:16.619394] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-09-15T18:33:17.096376] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-15T18:33:17.257869] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-09-15T18:33:17.791163] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-15T18:33:18.057882] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-09-15T18:33:18.149416] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-15T18:33:18.740893] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-15T18:33:18.857882] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-09-15T18:33:19.453023] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T18:33:19.657887] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-09-15T18:33:20.457945] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-09-15T18:33:20.688100] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-15T18:33:21.234805] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-15T18:33:21.241891] [INFO ] [REMOTE ] FTV: Full fetch complete (57505 records). [2025-09-15T18:33:21.242156] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-09-15T18:33:21.267366] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-09-15T18:33:21.642025] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-09-15T18:33:21.642109] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-09-15T18:33:21.642905] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-09-15T18:33:21.642951] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-09-15T18:33:21.644104] [DEBUG] [LOCAL ] FTV: Trimmed 57505 records to 39181 (keeping 150 days of data) [2025-09-15T18:33:21.895970] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-15T18:33:21.937149] [DEBUG] [LOCAL ] FTV: Primary data saved (39181 records). [2025-09-15T18:33:21.937312] [INFO ] [MAIN ] FTV: Full history saved. [2025-09-15T18:33:21.937405] [INFO ] [MAIN ] Update Progress: 882/2369 symbols completed. FTV took 23.4s. Estimated remaining: 2h 37m 19s. Rate: 9.5 symbols/min [2025-09-15T18:33:22.062949] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-09-15T18:33:22.109971] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:33:22.126792] [DEBUG] [LOCAL ] FVR: Loaded 16555 existing records from primary storage. [2025-09-15T18:33:22.126924] [INFO ] [MAIN ] FVR: Loaded 16555 existing records. [2025-09-15T18:33:22.301776] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:33:22.302016] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-09-15T18:33:22.302064] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-09-15T18:33:22.302564] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-09-15T18:33:22.302615] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-09-15T18:33:22.649990] [INFO ] [REMOTE ] FVR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:33:22.857882] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-09-15T18:33:23.364225] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-15T18:33:23.443886] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-15T18:33:23.505477] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-15T18:33:23.657891] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-09-15T18:33:24.457887] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-09-15T18:33:25.214523] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T18:33:25.257833] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-09-15T18:33:26.057871] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-09-15T18:33:26.520232] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-15T18:33:26.857873] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-09-15T18:33:27.099094] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-15T18:33:27.471852] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T18:33:27.657906] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-09-15T18:33:28.457880] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-09-15T18:33:28.725724] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-15T18:33:28.729262] [INFO ] [REMOTE ] FUL: Full fetch complete (35446 records). [2025-09-15T18:33:28.729336] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-09-15T18:33:28.729901] [FATAL] [VALIDATOR ] FUL: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:33:28.729976] [FATAL] [MAIN ] FUL: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:33:28.730013] [WARN ] [MAIN ] FUL: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:33:28.730051] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-09-15T18:33:28.730132] [DEBUG] [LOCAL ] FUL: No primary data file found to delete. [2025-09-15T18:33:28.730170] [INFO ] [LOCAL ] FUL: Starting deletion of derivative data. [2025-09-15T18:33:28.730496] [DEBUG] [LOCAL ] FUL: Deleted derivative data file. [2025-09-15T18:33:28.730588] [INFO ] [MAIN ] Update Progress: 883/2369 symbols completed. FUL took 30.2s. Estimated remaining: 2h 37m 13s. Rate: 9.5 symbols/min [2025-09-15T18:33:28.899823] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:33:28.931946] [DEBUG] [LOCAL ] FVRR: Loaded 30096 existing records from primary storage. [2025-09-15T18:33:28.932169] [INFO ] [MAIN ] FVRR: Loaded 30096 existing records. [2025-09-15T18:33:29.113825] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:33:29.114246] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-09-15T18:33:29.114356] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-09-15T18:33:29.120315] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-09-15T18:33:29.129911] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-09-15T18:33:29.175482] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-15T18:33:29.252284] [INFO ] [REMOTE ] FUBO: Full fetch complete (58379 records). [2025-09-15T18:33:29.262724] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-09-15T18:33:29.291503] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-09-15T18:33:29.666499] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:33:29.918967] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-09-15T18:33:29.919531] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T18:33:29.919666] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-09-15T18:33:29.925360] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-09-15T18:33:29.926081] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-09-15T18:33:29.927227] [DEBUG] [LOCAL ] FUBO: Trimmed 58379 records to 39688 (keeping 150 days of data) [2025-09-15T18:33:30.058447] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-09-15T18:33:30.177457] [DEBUG] [LOCAL ] FUBO: Primary data saved (39688 records). [2025-09-15T18:33:30.177613] [INFO ] [MAIN ] FUBO: Full history saved. [2025-09-15T18:33:30.177729] [INFO ] [MAIN ] Update Progress: 884/2369 symbols completed. FUBO took 31.7s. Estimated remaining: 2h 36m 59s. Rate: 9.5 symbols/min [2025-09-15T18:33:30.352785] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:33:30.355564] [DEBUG] [LOCAL ] FXED: Loaded 881 existing records from primary storage. [2025-09-15T18:33:30.355664] [INFO ] [MAIN ] FXED: Loaded 881 existing records. [2025-09-15T18:33:30.575256] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:33:30.575583] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-09-15T18:33:30.575674] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-09-15T18:33:30.575894] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-09-15T18:33:30.575961] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-09-15T18:33:30.860102] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-09-15T18:33:30.943740] [INFO ] [REMOTE ] FXED: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:33:30.958117] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-15T18:33:30.994858] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-15T18:33:31.657813] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-09-15T18:33:32.457908] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-09-15T18:33:32.622114] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-15T18:33:32.748284] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-15T18:33:33.257878] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-09-15T18:33:33.940500] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-15T18:33:34.057837] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-09-15T18:33:34.732100] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T18:33:34.857890] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-09-15T18:33:35.657856] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-09-15T18:33:35.692872] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T18:33:35.698738] [INFO ] [REMOTE ] FUN: Full fetch complete (55573 records). [2025-09-15T18:33:35.698852] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-09-15T18:33:36.083295] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-09-15T18:33:36.083380] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-09-15T18:33:36.084122] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-09-15T18:33:36.084170] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-09-15T18:33:36.085411] [DEBUG] [LOCAL ] FUN: Trimmed 55573 records to 38428 (keeping 150 days of data) [2025-09-15T18:33:36.139480] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-15T18:33:36.314485] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-15T18:33:36.352887] [DEBUG] [LOCAL ] FUN: Primary data saved (38428 records). [2025-09-15T18:33:36.353066] [INFO ] [MAIN ] FUN: Full history saved. [2025-09-15T18:33:36.354394] [INFO ] [MAIN ] Update Progress: 885/2369 symbols completed. FUN took 24.6s. Estimated remaining: 2h 36m 52s. Rate: 9.5 symbols/min [2025-09-15T18:33:36.462930] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-09-15T18:33:36.528738] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:33:36.568144] [DEBUG] [LOCAL ] G: Loaded 37400 existing records from primary storage. [2025-09-15T18:33:36.568284] [INFO ] [MAIN ] G: Loaded 37400 existing records. [2025-09-15T18:33:36.742159] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:33:36.742422] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-09-15T18:33:36.742469] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-09-15T18:33:36.743469] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-09-15T18:33:36.743523] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-09-15T18:33:36.917119] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-15T18:33:37.105310] [INFO ] [REMOTE ] G: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:33:37.257893] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-09-15T18:33:38.057886] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-09-15T18:33:38.857893] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-09-15T18:33:39.008087] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-15T18:33:39.638365] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T18:33:39.657834] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-09-15T18:33:39.936255] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-15T18:33:40.457886] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-09-15T18:33:40.636897] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-15T18:33:41.239939] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-15T18:33:41.257814] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-09-15T18:33:42.057938] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-09-15T18:33:42.276059] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-15T18:33:42.857931] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-09-15T18:33:43.663797] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-09-15T18:33:43.683531] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-15T18:33:44.292917] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-15T18:33:44.332368] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T18:33:44.457825] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-09-15T18:33:45.257890] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-09-15T18:33:45.672278] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-15T18:33:46.057895] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-09-15T18:33:46.226997] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T18:33:46.441371] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-15T18:33:46.857874] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-09-15T18:33:47.657907] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-09-15T18:33:48.457883] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-09-15T18:33:48.575651] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-15T18:33:48.642473] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T18:33:48.644962] [INFO ] [REMOTE ] FVR: Full fetch complete (23342 records). [2025-09-15T18:33:48.645068] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-09-15T18:33:49.033185] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-09-15T18:33:49.033271] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-09-15T18:33:49.033853] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-09-15T18:33:49.033908] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-09-15T18:33:49.034598] [DEBUG] [LOCAL ] FVR: Trimmed 23342 records to 16121 (keeping 150 days of data) [2025-09-15T18:33:49.137391] [DEBUG] [LOCAL ] FVR: Primary data saved (16121 records). [2025-09-15T18:33:49.137556] [INFO ] [MAIN ] FVR: Full history saved. [2025-09-15T18:33:49.137673] [INFO ] [MAIN ] Update Progress: 886/2369 symbols completed. FVR took 27.2s. Estimated remaining: 2h 36m 57s. Rate: 9.4 symbols/min [2025-09-15T18:33:49.262952] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-09-15T18:33:49.318032] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:33:49.337117] [DEBUG] [LOCAL ] GAB: Loaded 19836 existing records from primary storage. [2025-09-15T18:33:49.337242] [INFO ] [MAIN ] GAB: Loaded 19836 existing records. [2025-09-15T18:33:49.540196] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:33:49.540518] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-09-15T18:33:49.540577] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-09-15T18:33:49.541305] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-09-15T18:33:49.541362] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-09-15T18:33:49.644815] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-15T18:33:49.908970] [INFO ] [REMOTE ] GAB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:33:50.057869] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-09-15T18:33:50.175618] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-15T18:33:50.560451] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-15T18:33:50.857880] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-09-15T18:33:51.657930] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-09-15T18:33:52.432159] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-15T18:33:52.457830] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-09-15T18:33:52.931518] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-15T18:33:53.257871] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-09-15T18:33:54.062935] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-09-15T18:33:54.081502] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-15T18:33:54.230702] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-15T18:33:54.591304] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-15T18:33:54.592107] [INFO ] [REMOTE ] FXED: Full fetch complete (1283 records). [2025-09-15T18:33:54.592179] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-09-15T18:33:54.863001] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-09-15T18:33:54.958971] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-09-15T18:33:54.959059] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-09-15T18:33:54.959147] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-09-15T18:33:54.959186] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-09-15T18:33:54.959522] [DEBUG] [LOCAL ] FXED: Trimmed 1283 records to 868 (keeping 150 days of data) [2025-09-15T18:33:54.965591] [DEBUG] [LOCAL ] FXED: Primary data saved (868 records). [2025-09-15T18:33:54.965669] [INFO ] [MAIN ] FXED: Full history saved. [2025-09-15T18:33:54.965761] [INFO ] [MAIN ] Update Progress: 887/2369 symbols completed. FXED took 24.8s. Estimated remaining: 2h 36m 49s. Rate: 9.5 symbols/min [2025-09-15T18:33:55.140257] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:33:55.145564] [DEBUG] [LOCAL ] GAM: Loaded 2802 existing records from primary storage. [2025-09-15T18:33:55.145698] [INFO ] [MAIN ] GAM: Loaded 2802 existing records. [2025-09-15T18:33:55.324033] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:33:55.324327] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-09-15T18:33:55.324386] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-09-15T18:33:55.324608] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-09-15T18:33:55.324681] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-09-15T18:33:55.673066] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-09-15T18:33:55.677167] [INFO ] [REMOTE ] GAM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:33:56.263719] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T18:33:56.457887] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-09-15T18:33:56.962716] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T18:33:57.245077] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-15T18:33:57.257814] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-09-15T18:33:58.057887] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-09-15T18:33:58.857846] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-09-15T18:33:58.875449] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T18:33:58.919092] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-15T18:33:58.924695] [INFO ] [REMOTE ] G: Full fetch complete (54200 records). [2025-09-15T18:33:58.924818] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-09-15T18:33:59.311740] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-09-15T18:33:59.311830] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-09-15T18:33:59.312583] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-09-15T18:33:59.312623] [DEBUG] [LOCAL ] G: Saving primary data. [2025-09-15T18:33:59.313788] [DEBUG] [LOCAL ] G: Trimmed 54200 records to 36743 (keeping 150 days of data) [2025-09-15T18:33:59.547632] [DEBUG] [LOCAL ] G: Primary data saved (36743 records). [2025-09-15T18:33:59.547791] [INFO ] [MAIN ] G: Full history saved. [2025-09-15T18:33:59.547938] [INFO ] [MAIN ] Update Progress: 888/2369 symbols completed. G took 23.2s. Estimated remaining: 2h 36m 40s. Rate: 9.5 symbols/min [2025-09-15T18:33:59.663005] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-09-15T18:33:59.722901] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:33:59.762560] [DEBUG] [LOCAL ] GAP: Loaded 40398 existing records from primary storage. [2025-09-15T18:33:59.762723] [INFO ] [MAIN ] GAP: Loaded 40398 existing records. [2025-09-15T18:33:59.948809] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:33:59.949152] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-09-15T18:33:59.949207] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-09-15T18:33:59.950242] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-09-15T18:33:59.950300] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-09-15T18:34:00.316711] [INFO ] [REMOTE ] GAP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:34:00.329998] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T18:34:00.334410] [INFO ] [REMOTE ] FVRR: Full fetch complete (44022 records). [2025-09-15T18:34:00.334529] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-09-15T18:34:00.462939] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-09-15T18:34:00.722889] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-09-15T18:34:00.722987] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-09-15T18:34:00.723690] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-09-15T18:34:00.723736] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-09-15T18:34:00.724839] [DEBUG] [LOCAL ] FVRR: Trimmed 44022 records to 29697 (keeping 150 days of data) [2025-09-15T18:34:00.901320] [DEBUG] [LOCAL ] FVRR: Primary data saved (29697 records). [2025-09-15T18:34:00.901483] [INFO ] [MAIN ] FVRR: Full history saved. [2025-09-15T18:34:00.901601] [INFO ] [MAIN ] Update Progress: 889/2369 symbols completed. FVRR took 32.2s. Estimated remaining: 2h 36m 25s. Rate: 9.5 symbols/min [2025-09-15T18:34:01.079979] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:34:01.098478] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T18:34:01.117238] [DEBUG] [LOCAL ] GATX: Loaded 13288 existing records from primary storage. [2025-09-15T18:34:01.117381] [INFO ] [MAIN ] GATX: Loaded 13288 existing records. [2025-09-15T18:34:01.262922] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-09-15T18:34:01.298863] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:34:01.299101] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-09-15T18:34:01.299150] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-09-15T18:34:01.299596] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-09-15T18:34:01.299674] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-09-15T18:34:01.472166] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-15T18:34:01.682413] [INFO ] [REMOTE ] GATX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:34:02.057934] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-09-15T18:34:02.416019] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-15T18:34:02.857907] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-09-15T18:34:03.042471] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-15T18:34:03.657884] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-09-15T18:34:04.362339] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-15T18:34:04.457826] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-09-15T18:34:04.521434] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-15T18:34:05.257918] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-09-15T18:34:05.525317] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-15T18:34:06.057910] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-09-15T18:34:06.242571] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T18:34:06.246043] [INFO ] [REMOTE ] GAB: Full fetch complete (29411 records). [2025-09-15T18:34:06.246142] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-09-15T18:34:06.625996] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-09-15T18:34:06.626087] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-09-15T18:34:06.626633] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-09-15T18:34:06.626705] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-09-15T18:34:06.627578] [DEBUG] [LOCAL ] GAB: Trimmed 29411 records to 19323 (keeping 150 days of data) [2025-09-15T18:34:06.718045] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-15T18:34:06.748866] [DEBUG] [LOCAL ] GAB: Primary data saved (19323 records). [2025-09-15T18:34:06.749048] [INFO ] [MAIN ] GAB: Full history saved. [2025-09-15T18:34:06.749145] [INFO ] [MAIN ] Update Progress: 890/2369 symbols completed. GAB took 17.6s. Estimated remaining: 2h 36m 18s. Rate: 9.5 symbols/min [2025-09-15T18:34:06.862999] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-09-15T18:34:06.922341] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:34:06.933522] [DEBUG] [LOCAL ] GBAB: Loaded 9681 existing records from primary storage. [2025-09-15T18:34:06.933693] [INFO ] [MAIN ] GBAB: Loaded 9681 existing records. [2025-09-15T18:34:07.114891] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:34:07.115173] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-09-15T18:34:07.115220] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-09-15T18:34:07.115671] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-09-15T18:34:07.115725] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-09-15T18:34:07.525927] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:34:07.657958] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-09-15T18:34:07.852205] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-15T18:34:08.014710] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-15T18:34:08.457874] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-09-15T18:34:09.044884] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-15T18:34:09.257870] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-09-15T18:34:10.045417] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-15T18:34:10.057815] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-09-15T18:34:10.705603] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-15T18:34:10.857861] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-09-15T18:34:11.657875] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-09-15T18:34:11.950263] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-15T18:34:11.951243] [INFO ] [REMOTE ] GAM: Full fetch complete (4968 records). [2025-09-15T18:34:11.951315] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-09-15T18:34:12.319789] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-09-15T18:34:12.319877] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-09-15T18:34:12.320036] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-09-15T18:34:12.320076] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-09-15T18:34:12.320447] [DEBUG] [LOCAL ] GAM: Trimmed 4968 records to 2775 (keeping 150 days of data) [2025-09-15T18:34:12.338988] [DEBUG] [LOCAL ] GAM: Primary data saved (2775 records). [2025-09-15T18:34:12.339145] [INFO ] [MAIN ] GAM: Full history saved. [2025-09-15T18:34:12.339237] [INFO ] [MAIN ] Update Progress: 891/2369 symbols completed. GAM took 17.4s. Estimated remaining: 2h 36m 11s. Rate: 9.5 symbols/min [2025-09-15T18:34:12.463060] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-09-15T18:34:12.526978] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:34:12.561024] [DEBUG] [LOCAL ] GBCI: Loaded 29959 existing records from primary storage. [2025-09-15T18:34:12.561210] [INFO ] [MAIN ] GBCI: Loaded 29959 existing records. [2025-09-15T18:34:12.740707] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:34:12.741031] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-09-15T18:34:12.741078] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-09-15T18:34:12.741781] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-09-15T18:34:12.741831] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-09-15T18:34:13.098624] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:34:13.257905] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-09-15T18:34:13.330750] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-15T18:34:13.670258] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T18:34:14.057953] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-09-15T18:34:14.075534] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-15T18:34:14.857936] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-09-15T18:34:15.657941] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-09-15T18:34:16.457931] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-09-15T18:34:16.631595] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-09-15T18:34:16.725732] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-15T18:34:16.912179] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-15T18:34:17.257878] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-09-15T18:34:17.291990] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-15T18:34:17.886885] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-15T18:34:18.057873] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-09-15T18:34:18.857884] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-09-15T18:34:19.409665] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T18:34:19.657932] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-09-15T18:34:20.109028] [DEBUG] [REMOTE ] GBCI: Error fetching primary data for 2025-03: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-09-15T18:34:20.109199] [WARN ] [REMOTE ] GBCI: No data returned for month 2025-03 [2025-09-15T18:34:20.457904] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-09-15T18:34:20.630844] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-15T18:34:20.633194] [INFO ] [REMOTE ] GATX: Full fetch complete (18808 records). [2025-09-15T18:34:20.633276] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-09-15T18:34:20.633794] [FATAL] [VALIDATOR ] GATX: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:34:20.633877] [FATAL] [MAIN ] GATX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:34:20.633916] [WARN ] [MAIN ] GATX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:34:20.633955] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-09-15T18:34:20.634013] [DEBUG] [LOCAL ] GATX: No primary data file found to delete. [2025-09-15T18:34:20.634069] [INFO ] [LOCAL ] GATX: Starting deletion of derivative data. [2025-09-15T18:34:20.634388] [DEBUG] [LOCAL ] GATX: Deleted derivative data file. [2025-09-15T18:34:20.634474] [INFO ] [MAIN ] Update Progress: 892/2369 symbols completed. GATX took 19.7s. Estimated remaining: 2h 36m 8s. Rate: 9.5 symbols/min [2025-09-15T18:34:20.804610] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:34:20.804850] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-09-15T18:34:20.804891] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-09-15T18:34:20.805012] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-09-15T18:34:20.805050] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-15T18:34:20.805090] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-15T18:34:20.805123] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-09-15T18:34:21.178823] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:34:21.257863] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-09-15T18:34:21.410998] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-15T18:34:21.956675] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-15T18:34:22.057919] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-09-15T18:34:22.857875] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-09-15T18:34:23.230584] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-15T18:34:23.531380] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T18:34:23.657862] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-09-15T18:34:24.457936] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-09-15T18:34:25.144604] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-15T18:34:25.257888] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-09-15T18:34:26.057908] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-09-15T18:34:26.311071] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-15T18:34:26.538799] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T18:34:26.788192] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-15T18:34:26.857909] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-09-15T18:34:27.221804] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-15T18:34:27.657874] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-09-15T18:34:28.457890] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-09-15T18:34:28.863754] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-15T18:34:29.257868] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-09-15T18:34:29.897127] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-15T18:34:30.057872] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-09-15T18:34:30.170333] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-15T18:34:30.857872] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-09-15T18:34:31.093288] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-09-15T18:34:31.457906] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T18:34:31.657883] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-09-15T18:34:31.979258] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-15T18:34:32.457880] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-09-15T18:34:33.257917] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-09-15T18:34:33.462980] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T18:34:34.057969] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-09-15T18:34:34.807561] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-15T18:34:34.857908] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-09-15T18:34:35.061802] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-15T18:34:35.645184] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-15T18:34:35.657808] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-09-15T18:34:36.457894] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-09-15T18:34:36.464873] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T18:34:36.466829] [INFO ] [REMOTE ] GBAB: Full fetch complete (14412 records). [2025-09-15T18:34:36.466916] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-09-15T18:34:36.823216] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-09-15T18:34:36.823295] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-09-15T18:34:36.823602] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-09-15T18:34:36.823657] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-09-15T18:34:36.824146] [DEBUG] [LOCAL ] GBAB: Trimmed 14412 records to 9535 (keeping 150 days of data) [2025-09-15T18:34:36.881249] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-15T18:34:36.889452] [DEBUG] [LOCAL ] GBAB: Primary data saved (9535 records). [2025-09-15T18:34:36.889532] [INFO ] [MAIN ] GBAB: Full history saved. [2025-09-15T18:34:36.889614] [INFO ] [MAIN ] Update Progress: 893/2369 symbols completed. GBAB took 30.1s. Estimated remaining: 2h 36m 18s. Rate: 9.4 symbols/min [2025-09-15T18:34:37.066151] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:34:37.093899] [DEBUG] [LOCAL ] GBTG: Loaded 30281 existing records from primary storage. [2025-09-15T18:34:37.094038] [INFO ] [MAIN ] GBTG: Loaded 30281 existing records. [2025-09-15T18:34:37.260885] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-09-15T18:34:37.279294] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:34:37.280276] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-09-15T18:34:37.280344] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-09-15T18:34:37.281119] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-09-15T18:34:37.281206] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-09-15T18:34:37.668765] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:34:37.963326] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T18:34:37.964132] [INFO ] [REMOTE ] GBLI: Full fetch complete (1052 records). [2025-09-15T18:34:37.964201] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-09-15T18:34:38.062961] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-09-15T18:34:38.149392] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-15T18:34:38.149671] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:34:38.149725] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:34:38.149774] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-15T18:34:38.149847] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-15T18:34:38.149886] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-09-15T18:34:38.149928] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-09-15T18:34:38.149999] [INFO ] [MAIN ] Update Progress: 894/2369 symbols completed. GBLI took 17.5s. Estimated remaining: 2h 36m 3s. Rate: 9.5 symbols/min [2025-09-15T18:34:38.330189] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:34:38.354841] [DEBUG] [LOCAL ] GBX: Loaded 21172 existing records from primary storage. [2025-09-15T18:34:38.355015] [INFO ] [MAIN ] GBX: Loaded 21172 existing records. [2025-09-15T18:34:38.550485] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:34:38.550809] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-09-15T18:34:38.550872] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-09-15T18:34:38.551488] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-09-15T18:34:38.551561] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-09-15T18:34:38.863013] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-09-15T18:34:38.931389] [INFO ] [REMOTE ] GBX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:34:39.657917] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-09-15T18:34:39.974035] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-15T18:34:40.024274] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T18:34:40.457871] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-09-15T18:34:41.082335] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T18:34:41.257887] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-09-15T18:34:41.903667] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-15T18:34:41.908088] [INFO ] [REMOTE ] GBCI: Full fetch complete (37432 records). [2025-09-15T18:34:41.908182] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-09-15T18:34:42.059878] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-09-15T18:34:42.097191] [WARN ] [VALIDATOR ] GBCI: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-15T18:34:42.097768] [FATAL] [MAIN ] GBCI: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:34:42.097852] [WARN ] [MAIN ] GBCI: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:34:42.097921] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-09-15T18:34:42.098020] [DEBUG] [LOCAL ] GBCI: No primary data file found to delete. [2025-09-15T18:34:42.098075] [INFO ] [LOCAL ] GBCI: Starting deletion of derivative data. [2025-09-15T18:34:42.098334] [DEBUG] [LOCAL ] GBCI: Deleted derivative data file. [2025-09-15T18:34:42.098429] [INFO ] [MAIN ] Update Progress: 895/2369 symbols completed. GBCI took 29.8s. Estimated remaining: 2h 35m 53s. Rate: 9.5 symbols/min [2025-09-15T18:34:42.270180] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:34:42.301759] [DEBUG] [LOCAL ] GCI: Loaded 33004 existing records from primary storage. [2025-09-15T18:34:42.301902] [INFO ] [MAIN ] GCI: Loaded 33004 existing records. [2025-09-15T18:34:42.479327] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:34:42.479600] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-09-15T18:34:42.479664] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-09-15T18:34:42.480266] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-09-15T18:34:42.480315] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-09-15T18:34:42.842878] [INFO ] [REMOTE ] GCI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:34:42.857825] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-09-15T18:34:43.170672] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-15T18:34:43.230687] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-15T18:34:43.239105] [INFO ] [REMOTE ] GAP: Full fetch complete (58330 records). [2025-09-15T18:34:43.239354] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-09-15T18:34:43.655555] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-09-15T18:34:43.655664] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-09-15T18:34:43.656442] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-09-15T18:34:43.656502] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-09-15T18:34:43.657754] [DEBUG] [LOCAL ] GAP: Trimmed 58330 records to 39617 (keeping 150 days of data) [2025-09-15T18:34:43.657910] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-09-15T18:34:43.915402] [DEBUG] [LOCAL ] GAP: Primary data saved (39617 records). [2025-09-15T18:34:43.915595] [INFO ] [MAIN ] GAP: Full history saved. [2025-09-15T18:34:43.916302] [INFO ] [MAIN ] Update Progress: 896/2369 symbols completed. GAP took 44.4s. Estimated remaining: 2h 35m 39s. Rate: 9.5 symbols/min [2025-09-15T18:34:44.087225] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:34:44.108164] [DEBUG] [LOCAL ] GCO: Loaded 17713 existing records from primary storage. [2025-09-15T18:34:44.108335] [INFO ] [MAIN ] GCO: Loaded 17713 existing records. [2025-09-15T18:34:44.283007] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:34:44.283250] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-09-15T18:34:44.283295] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-09-15T18:34:44.283879] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-09-15T18:34:44.283930] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-09-15T18:34:44.488477] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-09-15T18:34:44.642750] [INFO ] [REMOTE ] GCO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:34:44.683480] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-15T18:34:45.069389] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-15T18:34:45.257892] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-09-15T18:34:45.859204] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T18:34:46.057870] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-09-15T18:34:46.565735] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-15T18:34:46.857835] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-09-15T18:34:47.254950] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-15T18:34:47.657884] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-09-15T18:34:48.290135] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T18:34:48.457863] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-09-15T18:34:48.753893] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-15T18:34:49.257866] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-09-15T18:34:49.325813] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-15T18:34:50.057877] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-09-15T18:34:50.287275] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-15T18:34:50.857868] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-09-15T18:34:51.071129] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T18:34:51.657880] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-09-15T18:34:52.243955] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-15T18:34:52.457886] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-09-15T18:34:53.095481] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-15T18:34:53.257869] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-09-15T18:34:53.805111] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T18:34:54.057886] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-09-15T18:34:54.624174] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T18:34:54.857922] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-09-15T18:34:55.142464] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-15T18:34:55.145582] [INFO ] [REMOTE ] GBX: Full fetch complete (32561 records). [2025-09-15T18:34:55.145739] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-09-15T18:34:55.523199] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-09-15T18:34:55.523283] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-09-15T18:34:55.523956] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-09-15T18:34:55.524002] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-09-15T18:34:55.524839] [DEBUG] [LOCAL ] GBX: Trimmed 32561 records to 20311 (keeping 150 days of data) [2025-09-15T18:34:55.658379] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-09-15T18:34:55.660029] [DEBUG] [LOCAL ] GBX: Primary data saved (20311 records). [2025-09-15T18:34:55.660920] [INFO ] [MAIN ] GBX: Full history saved. [2025-09-15T18:34:55.661009] [INFO ] [MAIN ] Update Progress: 897/2369 symbols completed. GBX took 17.5s. Estimated remaining: 2h 35m 41s. Rate: 9.5 symbols/min [2025-09-15T18:34:55.838686] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:34:55.855780] [DEBUG] [LOCAL ] GCTS: Loaded 15783 existing records from primary storage. [2025-09-15T18:34:55.855906] [INFO ] [MAIN ] GCTS: Loaded 15783 existing records. [2025-09-15T18:34:56.033424] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:34:56.033726] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-09-15T18:34:56.033776] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-09-15T18:34:56.034199] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-09-15T18:34:56.034266] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-09-15T18:34:56.388052] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:34:56.414342] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-15T18:34:56.457836] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-09-15T18:34:56.857368] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-15T18:34:57.257898] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-09-15T18:34:57.921491] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T18:34:58.041795] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-15T18:34:58.057825] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-09-15T18:34:58.857851] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-09-15T18:34:59.081617] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-15T18:34:59.657895] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-09-15T18:34:59.957960] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-15T18:34:59.962603] [INFO ] [REMOTE ] GBTG: Full fetch complete (43485 records). [2025-09-15T18:34:59.962791] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-09-15T18:35:00.347451] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-09-15T18:35:00.347539] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-09-15T18:35:00.348284] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-09-15T18:35:00.348337] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-09-15T18:35:00.349332] [DEBUG] [LOCAL ] GBTG: Trimmed 43485 records to 29741 (keeping 150 days of data) [2025-09-15T18:35:00.463043] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-09-15T18:35:00.534188] [DEBUG] [LOCAL ] GBTG: Primary data saved (29741 records). [2025-09-15T18:35:00.534345] [INFO ] [MAIN ] GBTG: Full history saved. [2025-09-15T18:35:00.534448] [INFO ] [MAIN ] Update Progress: 898/2369 symbols completed. GBTG took 23.6s. Estimated remaining: 2h 35m 32s. Rate: 9.5 symbols/min [2025-09-15T18:35:00.707054] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:35:00.713855] [DEBUG] [LOCAL ] GCV: Loaded 5535 existing records from primary storage. [2025-09-15T18:35:00.713974] [INFO ] [MAIN ] GCV: Loaded 5535 existing records. [2025-09-15T18:35:00.891591] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:35:00.892151] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-09-15T18:35:00.892243] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-09-15T18:35:00.900416] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-09-15T18:35:00.900927] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-09-15T18:35:00.901231] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T18:35:01.261696] [INFO ] [REMOTE ] GCV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:35:01.261753] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-09-15T18:35:01.689832] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T18:35:02.057927] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-09-15T18:35:02.803799] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-15T18:35:02.824405] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-15T18:35:02.857827] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-09-15T18:35:03.657889] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-09-15T18:35:04.002047] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-15T18:35:04.005196] [INFO ] [REMOTE ] GCO: Full fetch complete (27896 records). [2025-09-15T18:35:04.005268] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-09-15T18:35:04.374266] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-09-15T18:35:04.374394] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-09-15T18:35:04.375228] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-09-15T18:35:04.375333] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-09-15T18:35:04.386118] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-15T18:35:04.391244] [DEBUG] [LOCAL ] GCO: Trimmed 27896 records to 17261 (keeping 150 days of data) [2025-09-15T18:35:04.466880] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-09-15T18:35:04.496980] [DEBUG] [LOCAL ] GCO: Primary data saved (17261 records). [2025-09-15T18:35:04.497097] [INFO ] [MAIN ] GCO: Full history saved. [2025-09-15T18:35:04.497193] [INFO ] [MAIN ] Update Progress: 899/2369 symbols completed. GCO took 20.6s. Estimated remaining: 2h 35m 22s. Rate: 9.5 symbols/min [2025-09-15T18:35:04.665171] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:35:04.702135] [DEBUG] [LOCAL ] GD: Loaded 35042 existing records from primary storage. [2025-09-15T18:35:04.702313] [INFO ] [MAIN ] GD: Loaded 35042 existing records. [2025-09-15T18:35:04.884279] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:35:04.884803] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-09-15T18:35:04.884873] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-09-15T18:35:04.885912] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-09-15T18:35:04.886000] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-09-15T18:35:05.263430] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-09-15T18:35:05.270904] [INFO ] [REMOTE ] GD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:35:05.626137] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-15T18:35:06.057934] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-09-15T18:35:06.532332] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-15T18:35:06.857884] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-09-15T18:35:07.657835] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-09-15T18:35:07.700256] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-15T18:35:07.757513] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-15T18:35:08.457918] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-09-15T18:35:08.510706] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-15T18:35:09.257875] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-09-15T18:35:09.832506] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-15T18:35:10.014987] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T18:35:10.057868] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-09-15T18:35:10.857907] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-09-15T18:35:11.482753] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-15T18:35:11.657845] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-09-15T18:35:12.073476] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-15T18:35:12.221004] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-15T18:35:12.457870] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-09-15T18:35:12.849400] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-15T18:35:13.257881] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-09-15T18:35:13.957093] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-15T18:35:14.057854] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-09-15T18:35:14.810809] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-15T18:35:14.857881] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-09-15T18:35:15.657866] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-09-15T18:35:16.455114] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-15T18:35:16.458530] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-09-15T18:35:16.570768] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-15T18:35:17.257897] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-09-15T18:35:17.368321] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-15T18:35:17.370153] [INFO ] [REMOTE ] GCV: Full fetch complete (7491 records). [2025-09-15T18:35:17.370232] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-09-15T18:35:17.737455] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-09-15T18:35:17.737560] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-09-15T18:35:17.737784] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-09-15T18:35:17.737840] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-09-15T18:35:17.738253] [DEBUG] [LOCAL ] GCV: Trimmed 7491 records to 5377 (keeping 150 days of data) [2025-09-15T18:35:17.772191] [DEBUG] [LOCAL ] GCV: Primary data saved (5377 records). [2025-09-15T18:35:17.772344] [INFO ] [MAIN ] GCV: Full history saved. [2025-09-15T18:35:17.772479] [INFO ] [MAIN ] Update Progress: 900/2369 symbols completed. GCV took 17.2s. Estimated remaining: 2h 35m 27s. Rate: 9.4 symbols/min [2025-09-15T18:35:17.950007] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:35:17.993062] [DEBUG] [LOCAL ] GDDY: Loaded 37225 existing records from primary storage. [2025-09-15T18:35:17.993214] [INFO ] [MAIN ] GDDY: Loaded 37225 existing records. [2025-09-15T18:35:18.063001] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-09-15T18:35:18.185909] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:35:18.186187] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-09-15T18:35:18.186240] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-09-15T18:35:18.187253] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-09-15T18:35:18.187345] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-09-15T18:35:18.722961] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:35:18.772179] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-15T18:35:18.858053] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-09-15T18:35:19.204966] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-15T18:35:19.657867] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-09-15T18:35:20.457862] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-09-15T18:35:20.825443] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-15T18:35:20.866071] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-15T18:35:20.868429] [INFO ] [REMOTE ] GCTS: Full fetch complete (20403 records). [2025-09-15T18:35:20.868498] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-09-15T18:35:20.868960] [FATAL] [VALIDATOR ] GCTS: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:35:20.869035] [FATAL] [MAIN ] GCTS: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:35:20.869090] [WARN ] [MAIN ] GCTS: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:35:20.869133] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-09-15T18:35:20.869208] [DEBUG] [LOCAL ] GCTS: No primary data file found to delete. [2025-09-15T18:35:20.869257] [INFO ] [LOCAL ] GCTS: Starting deletion of derivative data. [2025-09-15T18:35:20.869724] [DEBUG] [LOCAL ] GCTS: Deleted derivative data file. [2025-09-15T18:35:20.869841] [INFO ] [MAIN ] Update Progress: 901/2369 symbols completed. GCTS took 25.2s. Estimated remaining: 2h 35m 16s. Rate: 9.5 symbols/min [2025-09-15T18:35:21.043203] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:35:21.048130] [DEBUG] [LOCAL ] GDIV: Loaded 2692 existing records from primary storage. [2025-09-15T18:35:21.048260] [INFO ] [MAIN ] GDIV: Loaded 2692 existing records. [2025-09-15T18:35:21.239077] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:35:21.239347] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-09-15T18:35:21.239393] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-09-15T18:35:21.239670] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-09-15T18:35:21.239720] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-09-15T18:35:21.263095] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-09-15T18:35:21.603293] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:35:22.057871] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-09-15T18:35:22.350185] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-15T18:35:22.857867] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-09-15T18:35:22.936511] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-15T18:35:23.625887] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-15T18:35:23.657867] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-09-15T18:35:24.457846] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-09-15T18:35:24.557619] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-15T18:35:25.257884] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-09-15T18:35:25.332390] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T18:35:25.725919] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-15T18:35:26.057913] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-09-15T18:35:26.821907] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-15T18:35:26.859026] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-09-15T18:35:26.862231] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-15T18:35:27.657914] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-09-15T18:35:28.211563] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T18:35:28.457874] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-09-15T18:35:28.846075] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-15T18:35:29.135361] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T18:35:29.140834] [INFO ] [REMOTE ] GD: Full fetch complete (52179 records). [2025-09-15T18:35:29.141023] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-09-15T18:35:29.263047] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-09-15T18:35:29.583265] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-09-15T18:35:29.583380] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-09-15T18:35:29.584145] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-09-15T18:35:29.584204] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-09-15T18:35:29.585553] [DEBUG] [LOCAL ] GD: Trimmed 52179 records to 34238 (keeping 150 days of data) [2025-09-15T18:35:29.804110] [DEBUG] [LOCAL ] GD: Primary data saved (34238 records). [2025-09-15T18:35:29.804279] [INFO ] [MAIN ] GD: Full history saved. [2025-09-15T18:35:29.804366] [INFO ] [MAIN ] Update Progress: 902/2369 symbols completed. GD took 25.3s. Estimated remaining: 2h 35m 13s. Rate: 9.5 symbols/min [2025-09-15T18:35:29.977696] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:35:29.983326] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-15T18:35:29.988120] [DEBUG] [LOCAL ] GDL: Loaded 1759 existing records from primary storage. [2025-09-15T18:35:29.988201] [INFO ] [MAIN ] GDL: Loaded 1759 existing records. [2025-09-15T18:35:30.063029] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-09-15T18:35:30.169430] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:35:30.169731] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-09-15T18:35:30.169784] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-09-15T18:35:30.170016] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-09-15T18:35:30.170063] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-09-15T18:35:30.540522] [INFO ] [REMOTE ] GDL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:35:30.857866] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-09-15T18:35:31.225707] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-15T18:35:31.538099] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T18:35:31.543905] [INFO ] [REMOTE ] GCI: Full fetch complete (47974 records). [2025-09-15T18:35:31.544060] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-09-15T18:35:31.659962] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-09-15T18:35:31.949360] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-09-15T18:35:31.949462] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-09-15T18:35:31.950289] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-09-15T18:35:31.950343] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-09-15T18:35:31.951452] [DEBUG] [LOCAL ] GCI: Trimmed 47974 records to 32264 (keeping 150 days of data) [2025-09-15T18:35:32.146887] [DEBUG] [LOCAL ] GCI: Primary data saved (32264 records). [2025-09-15T18:35:32.147044] [INFO ] [MAIN ] GCI: Full history saved. [2025-09-15T18:35:32.147158] [INFO ] [MAIN ] Update Progress: 903/2369 symbols completed. GCI took 50.0s. Estimated remaining: 2h 35m 1s. Rate: 9.5 symbols/min [2025-09-15T18:35:32.321372] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:35:32.328725] [DEBUG] [LOCAL ] GDO: Loaded 4390 existing records from primary storage. [2025-09-15T18:35:32.328838] [INFO ] [MAIN ] GDO: Loaded 4390 existing records. [2025-09-15T18:35:32.463026] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-09-15T18:35:32.515874] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:35:32.516288] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-09-15T18:35:32.516337] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-09-15T18:35:32.516610] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-09-15T18:35:32.516681] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-09-15T18:35:32.871003] [INFO ] [REMOTE ] GDO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:35:33.257908] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-09-15T18:35:33.313527] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-15T18:35:33.354493] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T18:35:34.002267] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-15T18:35:34.057849] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-09-15T18:35:34.670027] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-15T18:35:34.857909] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-09-15T18:35:35.298724] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-15T18:35:35.657891] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-09-15T18:35:36.268750] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-15T18:35:36.457891] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-09-15T18:35:37.107920] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-15T18:35:37.257916] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-09-15T18:35:37.593699] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-15T18:35:38.057867] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-09-15T18:35:38.495731] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-15T18:35:38.857955] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-09-15T18:35:39.456161] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-15T18:35:39.657899] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-09-15T18:35:40.386994] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-15T18:35:40.457833] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-09-15T18:35:40.748124] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-15T18:35:41.257925] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-09-15T18:35:42.057882] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-09-15T18:35:42.535552] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-15T18:35:42.857867] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-09-15T18:35:43.021571] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-15T18:35:43.277102] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-15T18:35:43.657885] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-09-15T18:35:44.457868] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-09-15T18:35:45.068348] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-15T18:35:45.069338] [INFO ] [REMOTE ] GDIV: Full fetch complete (4172 records). [2025-09-15T18:35:45.069411] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-09-15T18:35:45.266867] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-09-15T18:35:45.424823] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-09-15T18:35:45.424904] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-09-15T18:35:45.425049] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-09-15T18:35:45.425093] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-09-15T18:35:45.425445] [DEBUG] [LOCAL ] GDIV: Trimmed 4172 records to 2590 (keeping 150 days of data) [2025-09-15T18:35:45.441741] [DEBUG] [LOCAL ] GDIV: Primary data saved (2590 records). [2025-09-15T18:35:45.441801] [INFO ] [MAIN ] GDIV: Full history saved. [2025-09-15T18:35:45.441868] [INFO ] [MAIN ] Update Progress: 904/2369 symbols completed. GDIV took 24.6s. Estimated remaining: 2h 35m 6s. Rate: 9.4 symbols/min [2025-09-15T18:35:45.614006] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:35:45.659531] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-15T18:35:45.682447] [DEBUG] [LOCAL ] GDOT: Loaded 27838 existing records from primary storage. [2025-09-15T18:35:45.682621] [INFO ] [MAIN ] GDOT: Loaded 27838 existing records. [2025-09-15T18:35:45.789129] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-15T18:35:45.869746] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:35:45.869999] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-09-15T18:35:45.870046] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-09-15T18:35:45.870744] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-09-15T18:35:45.870797] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-09-15T18:35:46.064731] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-09-15T18:35:46.222453] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:35:46.857883] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-09-15T18:35:47.656025] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-15T18:35:47.657987] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-09-15T18:35:47.662573] [INFO ] [REMOTE ] GDDY: Full fetch complete (54351 records). [2025-09-15T18:35:47.662682] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-09-15T18:35:48.043984] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-09-15T18:35:48.044077] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-09-15T18:35:48.044858] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-09-15T18:35:48.044907] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-09-15T18:35:48.046169] [DEBUG] [LOCAL ] GDDY: Trimmed 54351 records to 36534 (keeping 150 days of data) [2025-09-15T18:35:48.113343] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-15T18:35:48.189512] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-15T18:35:48.301428] [DEBUG] [LOCAL ] GDDY: Primary data saved (36534 records). [2025-09-15T18:35:48.301573] [INFO ] [MAIN ] GDDY: Full history saved. [2025-09-15T18:35:48.302280] [INFO ] [MAIN ] Update Progress: 905/2369 symbols completed. GDDY took 30.5s. Estimated remaining: 2h 34m 54s. Rate: 9.5 symbols/min [2025-09-15T18:35:48.478276] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:35:48.474706] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-09-15T18:35:48.496115] [DEBUG] [LOCAL ] GDV: Loaded 14594 existing records from primary storage. [2025-09-15T18:35:48.496263] [INFO ] [MAIN ] GDV: Loaded 14594 existing records. [2025-09-15T18:35:48.680902] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:35:48.681288] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-09-15T18:35:48.681345] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-09-15T18:35:48.681832] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-09-15T18:35:48.681883] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-09-15T18:35:49.031680] [INFO ] [REMOTE ] GDV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:35:49.257858] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-09-15T18:35:49.780614] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T18:35:50.056948] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-15T18:35:50.058878] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-09-15T18:35:50.509738] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-15T18:35:50.857868] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-09-15T18:35:51.361282] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-15T18:35:51.362296] [INFO ] [REMOTE ] GDL: Full fetch complete (2560 records). [2025-09-15T18:35:51.362364] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-09-15T18:35:51.662951] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-09-15T18:35:51.735505] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-09-15T18:35:51.735583] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-09-15T18:35:51.735715] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-09-15T18:35:51.735758] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-09-15T18:35:51.736164] [DEBUG] [LOCAL ] GDL: Trimmed 2560 records to 1737 (keeping 150 days of data) [2025-09-15T18:35:51.747166] [DEBUG] [LOCAL ] GDL: Primary data saved (1737 records). [2025-09-15T18:35:51.747236] [INFO ] [MAIN ] GDL: Full history saved. [2025-09-15T18:35:51.747310] [INFO ] [MAIN ] Update Progress: 906/2369 symbols completed. GDL took 21.9s. Estimated remaining: 2h 34m 42s. Rate: 9.5 symbols/min [2025-09-15T18:35:51.931824] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:35:51.970842] [DEBUG] [LOCAL ] GE: Loaded 40461 existing records from primary storage. [2025-09-15T18:35:51.970984] [INFO ] [MAIN ] GE: Loaded 40461 existing records. [2025-09-15T18:35:52.165385] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:35:52.165846] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-09-15T18:35:52.165897] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-09-15T18:35:52.166917] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-09-15T18:35:52.166973] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-09-15T18:35:52.463045] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-09-15T18:35:52.520241] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-15T18:35:52.542627] [INFO ] [REMOTE ] GE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:35:52.544864] [INFO ] [REMOTE ] GDO: Full fetch complete (6483 records). [2025-09-15T18:35:52.545301] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-09-15T18:35:52.918896] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-09-15T18:35:52.918979] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-09-15T18:35:52.919145] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-09-15T18:35:52.919185] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-09-15T18:35:52.919660] [DEBUG] [LOCAL ] GDO: Trimmed 6483 records to 4329 (keeping 150 days of data) [2025-09-15T18:35:52.949814] [DEBUG] [LOCAL ] GDO: Primary data saved (4329 records). [2025-09-15T18:35:52.949979] [INFO ] [MAIN ] GDO: Full history saved. [2025-09-15T18:35:52.950072] [INFO ] [MAIN ] Update Progress: 907/2369 symbols completed. GDO took 20.8s. Estimated remaining: 2h 34m 28s. Rate: 9.5 symbols/min [2025-09-15T18:35:53.120961] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:35:53.137270] [DEBUG] [LOCAL ] GEF: Loaded 15434 existing records from primary storage. [2025-09-15T18:35:53.137400] [INFO ] [MAIN ] GEF: Loaded 15434 existing records. [2025-09-15T18:35:53.263019] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-09-15T18:35:53.323433] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:35:53.323725] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-09-15T18:35:53.323781] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-09-15T18:35:53.324301] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-09-15T18:35:53.324347] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-09-15T18:35:53.677080] [INFO ] [REMOTE ] GEF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:35:53.700205] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-15T18:35:54.057902] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-09-15T18:35:54.629828] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T18:35:54.857890] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-09-15T18:35:55.657879] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-09-15T18:35:55.730188] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-15T18:35:55.910399] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-15T18:35:56.457929] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-09-15T18:35:56.715440] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-15T18:35:57.257871] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-09-15T18:35:57.575287] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-15T18:35:58.057936] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-09-15T18:35:58.857898] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-09-15T18:35:59.038975] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-15T18:35:59.450661] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-15T18:35:59.657906] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-09-15T18:36:00.071153] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T18:36:00.457890] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-09-15T18:36:00.938448] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-15T18:36:01.257895] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-09-15T18:36:01.709402] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-15T18:36:02.036626] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-15T18:36:02.057825] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-09-15T18:36:02.857880] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-09-15T18:36:03.657903] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-09-15T18:36:04.457933] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-09-15T18:36:06.007935] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (3.95 seconds). [2025-09-15T18:36:06.012661] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-09-15T18:36:08.654791] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (4.20 seconds). [2025-09-15T18:36:08.663271] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-09-15T18:36:08.947007] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (2.93 seconds). [2025-09-15T18:36:08.952516] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-09-15T18:36:09.021404] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (6.16 seconds). [2025-09-15T18:36:09.026117] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-09-15T18:36:09.937088] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-15T18:36:09.944555] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-09-15T18:36:10.739867] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-15T18:36:10.744764] [INFO ] [REMOTE ] GDOT: Full fetch complete (41157 records). [2025-09-15T18:36:10.744930] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-09-15T18:36:11.239678] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-09-15T18:36:11.239828] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-09-15T18:36:11.240549] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-09-15T18:36:11.240629] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-09-15T18:36:11.242062] [DEBUG] [LOCAL ] GDOT: Trimmed 41157 records to 27340 (keeping 150 days of data) [2025-09-15T18:36:11.468418] [DEBUG] [LOCAL ] GDOT: Primary data saved (27340 records). [2025-09-15T18:36:11.468594] [INFO ] [MAIN ] GDOT: Full history saved. [2025-09-15T18:36:11.468745] [INFO ] [MAIN ] Update Progress: 908/2369 symbols completed. GDOT took 26.0s. Estimated remaining: 2h 34m 41s. Rate: 9.4 symbols/min [2025-09-15T18:36:11.700007] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:36:11.733472] [DEBUG] [LOCAL ] GEL: Loaded 25309 existing records from primary storage. [2025-09-15T18:36:11.733681] [INFO ] [MAIN ] GEL: Loaded 25309 existing records. [2025-09-15T18:36:12.021264] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:36:12.021571] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-09-15T18:36:12.021635] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-09-15T18:36:12.023027] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-09-15T18:36:12.023096] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-09-15T18:36:12.397928] [INFO ] [REMOTE ] GEL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:36:12.398318] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-09-15T18:36:12.454725] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (8.80 seconds). [2025-09-15T18:36:12.471438] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-09-15T18:36:12.832273] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-09-15T18:36:12.837821] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-09-15T18:36:13.327419] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (4.30 seconds). [2025-09-15T18:36:13.332999] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-09-15T18:36:13.504015] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-15T18:36:13.509099] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-09-15T18:36:14.153196] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-15T18:36:14.160872] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-09-15T18:36:14.173993] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-15T18:36:14.178744] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-09-15T18:36:14.214195] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-15T18:36:14.548110] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T18:36:14.551276] [INFO ] [REMOTE ] GEF: Full fetch complete (22210 records). [2025-09-15T18:36:14.551355] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-09-15T18:36:14.863049] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-09-15T18:36:14.918295] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-09-15T18:36:14.918375] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-09-15T18:36:14.918847] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-09-15T18:36:14.918891] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-09-15T18:36:14.919943] [DEBUG] [LOCAL ] GEF: Trimmed 22210 records to 15263 (keeping 150 days of data) [2025-09-15T18:36:15.013544] [DEBUG] [LOCAL ] GEF: Primary data saved (15263 records). [2025-09-15T18:36:15.013708] [INFO ] [MAIN ] GEF: Full history saved. [2025-09-15T18:36:15.013798] [INFO ] [MAIN ] Update Progress: 909/2369 symbols completed. GEF took 22.1s. Estimated remaining: 2h 34m 30s. Rate: 9.4 symbols/min [2025-09-15T18:36:15.181081] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:36:15.223663] [DEBUG] [LOCAL ] GENI: Loaded 39790 existing records from primary storage. [2025-09-15T18:36:15.223849] [INFO ] [MAIN ] GENI: Loaded 39790 existing records. [2025-09-15T18:36:15.397458] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:36:15.397739] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-09-15T18:36:15.397786] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-09-15T18:36:15.398744] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-09-15T18:36:15.398796] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-09-15T18:36:15.754155] [INFO ] [REMOTE ] GENI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:36:15.754527] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-09-15T18:36:15.760758] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-15T18:36:15.763280] [INFO ] [REMOTE ] GDV: Full fetch complete (21867 records). [2025-09-15T18:36:15.763356] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-09-15T18:36:16.125828] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-09-15T18:36:16.125916] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-09-15T18:36:16.126361] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-09-15T18:36:16.126400] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-09-15T18:36:16.127044] [DEBUG] [LOCAL ] GDV: Trimmed 21867 records to 14265 (keeping 150 days of data) [2025-09-15T18:36:16.215883] [DEBUG] [LOCAL ] GDV: Primary data saved (14265 records). [2025-09-15T18:36:16.216034] [INFO ] [MAIN ] GDV: Full history saved. [2025-09-15T18:36:16.216122] [INFO ] [MAIN ] Update Progress: 910/2369 symbols completed. GDV took 27.9s. Estimated remaining: 2h 34m 16s. Rate: 9.5 symbols/min [2025-09-15T18:36:16.384434] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:36:16.425078] [DEBUG] [LOCAL ] GEO: Loaded 39206 existing records from primary storage. [2025-09-15T18:36:16.425240] [INFO ] [MAIN ] GEO: Loaded 39206 existing records. [2025-09-15T18:36:16.604864] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:36:16.605111] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-09-15T18:36:16.605245] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-09-15T18:36:16.606091] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-09-15T18:36:16.652790] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-09-15T18:36:16.750344] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-09-15T18:36:16.786296] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-09-15T18:36:17.031258] [INFO ] [REMOTE ] GEO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:36:17.257885] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-09-15T18:36:17.879820] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (3.02 seconds). [2025-09-15T18:36:18.033209] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-15T18:36:18.057813] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-09-15T18:36:18.255878] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-09-15T18:36:18.857876] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-09-15T18:36:19.350271] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-15T18:36:19.663900] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-09-15T18:36:19.679618] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-09-15T18:36:20.457937] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-09-15T18:36:20.785259] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-15T18:36:20.863883] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-15T18:36:21.257898] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-09-15T18:36:21.974212] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T18:36:22.057818] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-09-15T18:36:22.695180] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T18:36:22.857895] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-09-15T18:36:23.657869] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-09-15T18:36:23.814742] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T18:36:24.457867] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-09-15T18:36:24.742283] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-15T18:36:25.058576] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T18:36:25.257865] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-09-15T18:36:26.057922] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-09-15T18:36:26.549259] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-15T18:36:26.857941] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-09-15T18:36:27.013169] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-15T18:36:27.657870] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-09-15T18:36:27.976354] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-15T18:36:28.457838] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-09-15T18:36:28.524668] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-15T18:36:28.530825] [INFO ] [REMOTE ] GE: Full fetch complete (58387 records). [2025-09-15T18:36:28.530937] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-09-15T18:36:28.917209] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-09-15T18:36:28.917295] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-09-15T18:36:28.918074] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-09-15T18:36:28.918121] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-09-15T18:36:28.919341] [DEBUG] [LOCAL ] GE: Trimmed 58387 records to 39678 (keeping 150 days of data) [2025-09-15T18:36:29.196558] [DEBUG] [LOCAL ] GE: Primary data saved (39678 records). [2025-09-15T18:36:29.196778] [INFO ] [MAIN ] GE: Full history saved. [2025-09-15T18:36:29.197458] [INFO ] [MAIN ] Update Progress: 911/2369 symbols completed. GE took 37.5s. Estimated remaining: 2h 34m 20s. Rate: 9.4 symbols/min [2025-09-15T18:36:29.262299] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-09-15T18:36:29.373889] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:36:29.440114] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-15T18:36:29.451473] [DEBUG] [LOCAL ] GES: Loaded 28871 existing records from primary storage. [2025-09-15T18:36:29.451941] [INFO ] [MAIN ] GES: Loaded 28871 existing records. [2025-09-15T18:36:29.632459] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:36:29.632762] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-09-15T18:36:29.632815] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-09-15T18:36:29.633547] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-09-15T18:36:29.633618] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-09-15T18:36:29.989426] [INFO ] [REMOTE ] GES: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:36:30.057827] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-09-15T18:36:30.310507] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-15T18:36:30.762828] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T18:36:30.766325] [INFO ] [REMOTE ] GEL: Full fetch complete (37792 records). [2025-09-15T18:36:30.766407] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-09-15T18:36:30.867261] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-09-15T18:36:31.159907] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-09-15T18:36:31.159997] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-09-15T18:36:31.160703] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-09-15T18:36:31.160776] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-09-15T18:36:31.161835] [DEBUG] [LOCAL ] GEL: Trimmed 37792 records to 24836 (keeping 150 days of data) [2025-09-15T18:36:31.321117] [DEBUG] [LOCAL ] GEL: Primary data saved (24836 records). [2025-09-15T18:36:31.321263] [INFO ] [MAIN ] GEL: Full history saved. [2025-09-15T18:36:31.321382] [INFO ] [MAIN ] Update Progress: 912/2369 symbols completed. GEL took 19.9s. Estimated remaining: 2h 34m 7s. Rate: 9.5 symbols/min [2025-09-15T18:36:31.492225] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:36:31.518050] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-15T18:36:31.549786] [DEBUG] [LOCAL ] GETY: Loaded 26329 existing records from primary storage. [2025-09-15T18:36:31.549965] [INFO ] [MAIN ] GETY: Loaded 26329 existing records. [2025-09-15T18:36:31.662933] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-09-15T18:36:31.732955] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:36:31.733172] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-09-15T18:36:31.733218] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-09-15T18:36:31.733857] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-09-15T18:36:31.733907] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-09-15T18:36:32.094423] [INFO ] [REMOTE ] GETY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:36:32.417388] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T18:36:32.457861] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-09-15T18:36:33.264851] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-09-15T18:36:33.286122] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-15T18:36:34.057907] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-09-15T18:36:34.308157] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-15T18:36:34.821824] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T18:36:34.857892] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-09-15T18:36:35.628766] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T18:36:35.657856] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-09-15T18:36:36.006632] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T18:36:36.012510] [INFO ] [REMOTE ] GENI: Full fetch complete (57199 records). [2025-09-15T18:36:36.012614] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-09-15T18:36:36.392222] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-09-15T18:36:36.392347] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-09-15T18:36:36.393132] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-09-15T18:36:36.393181] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-09-15T18:36:36.394373] [DEBUG] [LOCAL ] GENI: Trimmed 57199 records to 38999 (keeping 150 days of data) [2025-09-15T18:36:36.458909] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-09-15T18:36:36.635498] [DEBUG] [LOCAL ] GENI: Primary data saved (38999 records). [2025-09-15T18:36:36.635659] [INFO ] [MAIN ] GENI: Full history saved. [2025-09-15T18:36:36.637690] [INFO ] [MAIN ] Update Progress: 913/2369 symbols completed. GENI took 21.6s. Estimated remaining: 2h 33m 59s. Rate: 9.5 symbols/min [2025-09-15T18:36:36.807617] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:36:36.850047] [DEBUG] [LOCAL ] GEV: Loaded 39972 existing records from primary storage. [2025-09-15T18:36:36.850216] [INFO ] [MAIN ] GEV: Loaded 39972 existing records. [2025-09-15T18:36:37.029113] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:36:37.029384] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-09-15T18:36:37.029433] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-09-15T18:36:37.030280] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-09-15T18:36:37.030331] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-09-15T18:36:37.266820] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-09-15T18:36:37.384237] [INFO ] [REMOTE ] GEV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:36:37.416274] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-15T18:36:38.057858] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-09-15T18:36:38.447635] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-15T18:36:38.664355] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T18:36:38.857878] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-09-15T18:36:39.657881] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-09-15T18:36:40.208429] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-15T18:36:40.239276] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T18:36:40.457873] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-09-15T18:36:41.263239] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-09-15T18:36:41.265073] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-15T18:36:41.271014] [INFO ] [REMOTE ] GEO: Full fetch complete (56865 records). [2025-09-15T18:36:41.271103] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-09-15T18:36:41.658495] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-09-15T18:36:41.658579] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-09-15T18:36:41.659334] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-09-15T18:36:41.659380] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-09-15T18:36:41.660571] [DEBUG] [LOCAL ] GEO: Trimmed 56865 records to 38450 (keeping 150 days of data) [2025-09-15T18:36:41.898162] [DEBUG] [LOCAL ] GEO: Primary data saved (38450 records). [2025-09-15T18:36:41.898320] [INFO ] [MAIN ] GEO: Full history saved. [2025-09-15T18:36:41.899088] [INFO ] [MAIN ] Update Progress: 914/2369 symbols completed. GEO took 25.7s. Estimated remaining: 2h 33m 51s. Rate: 9.5 symbols/min [2025-09-15T18:36:42.062739] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-09-15T18:36:42.082037] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:36:42.086401] [DEBUG] [LOCAL ] GF: Loaded 2145 existing records from primary storage. [2025-09-15T18:36:42.086496] [INFO ] [MAIN ] GF: Loaded 2145 existing records. [2025-09-15T18:36:42.266820] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:36:42.267163] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-09-15T18:36:42.267248] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-09-15T18:36:42.267481] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-09-15T18:36:42.267531] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-09-15T18:36:42.628805] [INFO ] [REMOTE ] GF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:36:42.662477] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-15T18:36:42.803384] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-15T18:36:42.857925] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-09-15T18:36:43.657895] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-09-15T18:36:43.831467] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-15T18:36:44.338536] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-15T18:36:44.457884] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-09-15T18:36:45.072240] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-15T18:36:45.257875] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-09-15T18:36:45.892924] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-15T18:36:46.057918] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-09-15T18:36:46.844922] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-15T18:36:46.857816] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-09-15T18:36:47.398752] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-15T18:36:47.546188] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-15T18:36:47.657870] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-09-15T18:36:48.457879] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-09-15T18:36:49.257876] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-09-15T18:36:49.613467] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-15T18:36:49.849394] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-15T18:36:49.915860] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T18:36:50.057834] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-09-15T18:36:50.857886] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-09-15T18:36:51.120297] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-15T18:36:51.657892] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-09-15T18:36:52.334110] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-15T18:36:52.457921] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-09-15T18:36:53.257970] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-09-15T18:36:53.261093] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-15T18:36:54.066452] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-09-15T18:36:54.068819] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T18:36:54.197511] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T18:36:54.494846] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-15T18:36:54.857878] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-09-15T18:36:55.657892] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-09-15T18:36:56.060909] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-15T18:36:56.457837] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-09-15T18:36:56.950486] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-15T18:36:57.257838] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-09-15T18:36:57.468073] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T18:36:58.057925] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-09-15T18:36:58.488454] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T18:36:58.598005] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-15T18:36:58.598792] [INFO ] [REMOTE ] GF: Full fetch complete (4019 records). [2025-09-15T18:36:58.598860] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-09-15T18:36:58.862948] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-09-15T18:36:58.955244] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-09-15T18:36:58.955333] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-09-15T18:36:58.955493] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-09-15T18:36:58.955542] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-09-15T18:36:58.955936] [DEBUG] [LOCAL ] GF: Trimmed 4019 records to 2108 (keeping 150 days of data) [2025-09-15T18:36:58.969268] [DEBUG] [LOCAL ] GF: Primary data saved (2108 records). [2025-09-15T18:36:58.969336] [INFO ] [MAIN ] GF: Full history saved. [2025-09-15T18:36:58.969411] [INFO ] [MAIN ] Update Progress: 915/2369 symbols completed. GF took 17.1s. Estimated remaining: 2h 34m 1s. Rate: 9.4 symbols/min [2025-09-15T18:36:59.135326] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:36:59.161068] [DEBUG] [LOCAL ] GFF: Loaded 22815 existing records from primary storage. [2025-09-15T18:36:59.161222] [INFO ] [MAIN ] GFF: Loaded 22815 existing records. [2025-09-15T18:36:59.343970] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:36:59.344260] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-09-15T18:36:59.344314] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-09-15T18:36:59.344871] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-09-15T18:36:59.344936] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-09-15T18:36:59.672998] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-09-15T18:36:59.712310] [INFO ] [REMOTE ] GFF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:37:00.395991] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T18:37:00.402517] [INFO ] [REMOTE ] GES: Full fetch complete (44503 records). [2025-09-15T18:37:00.402655] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-09-15T18:37:00.464888] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-09-15T18:37:00.777297] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-09-15T18:37:00.777389] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-09-15T18:37:00.778217] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-09-15T18:37:00.778459] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-09-15T18:37:00.780964] [DEBUG] [LOCAL ] GES: Trimmed 44503 records to 28051 (keeping 150 days of data) [2025-09-15T18:37:00.897666] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-15T18:37:00.904986] [INFO ] [REMOTE ] GETY: Full fetch complete (40606 records). [2025-09-15T18:37:00.905367] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-09-15T18:37:01.274734] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-09-15T18:37:01.364487] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-09-15T18:37:01.367062] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-09-15T18:37:01.370555] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-09-15T18:37:01.373350] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-09-15T18:37:01.377797] [DEBUG] [LOCAL ] GES: Primary data saved (28051 records). [2025-09-15T18:37:01.377984] [INFO ] [MAIN ] GES: Full history saved. [2025-09-15T18:37:01.378124] [INFO ] [MAIN ] Update Progress: 916/2369 symbols completed. GES took 32.2s. Estimated remaining: 2h 33m 49s. Rate: 9.4 symbols/min [2025-09-15T18:37:01.423816] [DEBUG] [LOCAL ] GETY: Trimmed 40606 records to 25721 (keeping 150 days of data) [2025-09-15T18:37:01.647786] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:37:01.740045] [DEBUG] [LOCAL ] GFI: Loaded 39887 existing records from primary storage. [2025-09-15T18:37:01.741891] [INFO ] [MAIN ] GFI: Loaded 39887 existing records. [2025-09-15T18:37:01.831962] [DEBUG] [LOCAL ] GETY: Primary data saved (25721 records). [2025-09-15T18:37:01.853624] [INFO ] [MAIN ] GETY: Full history saved. [2025-09-15T18:37:01.853946] [INFO ] [MAIN ] Update Progress: 917/2369 symbols completed. GETY took 30.5s. Estimated remaining: 2h 33m 33s. Rate: 9.5 symbols/min [2025-09-15T18:37:01.931865] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:37:01.932149] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-09-15T18:37:01.932195] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-09-15T18:37:01.933061] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-09-15T18:37:01.933112] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-09-15T18:37:02.296132] [INFO ] [REMOTE ] GFI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:37:02.296492] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-09-15T18:37:02.695023] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-15T18:37:02.702354] [INFO ] [REMOTE ] GEV: Full fetch complete (57821 records). [2025-09-15T18:37:02.702506] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-09-15T18:37:03.131012] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-09-15T18:37:03.131094] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-09-15T18:37:03.131922] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-09-15T18:37:03.131968] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-09-15T18:37:03.134221] [DEBUG] [LOCAL ] GEV: Trimmed 57821 records to 39188 (keeping 150 days of data) [2025-09-15T18:37:03.387529] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-15T18:37:03.395989] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-09-15T18:37:03.425456] [DEBUG] [LOCAL ] GEV: Primary data saved (39188 records). [2025-09-15T18:37:03.425722] [INFO ] [MAIN ] GEV: Full history saved. [2025-09-15T18:37:03.426729] [INFO ] [MAIN ] Update Progress: 918/2369 symbols completed. GEV took 26.8s. Estimated remaining: 2h 33m 19s. Rate: 9.5 symbols/min [2025-09-15T18:37:03.793921] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-15T18:37:03.804700] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-09-15T18:37:04.547778] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-15T18:37:04.557824] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-09-15T18:37:05.848228] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-15T18:37:05.859670] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-09-15T18:37:06.001787] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-15T18:37:06.057886] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-09-15T18:37:07.291118] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-15T18:37:07.298554] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-09-15T18:37:08.086488] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-15T18:37:08.098978] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-09-15T18:37:08.137314] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-15T18:37:08.457941] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-09-15T18:37:09.654594] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-15T18:37:09.662019] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-09-15T18:37:09.767113] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-15T18:37:10.057934] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-09-15T18:37:10.535733] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-15T18:37:10.857931] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-09-15T18:37:11.819723] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-15T18:37:11.831559] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-09-15T18:37:12.070682] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-15T18:37:12.074412] [INFO ] [REMOTE ] GFF: Full fetch complete (33957 records). [2025-09-15T18:37:12.074498] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-09-15T18:37:12.453884] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-09-15T18:37:12.454018] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-09-15T18:37:12.454750] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-09-15T18:37:12.454807] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-09-15T18:37:12.455737] [DEBUG] [LOCAL ] GFF: Trimmed 33957 records to 22267 (keeping 150 days of data) [2025-09-15T18:37:12.601592] [DEBUG] [LOCAL ] GFF: Primary data saved (22267 records). [2025-09-15T18:37:12.601753] [INFO ] [MAIN ] GFF: Full history saved. [2025-09-15T18:37:12.601856] [INFO ] [MAIN ] Update Progress: 919/2369 symbols completed. GFF took 13.6s. Estimated remaining: 2h 33m 17s. Rate: 9.5 symbols/min [2025-09-15T18:37:13.873726] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-15T18:37:13.885444] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-09-15T18:37:15.426163] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-15T18:37:15.437564] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-09-15T18:37:17.325663] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-15T18:37:17.332601] [INFO ] [REMOTE ] GFI: Full fetch complete (57718 records). [2025-09-15T18:37:17.332729] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-09-15T18:37:17.759697] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-09-15T18:37:17.759813] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-09-15T18:37:17.760716] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-09-15T18:37:17.760777] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-09-15T18:37:17.762183] [DEBUG] [LOCAL ] GFI: Trimmed 57718 records to 39110 (keeping 150 days of data) [2025-09-15T18:37:18.017036] [DEBUG] [LOCAL ] GFI: Primary data saved (39110 records). [2025-09-15T18:37:18.017197] [INFO ] [MAIN ] GFI: Full history saved. [2025-09-15T18:37:18.017943] [INFO ] [MAIN ] Update Progress: 920/2369 symbols completed. GFI took 16.6s. Estimated remaining: 2h 33m 10s. Rate: 9.5 symbols/min [2025-09-15T18:37:18.619326] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:37:18.731483] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:37:18.749827] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:37:18.768384] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:37:18.789356] [DEBUG] [LOCAL ] GFR: Loaded 5201 existing records from primary storage. [2025-09-15T18:37:18.789529] [INFO ] [MAIN ] GFR: Loaded 5201 existing records. [2025-09-15T18:37:18.911880] [DEBUG] [LOCAL ] GGG: Loaded 30224 existing records from primary storage. [2025-09-15T18:37:18.951882] [INFO ] [MAIN ] GGG: Loaded 30224 existing records. [2025-09-15T18:37:18.998042] [DEBUG] [LOCAL ] GGB: Loaded 38585 existing records from primary storage. [2025-09-15T18:37:19.052805] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:37:19.058084] [INFO ] [MAIN ] GGB: Loaded 38585 existing records. [2025-09-15T18:37:19.108445] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-09-15T18:37:19.161954] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-09-15T18:37:19.181831] [DEBUG] [LOCAL ] GFL: Loaded 35480 existing records from primary storage. [2025-09-15T18:37:19.230199] [INFO ] [MAIN ] GFL: Loaded 35480 existing records. [2025-09-15T18:37:19.230022] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-09-15T18:37:19.330216] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-09-15T18:37:19.575028] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:37:19.556455] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:37:19.600618] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-09-15T18:37:19.631704] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-09-15T18:37:19.649060] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-09-15T18:37:19.670159] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-09-15T18:37:19.695764] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-09-15T18:37:19.730490] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-09-15T18:37:19.730558] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-09-15T18:37:19.768715] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-09-15T18:37:19.795879] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:37:19.860953] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-09-15T18:37:20.026458] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-09-15T18:37:20.052989] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-09-15T18:37:20.080619] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-09-15T18:37:20.509310] [INFO ] [REMOTE ] GFR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:37:20.578472] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-09-15T18:37:21.024608] [INFO ] [REMOTE ] GGG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:37:21.047411] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-09-15T18:37:21.051155] [INFO ] [REMOTE ] GGB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:37:21.052598] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-09-15T18:37:21.136557] [INFO ] [REMOTE ] GFL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:37:21.137303] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-09-15T18:37:21.720432] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-15T18:37:21.722729] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-09-15T18:37:22.532990] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-15T18:37:22.536356] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-09-15T18:37:22.636731] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-15T18:37:22.644895] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-09-15T18:37:22.758869] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-15T18:37:22.769234] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-09-15T18:37:22.843453] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-15T18:37:22.852952] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-09-15T18:37:23.002408] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-15T18:37:23.006038] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-09-15T18:37:23.738935] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-15T18:37:23.742152] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-09-15T18:37:23.930687] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-15T18:37:23.941581] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-09-15T18:37:24.139863] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-15T18:37:24.148827] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-09-15T18:37:24.212182] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-15T18:37:24.457882] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-09-15T18:37:24.571139] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-15T18:37:24.932602] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-15T18:37:25.257880] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-09-15T18:37:25.653318] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-15T18:37:25.733540] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T18:37:25.786730] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-15T18:37:26.057890] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-09-15T18:37:26.677156] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T18:37:26.678225] [INFO ] [REMOTE ] GFR: Full fetch complete (9135 records). [2025-09-15T18:37:26.678296] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-09-15T18:37:26.862992] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-09-15T18:37:27.035190] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-09-15T18:37:27.035271] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-09-15T18:37:27.035526] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-09-15T18:37:27.035580] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-09-15T18:37:27.036033] [DEBUG] [LOCAL ] GFR: Trimmed 9135 records to 5085 (keeping 150 days of data) [2025-09-15T18:37:27.066846] [DEBUG] [LOCAL ] GFR: Primary data saved (5085 records). [2025-09-15T18:37:27.066973] [INFO ] [MAIN ] GFR: Full history saved. [2025-09-15T18:37:27.067077] [INFO ] [MAIN ] Update Progress: 921/2369 symbols completed. GFR took 9.0s. Estimated remaining: 2h 33m 8s. Rate: 9.5 symbols/min [2025-09-15T18:37:27.233580] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:37:27.245039] [DEBUG] [LOCAL ] GGT: Loaded 11004 existing records from primary storage. [2025-09-15T18:37:27.245169] [INFO ] [MAIN ] GGT: Loaded 11004 existing records. [2025-09-15T18:37:27.420217] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:37:27.420517] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-09-15T18:37:27.420564] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-09-15T18:37:27.420952] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-09-15T18:37:27.421001] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-09-15T18:37:27.668902] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-09-15T18:37:27.789323] [INFO ] [REMOTE ] GGT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:37:28.457886] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-09-15T18:37:28.714120] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-15T18:37:29.087212] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-15T18:37:29.223165] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T18:37:29.257818] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-09-15T18:37:30.057874] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-09-15T18:37:30.860161] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-09-15T18:37:30.862696] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-15T18:37:31.125015] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-15T18:37:31.653808] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-15T18:37:31.657803] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-09-15T18:37:32.171760] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-15T18:37:32.457865] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-09-15T18:37:33.257875] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-09-15T18:37:34.057944] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-09-15T18:37:34.523123] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-15T18:37:34.857921] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-09-15T18:37:34.898966] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-15T18:37:35.664111] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-09-15T18:37:35.680800] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-15T18:37:35.983189] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T18:37:36.457944] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-09-15T18:37:36.833977] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-15T18:37:37.257885] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-09-15T18:37:37.572242] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-15T18:37:38.057904] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-09-15T18:37:38.772406] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-15T18:37:38.857839] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-09-15T18:37:38.873826] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-15T18:37:38.879928] [INFO ] [REMOTE ] GGB: Full fetch complete (55446 records). [2025-09-15T18:37:38.880067] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-09-15T18:37:39.261008] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-09-15T18:37:39.261093] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-09-15T18:37:39.261845] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-09-15T18:37:39.261890] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-09-15T18:37:39.263105] [DEBUG] [LOCAL ] GGB: Trimmed 55446 records to 37887 (keeping 150 days of data) [2025-09-15T18:37:39.489618] [DEBUG] [LOCAL ] GGB: Primary data saved (37887 records). [2025-09-15T18:37:39.489787] [INFO ] [MAIN ] GGB: Full history saved. [2025-09-15T18:37:39.489878] [INFO ] [MAIN ] Update Progress: 922/2369 symbols completed. GGB took 21.5s. Estimated remaining: 2h 33m 11s. Rate: 9.4 symbols/min [2025-09-15T18:37:39.664427] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:37:39.664566] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-09-15T18:37:39.670061] [DEBUG] [LOCAL ] GGZ: Loaded 1716 existing records from primary storage. [2025-09-15T18:37:39.670182] [INFO ] [MAIN ] GGZ: Loaded 1716 existing records. [2025-09-15T18:37:39.856553] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:37:39.856917] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-09-15T18:37:39.856975] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-09-15T18:37:39.857216] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-09-15T18:37:39.857286] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-09-15T18:37:40.008259] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-15T18:37:40.244611] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:37:40.457890] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-09-15T18:37:40.761458] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-15T18:37:41.174730] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-15T18:37:41.257879] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-09-15T18:37:41.826526] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-15T18:37:42.057903] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-09-15T18:37:42.857883] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-09-15T18:37:43.403222] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T18:37:43.502439] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-15T18:37:43.657931] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-09-15T18:37:44.457869] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-09-15T18:37:45.265770] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-09-15T18:37:45.271061] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T18:37:45.350730] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-15T18:37:45.352907] [INFO ] [REMOTE ] GGT: Full fetch complete (14928 records). [2025-09-15T18:37:45.352976] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-09-15T18:37:45.712367] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-09-15T18:37:45.712456] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-09-15T18:37:45.712797] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-09-15T18:37:45.712842] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-09-15T18:37:45.713361] [DEBUG] [LOCAL ] GGT: Trimmed 14928 records to 11031 (keeping 150 days of data) [2025-09-15T18:37:45.778363] [DEBUG] [LOCAL ] GGT: Primary data saved (11031 records). [2025-09-15T18:37:45.778496] [INFO ] [MAIN ] GGT: Full history saved. [2025-09-15T18:37:45.778579] [INFO ] [MAIN ] Update Progress: 923/2369 symbols completed. GGT took 18.7s. Estimated remaining: 2h 33m 4s. Rate: 9.4 symbols/min [2025-09-15T18:37:45.950672] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:37:45.954575] [DEBUG] [LOCAL ] GHC: Loaded 2078 existing records from primary storage. [2025-09-15T18:37:45.954676] [INFO ] [MAIN ] GHC: Loaded 2078 existing records. [2025-09-15T18:37:46.057847] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-09-15T18:37:46.136395] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:37:46.136684] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-09-15T18:37:46.136759] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-09-15T18:37:46.136934] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-09-15T18:37:46.136977] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-09-15T18:37:46.501515] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-15T18:37:46.506798] [INFO ] [REMOTE ] GHC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:37:46.519016] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-15T18:37:46.523049] [INFO ] [REMOTE ] GGG: Full fetch complete (44520 records). [2025-09-15T18:37:46.523132] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-09-15T18:37:46.861022] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-09-15T18:37:46.894799] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-09-15T18:37:46.894871] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-09-15T18:37:46.895532] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-09-15T18:37:46.895573] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-09-15T18:37:46.896567] [DEBUG] [LOCAL ] GGG: Trimmed 44520 records to 29577 (keeping 150 days of data) [2025-09-15T18:37:47.087081] [DEBUG] [LOCAL ] GGG: Primary data saved (29577 records). [2025-09-15T18:37:47.087223] [INFO ] [MAIN ] GGG: Full history saved. [2025-09-15T18:37:47.087309] [INFO ] [MAIN ] Update Progress: 924/2369 symbols completed. GGG took 29.1s. Estimated remaining: 2h 32m 50s. Rate: 9.5 symbols/min [2025-09-15T18:37:47.256431] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:37:47.260496] [DEBUG] [LOCAL ] GHG: Loaded 2514 existing records from primary storage. [2025-09-15T18:37:47.260580] [INFO ] [MAIN ] GHG: Loaded 2514 existing records. [2025-09-15T18:37:47.436520] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:37:47.436903] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-09-15T18:37:47.436971] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-09-15T18:37:47.437307] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-09-15T18:37:47.437376] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-09-15T18:37:47.663465] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-09-15T18:37:47.806523] [INFO ] [REMOTE ] GHG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:37:48.112697] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-15T18:37:48.457903] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-09-15T18:37:49.097791] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-15T18:37:49.257887] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-09-15T18:37:49.317296] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-15T18:37:49.322712] [INFO ] [REMOTE ] GFL: Full fetch complete (52361 records). [2025-09-15T18:37:49.322841] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-09-15T18:37:49.707384] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-09-15T18:37:49.707473] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-09-15T18:37:49.708239] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-09-15T18:37:49.708285] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-09-15T18:37:49.709339] [DEBUG] [LOCAL ] GFL: Trimmed 52361 records to 34741 (keeping 150 days of data) [2025-09-15T18:37:49.804852] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-15T18:37:49.925212] [DEBUG] [LOCAL ] GFL: Primary data saved (34741 records). [2025-09-15T18:37:49.925362] [INFO ] [MAIN ] GFL: Full history saved. [2025-09-15T18:37:49.925450] [INFO ] [MAIN ] Update Progress: 925/2369 symbols completed. GFL took 31.9s. Estimated remaining: 2h 32m 38s. Rate: 9.5 symbols/min [2025-09-15T18:37:50.063013] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-09-15T18:37:50.109032] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:37:50.116239] [DEBUG] [LOCAL ] GHI: Loaded 5287 existing records from primary storage. [2025-09-15T18:37:50.116836] [INFO ] [MAIN ] GHI: Loaded 5287 existing records. [2025-09-15T18:37:50.291048] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:37:50.291345] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-09-15T18:37:50.291401] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-09-15T18:37:50.291729] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-09-15T18:37:50.291777] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-09-15T18:37:50.636853] [INFO ] [REMOTE ] GHI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:37:50.650934] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-15T18:37:50.857916] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-09-15T18:37:51.657978] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-09-15T18:37:51.898857] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-15T18:37:52.204605] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-15T18:37:52.457900] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-09-15T18:37:52.832516] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-15T18:37:53.257891] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-09-15T18:37:53.890894] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-15T18:37:54.057896] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-09-15T18:37:54.770895] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-15T18:37:54.857894] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-09-15T18:37:55.650112] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-15T18:37:55.657826] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-09-15T18:37:56.273481] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-15T18:37:56.457925] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-09-15T18:37:56.924661] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-15T18:37:57.257884] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-09-15T18:37:57.683316] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-15T18:37:58.057880] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-09-15T18:37:58.678744] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-15T18:37:58.857873] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-09-15T18:37:59.636561] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-15T18:37:59.657823] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-09-15T18:38:00.207757] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-15T18:38:00.458000] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-09-15T18:38:00.925503] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-15T18:38:01.257893] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-09-15T18:38:01.741820] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-15T18:38:02.057891] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-09-15T18:38:02.633879] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-15T18:38:02.634879] [INFO ] [REMOTE ] GGZ: Full fetch complete (2732 records). [2025-09-15T18:38:02.634956] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-09-15T18:38:02.863984] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-09-15T18:38:02.992214] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-09-15T18:38:02.992304] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-09-15T18:38:02.992411] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-09-15T18:38:02.992451] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-09-15T18:38:02.992909] [DEBUG] [LOCAL ] GGZ: Trimmed 2732 records to 1696 (keeping 150 days of data) [2025-09-15T18:38:03.004453] [DEBUG] [LOCAL ] GGZ: Primary data saved (1696 records). [2025-09-15T18:38:03.004603] [INFO ] [MAIN ] GGZ: Full history saved. [2025-09-15T18:38:03.004735] [INFO ] [MAIN ] Update Progress: 926/2369 symbols completed. GGZ took 23.5s. Estimated remaining: 2h 32m 42s. Rate: 9.4 symbols/min [2025-09-15T18:38:03.179868] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:38:03.184846] [DEBUG] [LOCAL ] GHLD: Loaded 3308 existing records from primary storage. [2025-09-15T18:38:03.184929] [INFO ] [MAIN ] GHLD: Loaded 3308 existing records. [2025-09-15T18:38:03.361181] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:38:03.361474] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-09-15T18:38:03.361529] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-09-15T18:38:03.361901] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-09-15T18:38:03.361949] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-09-15T18:38:03.587772] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-15T18:38:03.662998] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-09-15T18:38:03.726351] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:38:04.219338] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-15T18:38:04.457878] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-09-15T18:38:04.876898] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-15T18:38:05.257941] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-09-15T18:38:05.696308] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-15T18:38:06.057885] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-09-15T18:38:06.512046] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-15T18:38:06.857899] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-09-15T18:38:07.657914] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-09-15T18:38:07.727713] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-15T18:38:08.128698] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-15T18:38:08.457866] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-09-15T18:38:09.200943] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-15T18:38:09.257879] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-09-15T18:38:09.783070] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-15T18:38:10.057933] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-09-15T18:38:10.358494] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-15T18:38:10.857873] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-09-15T18:38:11.627937] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T18:38:11.629278] [INFO ] [REMOTE ] GHI: Full fetch complete (7578 records). [2025-09-15T18:38:11.629362] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-09-15T18:38:11.662993] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-09-15T18:38:12.055594] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-09-15T18:38:12.055706] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-09-15T18:38:12.055928] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-09-15T18:38:12.055970] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-09-15T18:38:12.056395] [DEBUG] [LOCAL ] GHI: Trimmed 7578 records to 5230 (keeping 150 days of data) [2025-09-15T18:38:12.088180] [DEBUG] [LOCAL ] GHI: Primary data saved (5230 records). [2025-09-15T18:38:12.088256] [INFO ] [MAIN ] GHI: Full history saved. [2025-09-15T18:38:12.088333] [INFO ] [MAIN ] Update Progress: 927/2369 symbols completed. GHI took 22.2s. Estimated remaining: 2h 32m 40s. Rate: 9.4 symbols/min [2025-09-15T18:38:12.253216] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-15T18:38:12.261375] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:38:12.273906] [DEBUG] [LOCAL ] GHM: Loaded 10444 existing records from primary storage. [2025-09-15T18:38:12.273997] [INFO ] [MAIN ] GHM: Loaded 10444 existing records. [2025-09-15T18:38:12.451976] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:38:12.452285] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-09-15T18:38:12.452332] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-09-15T18:38:12.452764] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-09-15T18:38:12.452813] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-09-15T18:38:12.463519] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-09-15T18:38:12.803057] [INFO ] [REMOTE ] GHM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:38:12.996480] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-15T18:38:13.257868] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-09-15T18:38:14.057889] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-09-15T18:38:14.410822] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-15T18:38:14.812827] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-15T18:38:14.813729] [INFO ] [REMOTE ] GHC: Full fetch complete (2693 records). [2025-09-15T18:38:14.813799] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-09-15T18:38:14.866747] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-09-15T18:38:15.172993] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-09-15T18:38:15.173076] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-09-15T18:38:15.173180] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-09-15T18:38:15.173219] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-09-15T18:38:15.173566] [DEBUG] [LOCAL ] GHC: Trimmed 2693 records to 2054 (keeping 150 days of data) [2025-09-15T18:38:15.187152] [DEBUG] [LOCAL ] GHC: Primary data saved (2054 records). [2025-09-15T18:38:15.187217] [INFO ] [MAIN ] GHC: Full history saved. [2025-09-15T18:38:15.187287] [INFO ] [MAIN ] Update Progress: 928/2369 symbols completed. GHC took 29.4s. Estimated remaining: 2h 32m 29s. Rate: 9.5 symbols/min [2025-09-15T18:38:15.362886] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:38:15.379673] [DEBUG] [LOCAL ] GHY: Loaded 15424 existing records from primary storage. [2025-09-15T18:38:15.379812] [INFO ] [MAIN ] GHY: Loaded 15424 existing records. [2025-09-15T18:38:15.553897] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:38:15.554174] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-09-15T18:38:15.554232] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-09-15T18:38:15.554750] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-09-15T18:38:15.554800] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-09-15T18:38:15.656879] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-15T18:38:15.662328] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-09-15T18:38:15.707892] [INFO ] [REMOTE ] GHG: Full fetch complete (3332 records). [2025-09-15T18:38:15.715800] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-09-15T18:38:15.732225] [FATAL] [VALIDATOR ] GHG: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:38:15.741389] [FATAL] [MAIN ] GHG: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:38:15.773268] [WARN ] [MAIN ] GHG: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:38:15.813490] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-09-15T18:38:15.843015] [DEBUG] [LOCAL ] GHG: No primary data file found to delete. [2025-09-15T18:38:15.843357] [INFO ] [LOCAL ] GHG: Starting deletion of derivative data. [2025-09-15T18:38:15.884330] [DEBUG] [LOCAL ] GHG: Deleted derivative data file. [2025-09-15T18:38:15.902601] [INFO ] [MAIN ] Update Progress: 929/2369 symbols completed. GHG took 28.8s. Estimated remaining: 2h 32m 14s. Rate: 9.5 symbols/min [2025-09-15T18:38:15.957608] [INFO ] [REMOTE ] GHY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:38:16.099552] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:38:16.122088] [DEBUG] [LOCAL ] GIB: Loaded 23149 existing records from primary storage. [2025-09-15T18:38:16.122232] [INFO ] [MAIN ] GIB: Loaded 23149 existing records. [2025-09-15T18:38:16.299671] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:38:16.299905] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-09-15T18:38:16.299950] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-09-15T18:38:16.300582] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-09-15T18:38:16.300637] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-09-15T18:38:16.411503] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-15T18:38:16.465794] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-09-15T18:38:16.681096] [INFO ] [REMOTE ] GIB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:38:17.154722] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-15T18:38:17.257912] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-09-15T18:38:18.057926] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-09-15T18:38:18.494599] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T18:38:18.673558] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-15T18:38:18.857897] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-09-15T18:38:19.657888] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-09-15T18:38:19.855458] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-15T18:38:20.405119] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-15T18:38:20.457890] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-09-15T18:38:21.132674] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-15T18:38:21.257841] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-09-15T18:38:21.830573] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-15T18:38:21.831761] [INFO ] [REMOTE ] GHLD: Full fetch complete (4052 records). [2025-09-15T18:38:21.831829] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-09-15T18:38:22.067446] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-09-15T18:38:22.185102] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-09-15T18:38:22.185189] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-09-15T18:38:22.185313] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-09-15T18:38:22.185352] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-09-15T18:38:22.185744] [DEBUG] [LOCAL ] GHLD: Trimmed 4052 records to 3305 (keeping 150 days of data) [2025-09-15T18:38:22.208102] [DEBUG] [LOCAL ] GHLD: Primary data saved (3305 records). [2025-09-15T18:38:22.208217] [INFO ] [MAIN ] GHLD: Full history saved. [2025-09-15T18:38:22.208319] [INFO ] [MAIN ] Update Progress: 930/2369 symbols completed. GHLD took 19.2s. Estimated remaining: 2h 32m 7s. Rate: 9.5 symbols/min [2025-09-15T18:38:22.377338] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:38:22.388596] [DEBUG] [LOCAL ] GIC: Loaded 10183 existing records from primary storage. [2025-09-15T18:38:22.388731] [INFO ] [MAIN ] GIC: Loaded 10183 existing records. [2025-09-15T18:38:22.567703] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:38:22.567988] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-09-15T18:38:22.568037] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-09-15T18:38:22.568446] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-09-15T18:38:22.568497] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-09-15T18:38:22.863325] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-09-15T18:38:22.946006] [INFO ] [REMOTE ] GIC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:38:22.969632] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-15T18:38:23.657926] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-09-15T18:38:24.357165] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-15T18:38:24.457870] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-09-15T18:38:24.622683] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-15T18:38:25.257874] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-09-15T18:38:25.616477] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-15T18:38:26.057882] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-09-15T18:38:26.238120] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-15T18:38:26.857893] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-09-15T18:38:27.514781] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T18:38:27.555840] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T18:38:27.657901] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-09-15T18:38:28.457875] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-09-15T18:38:28.875578] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-15T18:38:29.257870] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-09-15T18:38:29.706496] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-15T18:38:30.057868] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-09-15T18:38:30.523112] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-15T18:38:30.857850] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-09-15T18:38:31.102425] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-15T18:38:31.567144] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-15T18:38:31.657882] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-09-15T18:38:32.457912] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-09-15T18:38:32.629414] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-15T18:38:32.632011] [INFO ] [REMOTE ] GHY: Full fetch complete (23051 records). [2025-09-15T18:38:32.632108] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-09-15T18:38:33.015221] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-09-15T18:38:33.015340] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-09-15T18:38:33.016132] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-09-15T18:38:33.016195] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-09-15T18:38:33.017339] [DEBUG] [LOCAL ] GHY: Trimmed 23051 records to 14869 (keeping 150 days of data) [2025-09-15T18:38:33.120497] [DEBUG] [LOCAL ] GHY: Primary data saved (14869 records). [2025-09-15T18:38:33.120743] [INFO ] [MAIN ] GHY: Full history saved. [2025-09-15T18:38:33.120858] [INFO ] [MAIN ] Update Progress: 931/2369 symbols completed. GHY took 17.9s. Estimated remaining: 2h 32m 8s. Rate: 9.5 symbols/min [2025-09-15T18:38:33.271462] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-09-15T18:38:33.306728] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:38:33.349140] [DEBUG] [LOCAL ] GIL: Loaded 32288 existing records from primary storage. [2025-09-15T18:38:33.349371] [INFO ] [MAIN ] GIL: Loaded 32288 existing records. [2025-09-15T18:38:33.540172] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:38:33.540727] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-09-15T18:38:33.540803] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-09-15T18:38:33.547501] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-09-15T18:38:33.559102] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-09-15T18:38:33.566733] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-15T18:38:33.934443] [INFO ] [REMOTE ] GIL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:38:34.057901] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-09-15T18:38:34.284208] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-15T18:38:34.857897] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-09-15T18:38:35.528009] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-15T18:38:35.657888] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-09-15T18:38:35.804395] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-15T18:38:36.457911] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-09-15T18:38:37.038427] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T18:38:37.257917] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-09-15T18:38:37.563800] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-15T18:38:38.057892] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-09-15T18:38:38.650728] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-15T18:38:38.857885] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-09-15T18:38:38.978104] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-15T18:38:39.647777] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-15T18:38:39.657816] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-09-15T18:38:40.357528] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-15T18:38:40.457867] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-09-15T18:38:41.257892] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-09-15T18:38:41.399474] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-15T18:38:41.401433] [INFO ] [REMOTE ] GHM: Full fetch complete (16195 records). [2025-09-15T18:38:41.401522] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-09-15T18:38:41.762625] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-09-15T18:38:41.762728] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-09-15T18:38:41.763081] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-09-15T18:38:41.763172] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-09-15T18:38:41.764063] [DEBUG] [LOCAL ] GHM: Trimmed 16195 records to 10420 (keeping 150 days of data) [2025-09-15T18:38:41.829609] [DEBUG] [LOCAL ] GHM: Primary data saved (10420 records). [2025-09-15T18:38:41.829781] [INFO ] [MAIN ] GHM: Full history saved. [2025-09-15T18:38:41.829884] [INFO ] [MAIN ] Update Progress: 932/2369 symbols completed. GHM took 29.7s. Estimated remaining: 2h 32m 5s. Rate: 9.4 symbols/min [2025-09-15T18:38:42.010687] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:38:42.011489] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-15T18:38:42.052519] [DEBUG] [LOCAL ] GIS: Loaded 40420 existing records from primary storage. [2025-09-15T18:38:42.052703] [INFO ] [MAIN ] GIS: Loaded 40420 existing records. [2025-09-15T18:38:42.063566] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-09-15T18:38:42.235717] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:38:42.236012] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-09-15T18:38:42.236069] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-09-15T18:38:42.236927] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-09-15T18:38:42.237003] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-09-15T18:38:42.589266] [INFO ] [REMOTE ] GIS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:38:42.857878] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-09-15T18:38:43.657872] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-09-15T18:38:43.684191] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-15T18:38:44.457889] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-09-15T18:38:44.618017] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-15T18:38:44.796812] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-15T18:38:45.257888] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-09-15T18:38:45.443553] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-15T18:38:46.057883] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-09-15T18:38:46.847819] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-15T18:38:46.849976] [INFO ] [REMOTE ] GIC: Full fetch complete (15028 records). [2025-09-15T18:38:46.850050] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-09-15T18:38:46.850452] [FATAL] [VALIDATOR ] GIC: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:38:46.850527] [FATAL] [MAIN ] GIC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:38:46.850563] [WARN ] [MAIN ] GIC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:38:46.850600] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-09-15T18:38:46.850674] [DEBUG] [LOCAL ] GIC: No primary data file found to delete. [2025-09-15T18:38:46.850714] [INFO ] [LOCAL ] GIC: Starting deletion of derivative data. [2025-09-15T18:38:46.850995] [DEBUG] [LOCAL ] GIC: Deleted derivative data file. [2025-09-15T18:38:46.851071] [INFO ] [MAIN ] Update Progress: 933/2369 symbols completed. GIC took 24.6s. Estimated remaining: 2h 31m 57s. Rate: 9.5 symbols/min [2025-09-15T18:38:46.862986] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-09-15T18:38:47.027523] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:38:47.063837] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-15T18:38:47.096446] [DEBUG] [LOCAL ] GKOS: Loaded 31951 existing records from primary storage. [2025-09-15T18:38:47.096583] [INFO ] [MAIN ] GKOS: Loaded 31951 existing records. [2025-09-15T18:38:47.269157] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:38:47.269425] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-09-15T18:38:47.269470] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-09-15T18:38:47.270235] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-09-15T18:38:47.270292] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-09-15T18:38:47.636098] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:38:47.657820] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-09-15T18:38:48.427841] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-15T18:38:48.457845] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-09-15T18:38:49.006496] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T18:38:49.257876] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-09-15T18:38:49.626758] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-15T18:38:50.057869] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-09-15T18:38:50.254348] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-15T18:38:50.857892] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-09-15T18:38:51.556284] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-15T18:38:51.657900] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-09-15T18:38:51.905173] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-15T18:38:51.908901] [INFO ] [REMOTE ] GIB: Full fetch complete (35481 records). [2025-09-15T18:38:51.908980] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-09-15T18:38:52.278446] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-09-15T18:38:52.278530] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-09-15T18:38:52.279199] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-09-15T18:38:52.279246] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-09-15T18:38:52.280125] [DEBUG] [LOCAL ] GIB: Trimmed 35481 records to 22652 (keeping 150 days of data) [2025-09-15T18:38:52.430266] [DEBUG] [LOCAL ] GIB: Primary data saved (22652 records). [2025-09-15T18:38:52.430444] [INFO ] [MAIN ] GIB: Full history saved. [2025-09-15T18:38:52.430548] [INFO ] [MAIN ] Update Progress: 934/2369 symbols completed. GIB took 36.5s. Estimated remaining: 2h 31m 49s. Rate: 9.5 symbols/min [2025-09-15T18:38:52.465749] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-09-15T18:38:52.614412] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:38:52.645562] [DEBUG] [LOCAL ] GL: Loaded 28207 existing records from primary storage. [2025-09-15T18:38:52.645735] [INFO ] [MAIN ] GL: Loaded 28207 existing records. [2025-09-15T18:38:52.827267] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:38:52.827521] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-09-15T18:38:52.828787] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-09-15T18:38:52.829494] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-09-15T18:38:52.829548] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-09-15T18:38:53.187739] [INFO ] [REMOTE ] GL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:38:53.233240] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-15T18:38:53.238797] [INFO ] [REMOTE ] GIL: Full fetch complete (46580 records). [2025-09-15T18:38:53.238920] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-09-15T18:38:53.262973] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-09-15T18:38:53.633276] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-09-15T18:38:53.633376] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-09-15T18:38:53.634155] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-09-15T18:38:53.634211] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-09-15T18:38:53.635525] [DEBUG] [LOCAL ] GIL: Trimmed 46580 records to 31665 (keeping 150 days of data) [2025-09-15T18:38:53.849849] [DEBUG] [LOCAL ] GIL: Primary data saved (31665 records). [2025-09-15T18:38:53.850004] [INFO ] [MAIN ] GIL: Full history saved. [2025-09-15T18:38:53.850090] [INFO ] [MAIN ] Update Progress: 935/2369 symbols completed. GIL took 20.7s. Estimated remaining: 2h 31m 36s. Rate: 9.5 symbols/min [2025-09-15T18:38:54.029788] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:38:54.057923] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-09-15T18:38:54.071612] [DEBUG] [LOCAL ] GLOB: Loaded 35854 existing records from primary storage. [2025-09-15T18:38:54.071842] [INFO ] [MAIN ] GLOB: Loaded 35854 existing records. [2025-09-15T18:38:54.299204] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-15T18:38:54.304846] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:38:54.316415] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-09-15T18:38:54.316478] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-09-15T18:38:54.317285] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-09-15T18:38:54.317350] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-09-15T18:38:54.681928] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:38:54.820041] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T18:38:54.857907] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-09-15T18:38:55.657889] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-09-15T18:38:55.815605] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-15T18:38:56.273847] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T18:38:56.457899] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-09-15T18:38:57.257853] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-09-15T18:38:57.475114] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-15T18:38:58.034767] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T18:38:58.057825] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-09-15T18:38:58.813729] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T18:38:58.857888] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-09-15T18:38:59.256525] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T18:38:59.657884] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-09-15T18:39:00.288312] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T18:39:00.457875] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-09-15T18:39:01.140036] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T18:39:01.257883] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-09-15T18:39:02.057908] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-09-15T18:39:02.434731] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-15T18:39:02.510974] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-15T18:39:02.857880] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-09-15T18:39:03.657924] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-09-15T18:39:04.293255] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-15T18:39:04.457874] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-09-15T18:39:05.257951] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-09-15T18:39:06.103140] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-15T18:39:06.112080] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-09-15T18:39:06.178796] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (3.32 seconds). [2025-09-15T18:39:06.682424] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-15T18:39:06.857897] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-09-15T18:39:07.198085] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-15T18:39:07.233009] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-15T18:39:07.657889] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-09-15T18:39:08.078043] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-15T18:39:08.457921] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-09-15T18:39:09.257945] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-09-15T18:39:09.550396] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-15T18:39:09.556561] [INFO ] [REMOTE ] GIS: Full fetch complete (58353 records). [2025-09-15T18:39:09.556737] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-09-15T18:39:09.983151] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-09-15T18:39:09.983277] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-09-15T18:39:09.984313] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-09-15T18:39:09.984431] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-09-15T18:39:09.986064] [DEBUG] [LOCAL ] GIS: Trimmed 58353 records to 39641 (keeping 150 days of data) [2025-09-15T18:39:10.069181] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-09-15T18:39:10.204108] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-15T18:39:10.373378] [DEBUG] [LOCAL ] GIS: Primary data saved (39641 records). [2025-09-15T18:39:10.373582] [INFO ] [MAIN ] GIS: Full history saved. [2025-09-15T18:39:10.373765] [INFO ] [MAIN ] Update Progress: 936/2369 symbols completed. GIS took 28.5s. Estimated remaining: 2h 31m 45s. Rate: 9.4 symbols/min [2025-09-15T18:39:10.614501] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:39:10.625525] [DEBUG] [LOCAL ] GLP: Loaded 7000 existing records from primary storage. [2025-09-15T18:39:10.625717] [INFO ] [MAIN ] GLP: Loaded 7000 existing records. [2025-09-15T18:39:10.860559] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-09-15T18:39:10.908900] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:39:10.909927] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-09-15T18:39:10.910004] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-09-15T18:39:10.910364] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-09-15T18:39:10.910416] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-09-15T18:39:11.071381] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-15T18:39:11.352295] [INFO ] [REMOTE ] GLP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:39:11.445254] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-15T18:39:11.657871] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-09-15T18:39:12.083564] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-15T18:39:12.457889] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-09-15T18:39:13.232371] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-15T18:39:13.257861] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-09-15T18:39:13.670787] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T18:39:14.057934] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-09-15T18:39:14.301275] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T18:39:14.305297] [INFO ] [REMOTE ] GL: Full fetch complete (41632 records). [2025-09-15T18:39:14.305424] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-09-15T18:39:14.689595] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-09-15T18:39:14.689728] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-09-15T18:39:14.690392] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-09-15T18:39:14.690438] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-09-15T18:39:14.691574] [DEBUG] [LOCAL ] GL: Trimmed 41632 records to 27677 (keeping 150 days of data) [2025-09-15T18:39:14.861633] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-09-15T18:39:14.875406] [DEBUG] [LOCAL ] GL: Primary data saved (27677 records). [2025-09-15T18:39:14.875482] [INFO ] [MAIN ] GL: Full history saved. [2025-09-15T18:39:14.875574] [INFO ] [MAIN ] Update Progress: 937/2369 symbols completed. GL took 22.4s. Estimated remaining: 2h 31m 36s. Rate: 9.4 symbols/min [2025-09-15T18:39:15.044042] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:39:15.083444] [DEBUG] [LOCAL ] GLW: Loaded 40377 existing records from primary storage. [2025-09-15T18:39:15.083586] [INFO ] [MAIN ] GLW: Loaded 40377 existing records. [2025-09-15T18:39:15.259863] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:39:15.260094] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-09-15T18:39:15.260138] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-09-15T18:39:15.261036] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-09-15T18:39:15.261086] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-09-15T18:39:15.617525] [INFO ] [REMOTE ] GLW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:39:15.632119] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T18:39:15.641769] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-15T18:39:15.647608] [INFO ] [REMOTE ] GKOS: Full fetch complete (46562 records). [2025-09-15T18:39:15.647816] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-09-15T18:39:15.663239] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-09-15T18:39:16.059744] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-09-15T18:39:16.059841] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-09-15T18:39:16.060595] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-09-15T18:39:16.060666] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-09-15T18:39:16.062297] [DEBUG] [LOCAL ] GKOS: Trimmed 46562 records to 31298 (keeping 150 days of data) [2025-09-15T18:39:16.257467] [DEBUG] [LOCAL ] GKOS: Primary data saved (31298 records). [2025-09-15T18:39:16.257626] [INFO ] [MAIN ] GKOS: Full history saved. [2025-09-15T18:39:16.257783] [INFO ] [MAIN ] Update Progress: 938/2369 symbols completed. GKOS took 29.4s. Estimated remaining: 2h 31m 22s. Rate: 9.5 symbols/min [2025-09-15T18:39:16.434663] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:39:16.460199] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-09-15T18:39:16.478253] [DEBUG] [LOCAL ] GM: Loaded 40470 existing records from primary storage. [2025-09-15T18:39:16.478397] [INFO ] [MAIN ] GM: Loaded 40470 existing records. [2025-09-15T18:39:16.651549] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:39:16.651854] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-09-15T18:39:16.651903] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-09-15T18:39:16.652883] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-09-15T18:39:16.652936] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-09-15T18:39:17.052628] [INFO ] [REMOTE ] GM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:39:17.257892] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-09-15T18:39:17.992537] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-15T18:39:18.057939] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-09-15T18:39:18.692014] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (3.03 seconds). [2025-09-15T18:39:18.853029] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-15T18:39:18.857808] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-09-15T18:39:19.604788] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-15T18:39:19.657884] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-09-15T18:39:19.969465] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (2.71 seconds). [2025-09-15T18:39:19.976408] [INFO ] [REMOTE ] GLOB: Full fetch complete (50787 records). [2025-09-15T18:39:19.976607] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-09-15T18:39:20.366078] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-09-15T18:39:20.366206] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-09-15T18:39:20.367312] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-09-15T18:39:20.367361] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-09-15T18:39:20.368854] [DEBUG] [LOCAL ] GLOB: Trimmed 50787 records to 35383 (keeping 150 days of data) [2025-09-15T18:39:20.471046] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-09-15T18:39:20.609284] [DEBUG] [LOCAL ] GLOB: Primary data saved (35383 records). [2025-09-15T18:39:20.609493] [INFO ] [MAIN ] GLOB: Full history saved. [2025-09-15T18:39:20.609609] [INFO ] [MAIN ] Update Progress: 939/2369 symbols completed. GLOB took 26.8s. Estimated remaining: 2h 31m 12s. Rate: 9.5 symbols/min [2025-09-15T18:39:20.807457] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:39:20.851304] [DEBUG] [LOCAL ] GME: Loaded 40527 existing records from primary storage. [2025-09-15T18:39:20.851629] [INFO ] [MAIN ] GME: Loaded 40527 existing records. [2025-09-15T18:39:21.037363] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:39:21.037712] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-09-15T18:39:21.037765] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-09-15T18:39:21.038770] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-09-15T18:39:21.038830] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-09-15T18:39:21.267844] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-09-15T18:39:21.424001] [INFO ] [REMOTE ] GME: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:39:21.482476] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-15T18:39:22.043554] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-15T18:39:22.057841] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-09-15T18:39:22.289529] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-15T18:39:22.857907] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-09-15T18:39:23.657946] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-09-15T18:39:23.877463] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-15T18:39:24.457973] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-09-15T18:39:24.664788] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-15T18:39:25.257885] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-09-15T18:39:25.584036] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-15T18:39:25.694859] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T18:39:26.057894] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-09-15T18:39:26.550996] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-15T18:39:26.857864] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-09-15T18:39:27.258224] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-15T18:39:27.657868] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-09-15T18:39:28.457917] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-09-15T18:39:29.257887] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-09-15T18:39:29.437073] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-15T18:39:29.454395] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-15T18:39:29.986594] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-15T18:39:30.057813] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-09-15T18:39:30.847810] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T18:39:30.858364] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-09-15T18:39:31.657903] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-09-15T18:39:31.747122] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-15T18:39:31.749507] [INFO ] [REMOTE ] GLP: Full fetch complete (10340 records). [2025-09-15T18:39:31.749596] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-09-15T18:39:31.750084] [FATAL] [VALIDATOR ] GLP: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:39:31.750169] [FATAL] [MAIN ] GLP: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:39:31.750206] [WARN ] [MAIN ] GLP: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:39:31.750266] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-09-15T18:39:31.750341] [DEBUG] [LOCAL ] GLP: No primary data file found to delete. [2025-09-15T18:39:31.750379] [INFO ] [LOCAL ] GLP: Starting deletion of derivative data. [2025-09-15T18:39:31.750720] [DEBUG] [LOCAL ] GLP: Deleted derivative data file. [2025-09-15T18:39:31.750808] [INFO ] [MAIN ] Update Progress: 940/2369 symbols completed. GLP took 21.4s. Estimated remaining: 2h 31m 13s. Rate: 9.4 symbols/min [2025-09-15T18:39:31.921335] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:39:31.957627] [DEBUG] [LOCAL ] GMED: Loaded 36187 existing records from primary storage. [2025-09-15T18:39:31.957805] [INFO ] [MAIN ] GMED: Loaded 36187 existing records. [2025-09-15T18:39:32.135814] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:39:32.136064] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-09-15T18:39:32.136111] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-09-15T18:39:32.136872] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-09-15T18:39:32.136922] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-09-15T18:39:32.469043] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-09-15T18:39:32.497546] [INFO ] [REMOTE ] GMED: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:39:32.530769] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-09-15T18:39:33.257918] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-09-15T18:39:33.892688] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-15T18:39:34.057905] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-09-15T18:39:34.421892] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-15T18:39:34.857853] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-09-15T18:39:34.955606] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T18:39:35.657917] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-09-15T18:39:36.444514] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-09-15T18:39:36.466746] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-09-15T18:39:36.486193] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T18:39:37.257906] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-09-15T18:39:37.612275] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-15T18:39:38.057956] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-09-15T18:39:38.845827] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-15T18:39:38.857755] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-09-15T18:39:39.195445] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-15T18:39:39.202102] [INFO ] [REMOTE ] GLW: Full fetch complete (58307 records). [2025-09-15T18:39:39.202286] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-09-15T18:39:39.584094] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-09-15T18:39:39.584193] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-09-15T18:39:39.585115] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-09-15T18:39:39.585170] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-09-15T18:39:39.586554] [DEBUG] [LOCAL ] GLW: Trimmed 58307 records to 39598 (keeping 150 days of data) [2025-09-15T18:39:39.679845] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-09-15T18:39:39.844685] [DEBUG] [LOCAL ] GLW: Primary data saved (39598 records). [2025-09-15T18:39:39.844870] [INFO ] [MAIN ] GLW: Full history saved. [2025-09-15T18:39:39.845602] [INFO ] [MAIN ] Update Progress: 941/2369 symbols completed. GLW took 25.0s. Estimated remaining: 2h 31m 10s. Rate: 9.4 symbols/min [2025-09-15T18:39:40.015326] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:39:40.043849] [DEBUG] [LOCAL ] GMRE: Loaded 28453 existing records from primary storage. [2025-09-15T18:39:40.043997] [INFO ] [MAIN ] GMRE: Loaded 28453 existing records. [2025-09-15T18:39:40.221752] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:39:40.222218] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-09-15T18:39:40.222322] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-09-15T18:39:40.223055] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-09-15T18:39:40.223115] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-09-15T18:39:40.641620] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:39:40.643457] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-09-15T18:39:40.647395] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-09-15T18:39:40.941263] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-15T18:39:41.041660] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-15T18:39:41.257919] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-09-15T18:39:41.823123] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-15T18:39:42.057865] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-09-15T18:39:42.857880] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-09-15T18:39:43.169014] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-15T18:39:43.174947] [INFO ] [REMOTE ] GME: Full fetch complete (58436 records). [2025-09-15T18:39:43.175098] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-09-15T18:39:43.562001] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-09-15T18:39:43.562093] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-09-15T18:39:43.562878] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-09-15T18:39:43.562987] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-09-15T18:39:43.582491] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T18:39:43.582614] [DEBUG] [LOCAL ] GME: Trimmed 58436 records to 39747 (keeping 150 days of data) [2025-09-15T18:39:43.678516] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-09-15T18:39:43.834358] [DEBUG] [LOCAL ] GME: Primary data saved (39747 records). [2025-09-15T18:39:43.834507] [INFO ] [MAIN ] GME: Full history saved. [2025-09-15T18:39:43.835345] [INFO ] [MAIN ] Update Progress: 942/2369 symbols completed. GME took 23.2s. Estimated remaining: 2h 30m 60s. Rate: 9.5 symbols/min [2025-09-15T18:39:44.007327] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:39:44.023495] [DEBUG] [LOCAL ] GNE: Loaded 14647 existing records from primary storage. [2025-09-15T18:39:44.023629] [INFO ] [MAIN ] GNE: Loaded 14647 existing records. [2025-09-15T18:39:44.207978] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:39:44.208259] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-09-15T18:39:44.208353] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-09-15T18:39:44.208856] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-09-15T18:39:44.208908] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-09-15T18:39:44.467435] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-09-15T18:39:44.602532] [INFO ] [REMOTE ] GNE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:39:44.632434] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T18:39:45.053945] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-15T18:39:45.257891] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-09-15T18:39:45.905144] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-15T18:39:46.057874] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-09-15T18:39:46.857891] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-09-15T18:39:46.913090] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T18:39:47.657924] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-09-15T18:39:47.823042] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-15T18:39:48.004426] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-15T18:39:48.010543] [INFO ] [REMOTE ] GM: Full fetch complete (58408 records). [2025-09-15T18:39:48.010690] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-09-15T18:39:48.392576] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-09-15T18:39:48.392678] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-09-15T18:39:48.393514] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-09-15T18:39:48.393558] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-09-15T18:39:48.395137] [DEBUG] [LOCAL ] GM: Trimmed 58408 records to 39689 (keeping 150 days of data) [2025-09-15T18:39:48.459853] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-09-15T18:39:48.656550] [DEBUG] [LOCAL ] GM: Primary data saved (39689 records). [2025-09-15T18:39:48.656720] [INFO ] [MAIN ] GM: Full history saved. [2025-09-15T18:39:48.657468] [INFO ] [MAIN ] Update Progress: 943/2369 symbols completed. GM took 32.4s. Estimated remaining: 2h 30m 51s. Rate: 9.5 symbols/min [2025-09-15T18:39:48.831061] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:39:48.863226] [DEBUG] [LOCAL ] GNK: Loaded 29950 existing records from primary storage. [2025-09-15T18:39:48.863363] [INFO ] [MAIN ] GNK: Loaded 29950 existing records. [2025-09-15T18:39:49.040091] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:39:49.040354] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-09-15T18:39:49.040400] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-09-15T18:39:49.041125] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-09-15T18:39:49.041175] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-09-15T18:39:49.262187] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-09-15T18:39:49.399244] [INFO ] [REMOTE ] GNK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:39:49.431450] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-15T18:39:49.805316] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T18:39:50.057915] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-09-15T18:39:50.121981] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-15T18:39:50.857885] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-09-15T18:39:51.657809] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T18:39:51.657893] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-09-15T18:39:52.034028] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-15T18:39:52.185218] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-15T18:39:52.457860] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-09-15T18:39:53.095537] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-15T18:39:53.257862] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-09-15T18:39:54.057947] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-09-15T18:39:54.857891] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-09-15T18:39:54.903610] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T18:39:55.342845] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T18:39:55.657893] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-09-15T18:39:55.976618] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-15T18:39:56.457920] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-09-15T18:39:57.206167] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T18:39:57.257835] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-09-15T18:39:57.639495] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-15T18:39:58.057899] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-09-15T18:39:58.697907] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-15T18:39:58.857920] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-09-15T18:39:59.269091] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T18:39:59.657895] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-09-15T18:40:00.417800] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T18:40:00.457870] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-09-15T18:40:01.211951] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T18:40:01.257834] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-09-15T18:40:01.820198] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-15T18:40:02.057892] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-09-15T18:40:02.444548] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-15T18:40:02.450722] [INFO ] [REMOTE ] GMRE: Full fetch complete (40042 records). [2025-09-15T18:40:02.450923] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-09-15T18:40:02.451784] [FATAL] [VALIDATOR ] GMRE: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:40:02.451914] [FATAL] [MAIN ] GMRE: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:40:02.451970] [WARN ] [MAIN ] GMRE: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:40:02.452029] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-09-15T18:40:02.452126] [DEBUG] [LOCAL ] GMRE: No primary data file found to delete. [2025-09-15T18:40:02.452183] [INFO ] [LOCAL ] GMRE: Starting deletion of derivative data. [2025-09-15T18:40:02.452594] [DEBUG] [LOCAL ] GMRE: Deleted derivative data file. [2025-09-15T18:40:02.452769] [INFO ] [MAIN ] Update Progress: 944/2369 symbols completed. GMRE took 22.6s. Estimated remaining: 2h 30m 56s. Rate: 9.4 symbols/min [2025-09-15T18:40:02.662736] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:40:02.709140] [DEBUG] [LOCAL ] GNL: Loaded 35163 existing records from primary storage. [2025-09-15T18:40:02.709343] [INFO ] [MAIN ] GNL: Loaded 35163 existing records. [2025-09-15T18:40:02.863368] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-09-15T18:40:02.979951] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:40:02.980452] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-09-15T18:40:02.980530] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-09-15T18:40:02.981699] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-09-15T18:40:02.981793] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-09-15T18:40:03.577828] [INFO ] [REMOTE ] GNL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:40:03.609381] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T18:40:03.657960] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-09-15T18:40:04.218058] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T18:40:04.220626] [INFO ] [REMOTE ] GNE: Full fetch complete (18098 records). [2025-09-15T18:40:04.220745] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-09-15T18:40:04.470121] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-09-15T18:40:04.607588] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-09-15T18:40:04.607691] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-09-15T18:40:04.608141] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-09-15T18:40:04.608190] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-09-15T18:40:04.608777] [DEBUG] [LOCAL ] GNE: Trimmed 18098 records to 14550 (keeping 150 days of data) [2025-09-15T18:40:04.701959] [DEBUG] [LOCAL ] GNE: Primary data saved (14550 records). [2025-09-15T18:40:04.702121] [INFO ] [MAIN ] GNE: Full history saved. [2025-09-15T18:40:04.702207] [INFO ] [MAIN ] Update Progress: 945/2369 symbols completed. GNE took 20.9s. Estimated remaining: 2h 30m 43s. Rate: 9.4 symbols/min [2025-09-15T18:40:04.876557] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:40:04.913830] [DEBUG] [LOCAL ] GNRC: Loaded 33818 existing records from primary storage. [2025-09-15T18:40:04.913999] [INFO ] [MAIN ] GNRC: Loaded 33818 existing records. [2025-09-15T18:40:05.096004] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:40:05.096295] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-09-15T18:40:05.096345] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-09-15T18:40:05.097172] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-09-15T18:40:05.097231] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-09-15T18:40:05.259155] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-09-15T18:40:05.489524] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:40:05.494096] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-15T18:40:05.672282] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-15T18:40:06.057882] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-09-15T18:40:06.857944] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-09-15T18:40:06.996526] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-15T18:40:07.408560] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T18:40:07.413373] [INFO ] [REMOTE ] GNK: Full fetch complete (44425 records). [2025-09-15T18:40:07.413555] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-09-15T18:40:07.670038] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-09-15T18:40:07.810967] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-09-15T18:40:07.811075] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-09-15T18:40:07.811893] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-09-15T18:40:07.811953] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-09-15T18:40:07.813217] [DEBUG] [LOCAL ] GNK: Trimmed 44425 records to 29366 (keeping 150 days of data) [2025-09-15T18:40:07.997685] [DEBUG] [LOCAL ] GNK: Primary data saved (29366 records). [2025-09-15T18:40:07.997845] [INFO ] [MAIN ] GNK: Full history saved. [2025-09-15T18:40:07.997936] [INFO ] [MAIN ] Update Progress: 946/2369 symbols completed. GNK took 19.3s. Estimated remaining: 2h 30m 32s. Rate: 9.5 symbols/min [2025-09-15T18:40:08.172759] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:40:08.207101] [DEBUG] [LOCAL ] GNT: Loaded 5911 existing records from primary storage. [2025-09-15T18:40:08.207273] [INFO ] [MAIN ] GNT: Loaded 5911 existing records. [2025-09-15T18:40:08.253038] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T18:40:08.410742] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:40:08.411107] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-09-15T18:40:08.411159] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-09-15T18:40:08.411716] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-09-15T18:40:08.411964] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-09-15T18:40:08.467962] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-09-15T18:40:08.778150] [INFO ] [REMOTE ] GNT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:40:08.883100] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T18:40:09.258005] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-09-15T18:40:09.913027] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T18:40:10.057869] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-09-15T18:40:10.172755] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-15T18:40:10.857961] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-09-15T18:40:11.628127] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-15T18:40:11.657815] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-09-15T18:40:12.307761] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-15T18:40:12.313372] [INFO ] [REMOTE ] GMED: Full fetch complete (52590 records). [2025-09-15T18:40:12.313488] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-09-15T18:40:12.463098] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-09-15T18:40:12.715300] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-09-15T18:40:12.715405] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-09-15T18:40:12.716325] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-09-15T18:40:12.716386] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-09-15T18:40:12.717631] [DEBUG] [LOCAL ] GMED: Trimmed 52590 records to 35554 (keeping 150 days of data) [2025-09-15T18:40:12.941921] [DEBUG] [LOCAL ] GMED: Primary data saved (35554 records). [2025-09-15T18:40:12.942156] [INFO ] [MAIN ] GMED: Full history saved. [2025-09-15T18:40:12.942386] [INFO ] [MAIN ] Update Progress: 947/2369 symbols completed. GMED took 41.2s. Estimated remaining: 2h 30m 24s. Rate: 9.5 symbols/min [2025-09-15T18:40:13.048976] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-15T18:40:13.155754] [INFO ] [MAIN ] GNTY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:40:13.162271] [DEBUG] [LOCAL ] GNTY: Loaded 5735 existing records from primary storage. [2025-09-15T18:40:13.162347] [INFO ] [MAIN ] GNTY: Loaded 5735 existing records. [2025-09-15T18:40:13.260097] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-09-15T18:40:13.336593] [WARN ] [MAIN ] GNTY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:40:13.336837] [INFO ] [MAIN ] GNTY: Wiping existing primary data before full refresh. [2025-09-15T18:40:13.336892] [INFO ] [LOCAL ] GNTY: Starting deletion of primary data. [2025-09-15T18:40:13.337179] [DEBUG] [LOCAL ] GNTY: Deleted primary data file. [2025-09-15T18:40:13.337229] [INFO ] [MAIN ] GNTY: Starting full primary refresh. [2025-09-15T18:40:13.718867] [INFO ] [REMOTE ] GNTY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:40:13.884918] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-15T18:40:14.057819] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-02. [2025-09-15T18:40:14.085237] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-15T18:40:14.796044] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-15T18:40:14.857827] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-09-15T18:40:15.657875] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-03. [2025-09-15T18:40:16.241328] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T18:40:16.457889] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-09-15T18:40:16.471013] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-15T18:40:17.257879] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-09-15T18:40:17.693157] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-15T18:40:17.970830] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-15T18:40:18.057883] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-09-15T18:40:18.857930] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-09-15T18:40:19.421882] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-15T18:40:19.658464] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-15T18:40:19.658555] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-09-15T18:40:20.457889] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-09-15T18:40:20.471508] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-15T18:40:21.257869] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-09-15T18:40:21.934413] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-15T18:40:22.057869] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-09-15T18:40:22.117788] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-15T18:40:22.716782] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-15T18:40:22.857872] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-09-15T18:40:23.657875] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-09-15T18:40:24.149503] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-15T18:40:24.171387] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-15T18:40:24.173276] [INFO ] [REMOTE ] GNT: Full fetch complete (8280 records). [2025-09-15T18:40:24.173350] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-09-15T18:40:24.459773] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-04. [2025-09-15T18:40:24.546731] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-09-15T18:40:24.546826] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-09-15T18:40:24.547055] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-09-15T18:40:24.547100] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-09-15T18:40:24.547528] [DEBUG] [LOCAL ] GNT: Trimmed 8280 records to 5815 (keeping 150 days of data) [2025-09-15T18:40:24.582610] [DEBUG] [LOCAL ] GNT: Primary data saved (5815 records). [2025-09-15T18:40:24.582790] [INFO ] [MAIN ] GNT: Full history saved. [2025-09-15T18:40:24.582916] [INFO ] [MAIN ] Update Progress: 948/2369 symbols completed. GNT took 16.6s. Estimated remaining: 2h 30m 26s. Rate: 9.4 symbols/min [2025-09-15T18:40:24.751884] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:40:24.787573] [DEBUG] [LOCAL ] GNW: Loaded 38622 existing records from primary storage. [2025-09-15T18:40:24.787743] [INFO ] [MAIN ] GNW: Loaded 38622 existing records. [2025-09-15T18:40:24.976229] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:40:24.976469] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-09-15T18:40:24.976515] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-09-15T18:40:24.977240] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-09-15T18:40:24.977297] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-09-15T18:40:25.104129] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-15T18:40:25.260672] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-09-15T18:40:25.342188] [INFO ] [REMOTE ] GNW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:40:26.057878] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-09-15T18:40:26.857875] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-09-15T18:40:27.079415] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-15T18:40:27.326202] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-15T18:40:27.657924] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-09-15T18:40:28.075138] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-15T18:40:28.080099] [INFO ] [REMOTE ] GNRC: Full fetch complete (49277 records). [2025-09-15T18:40:28.080226] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-09-15T18:40:28.465348] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-09-15T18:40:28.468095] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-09-15T18:40:28.469085] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-09-15T18:40:28.469884] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-09-15T18:40:28.469939] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-09-15T18:40:28.471193] [DEBUG] [LOCAL ] GNRC: Trimmed 49277 records to 33188 (keeping 150 days of data) [2025-09-15T18:40:28.690946] [DEBUG] [LOCAL ] GNRC: Primary data saved (33188 records). [2025-09-15T18:40:28.691134] [INFO ] [MAIN ] GNRC: Full history saved. [2025-09-15T18:40:28.691224] [INFO ] [MAIN ] Update Progress: 949/2369 symbols completed. GNRC took 24.0s. Estimated remaining: 2h 30m 16s. Rate: 9.5 symbols/min [2025-09-15T18:40:28.864031] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:40:28.897160] [DEBUG] [LOCAL ] GOF: Loaded 31610 existing records from primary storage. [2025-09-15T18:40:28.897306] [INFO ] [MAIN ] GOF: Loaded 31610 existing records. [2025-09-15T18:40:29.081381] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:40:29.081817] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-09-15T18:40:29.081898] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-09-15T18:40:29.082754] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-09-15T18:40:29.082813] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-09-15T18:40:29.261303] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-05. [2025-09-15T18:40:29.351029] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T18:40:29.496078] [INFO ] [REMOTE ] GOF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:40:29.893489] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-15T18:40:30.035251] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-15T18:40:30.057880] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-09-15T18:40:30.857899] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-09-15T18:40:31.657920] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-09-15T18:40:31.710259] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T18:40:32.174152] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T18:40:32.179952] [INFO ] [REMOTE ] GNL: Full fetch complete (51582 records). [2025-09-15T18:40:32.180174] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-09-15T18:40:32.463171] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-06. [2025-09-15T18:40:32.576106] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-09-15T18:40:32.576207] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-09-15T18:40:32.577187] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-09-15T18:40:32.577243] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-09-15T18:40:32.578569] [DEBUG] [LOCAL ] GNL: Trimmed 51582 records to 34319 (keeping 150 days of data) [2025-09-15T18:40:32.782192] [DEBUG] [LOCAL ] GNL: Primary data saved (34319 records). [2025-09-15T18:40:32.782347] [INFO ] [MAIN ] GNL: Full history saved. [2025-09-15T18:40:32.782446] [INFO ] [MAIN ] Update Progress: 950/2369 symbols completed. GNL took 30.3s. Estimated remaining: 2h 30m 6s. Rate: 9.5 symbols/min [2025-09-15T18:40:32.955756] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:40:32.978313] [DEBUG] [LOCAL ] GOLF: Loaded 23261 existing records from primary storage. [2025-09-15T18:40:32.978463] [INFO ] [MAIN ] GOLF: Loaded 23261 existing records. [2025-09-15T18:40:33.161516] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:40:33.161833] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-09-15T18:40:33.161885] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-09-15T18:40:33.162493] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-09-15T18:40:33.162548] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-09-15T18:40:33.260744] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-09-15T18:40:33.401842] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-15T18:40:33.547241] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:40:33.573299] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-15T18:40:34.057876] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-09-15T18:40:34.857875] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-07. [2025-09-15T18:40:34.930932] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-15T18:40:35.634016] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T18:40:35.657813] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-09-15T18:40:35.736378] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-15T18:40:36.457936] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-09-15T18:40:37.195857] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-15T18:40:37.257906] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-09-15T18:40:38.057969] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-09-15T18:40:38.347763] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-15T18:40:38.402000] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-15T18:40:38.857876] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-09-15T18:40:39.250622] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T18:40:39.657876] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-09-15T18:40:40.457903] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-09-15T18:40:40.508946] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T18:40:40.817244] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-15T18:40:41.257876] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-09-15T18:40:41.738051] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T18:40:42.057884] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-09-15T18:40:42.857919] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-08. [2025-09-15T18:40:42.906969] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T18:40:43.054304] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-15T18:40:43.635069] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-15T18:40:43.657829] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-09. [2025-09-15T18:40:44.323429] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-15T18:40:44.324981] [INFO ] [REMOTE ] GNTY: Full fetch complete (7279 records). [2025-09-15T18:40:44.325058] [DEBUG] [VALIDATOR ] GNTY: Validating primary data. [2025-09-15T18:40:44.325542] [FATAL] [VALIDATOR ] GNTY: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:40:44.325663] [FATAL] [MAIN ] GNTY: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:40:44.325706] [WARN ] [MAIN ] GNTY: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:40:44.325749] [INFO ] [LOCAL ] GNTY: Starting deletion of primary data. [2025-09-15T18:40:44.325816] [DEBUG] [LOCAL ] GNTY: No primary data file found to delete. [2025-09-15T18:40:44.325854] [INFO ] [LOCAL ] GNTY: Starting deletion of derivative data. [2025-09-15T18:40:44.326189] [DEBUG] [LOCAL ] GNTY: Deleted derivative data file. [2025-09-15T18:40:44.326329] [INFO ] [MAIN ] Update Progress: 951/2369 symbols completed. GNTY took 31.4s. Estimated remaining: 2h 30m 7s. Rate: 9.4 symbols/min [2025-09-15T18:40:44.466360] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-09-15T18:40:44.499377] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:40:44.538507] [DEBUG] [LOCAL ] GOOS: Loaded 34330 existing records from primary storage. [2025-09-15T18:40:44.538762] [INFO ] [MAIN ] GOOS: Loaded 34330 existing records. [2025-09-15T18:40:44.740353] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:40:44.740725] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-09-15T18:40:44.740793] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-09-15T18:40:44.741517] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-09-15T18:40:44.741575] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-09-15T18:40:45.112549] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:40:45.257922] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-09-15T18:40:46.031427] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-15T18:40:46.057862] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-09-15T18:40:46.633778] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T18:40:46.857879] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-09-15T18:40:47.564519] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-15T18:40:47.569401] [INFO ] [REMOTE ] GOF: Full fetch complete (46806 records). [2025-09-15T18:40:47.569509] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-09-15T18:40:47.663040] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-09-15T18:40:47.941413] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-15T18:40:47.978055] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-09-15T18:40:47.978180] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-09-15T18:40:47.979033] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-09-15T18:40:47.979096] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-09-15T18:40:47.980410] [DEBUG] [LOCAL ] GOF: Trimmed 46806 records to 30983 (keeping 150 days of data) [2025-09-15T18:40:48.183305] [DEBUG] [LOCAL ] GOF: Primary data saved (30983 records). [2025-09-15T18:40:48.183473] [INFO ] [MAIN ] GOF: Full history saved. [2025-09-15T18:40:48.183565] [INFO ] [MAIN ] Update Progress: 952/2369 symbols completed. GOF took 19.5s. Estimated remaining: 2h 29m 57s. Rate: 9.4 symbols/min [2025-09-15T18:40:48.354923] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:40:48.381539] [DEBUG] [LOCAL ] GOTU: Loaded 28001 existing records from primary storage. [2025-09-15T18:40:48.381703] [INFO ] [MAIN ] GOTU: Loaded 28001 existing records. [2025-09-15T18:40:48.463023] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-09-15T18:40:48.560297] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:40:48.560568] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-09-15T18:40:48.560624] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-09-15T18:40:48.561261] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-09-15T18:40:48.561323] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-09-15T18:40:48.918844] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:40:49.257874] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-09-15T18:40:49.364470] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-15T18:40:49.876519] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T18:40:50.057867] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-09-15T18:40:50.780581] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-15T18:40:50.857819] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-09-15T18:40:51.117778] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-15T18:40:51.657883] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-09-15T18:40:52.108926] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-15T18:40:52.457875] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-09-15T18:40:53.223275] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T18:40:53.229305] [INFO ] [REMOTE ] GNW: Full fetch complete (55728 records). [2025-09-15T18:40:53.229427] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-09-15T18:40:53.262943] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-09-15T18:40:53.611369] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-09-15T18:40:53.611447] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-09-15T18:40:53.612204] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-09-15T18:40:53.612258] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-09-15T18:40:53.613417] [DEBUG] [LOCAL ] GNW: Trimmed 55728 records to 37886 (keeping 150 days of data) [2025-09-15T18:40:53.838394] [DEBUG] [LOCAL ] GNW: Primary data saved (37886 records). [2025-09-15T18:40:53.838549] [INFO ] [MAIN ] GNW: Full history saved. [2025-09-15T18:40:53.839073] [INFO ] [MAIN ] Update Progress: 953/2369 symbols completed. GNW took 29.3s. Estimated remaining: 2h 29m 50s. Rate: 9.5 symbols/min [2025-09-15T18:40:54.008506] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:40:54.060072] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-09-15T18:40:54.073391] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T18:40:54.074317] [DEBUG] [LOCAL ] GPC: Loaded 34452 existing records from primary storage. [2025-09-15T18:40:54.084277] [INFO ] [MAIN ] GPC: Loaded 34452 existing records. [2025-09-15T18:40:54.267065] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:40:54.267416] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-09-15T18:40:54.267561] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-09-15T18:40:54.268428] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-09-15T18:40:54.268497] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-09-15T18:40:54.450144] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-15T18:40:54.656026] [INFO ] [REMOTE ] GPC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:40:54.857875] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-09-15T18:40:55.568609] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-15T18:40:55.657934] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-09-15T18:40:56.463317] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-09-15T18:40:56.474610] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T18:40:56.676708] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T18:40:56.680347] [INFO ] [REMOTE ] GOLF: Full fetch complete (35769 records). [2025-09-15T18:40:56.680512] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-09-15T18:40:57.092398] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-09-15T18:40:57.092493] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-09-15T18:40:57.093176] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-09-15T18:40:57.093223] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-09-15T18:40:57.094635] [DEBUG] [LOCAL ] GOLF: Trimmed 35769 records to 22665 (keeping 150 days of data) [2025-09-15T18:40:57.255870] [DEBUG] [LOCAL ] GOLF: Primary data saved (22665 records). [2025-09-15T18:40:57.256026] [INFO ] [MAIN ] GOLF: Full history saved. [2025-09-15T18:40:57.256138] [INFO ] [MAIN ] Update Progress: 954/2369 symbols completed. GOLF took 24.5s. Estimated remaining: 2h 29m 39s. Rate: 9.5 symbols/min [2025-09-15T18:40:57.267854] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-09-15T18:40:57.443934] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:40:57.455945] [DEBUG] [LOCAL ] GPI: Loaded 10289 existing records from primary storage. [2025-09-15T18:40:57.456104] [INFO ] [MAIN ] GPI: Loaded 10289 existing records. [2025-09-15T18:40:57.642549] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:40:57.642851] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-09-15T18:40:57.642902] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-09-15T18:40:57.643275] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-09-15T18:40:57.643324] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-09-15T18:40:57.999107] [INFO ] [REMOTE ] GPI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:40:58.034698] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T18:40:58.057872] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-09-15T18:40:58.857915] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-09-15T18:40:58.927590] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-15T18:40:59.419688] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-15T18:40:59.657918] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-09-15T18:40:59.788087] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-15T18:41:00.457879] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-09-15T18:41:01.101300] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-15T18:41:01.257861] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-09-15T18:41:02.057923] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-09-15T18:41:02.177424] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-15T18:41:02.862957] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-09-15T18:41:02.879509] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-15T18:41:03.085185] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-15T18:41:03.657888] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-09-15T18:41:04.305072] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T18:41:04.457917] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-09-15T18:41:04.839070] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-15T18:41:05.257873] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-09-15T18:41:05.864967] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-15T18:41:06.057938] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-09-15T18:41:06.592727] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-15T18:41:06.857886] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-09-15T18:41:07.561295] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T18:41:07.566270] [INFO ] [REMOTE ] GOTU: Full fetch complete (44025 records). [2025-09-15T18:41:07.566362] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-09-15T18:41:07.662937] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-09-15T18:41:07.937607] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-09-15T18:41:07.937772] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-09-15T18:41:07.938468] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-09-15T18:41:07.938513] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-09-15T18:41:07.939677] [DEBUG] [LOCAL ] GOTU: Trimmed 44025 records to 27638 (keeping 150 days of data) [2025-09-15T18:41:08.109126] [DEBUG] [LOCAL ] GOTU: Primary data saved (27638 records). [2025-09-15T18:41:08.109365] [INFO ] [MAIN ] GOTU: Full history saved. [2025-09-15T18:41:08.109507] [INFO ] [MAIN ] Update Progress: 955/2369 symbols completed. GOTU took 19.9s. Estimated remaining: 2h 29m 40s. Rate: 9.4 symbols/min [2025-09-15T18:41:08.295949] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:41:08.302079] [DEBUG] [LOCAL ] GPJA: Loaded 3110 existing records from primary storage. [2025-09-15T18:41:08.302187] [INFO ] [MAIN ] GPJA: Loaded 3110 existing records. [2025-09-15T18:41:08.458788] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-09-15T18:41:08.480399] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:41:08.480612] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-09-15T18:41:08.480688] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-09-15T18:41:08.480964] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-09-15T18:41:08.481013] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-09-15T18:41:08.843865] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:41:08.922116] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-15T18:41:08.928170] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-15T18:41:09.257910] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-09-15T18:41:10.057853] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-09-15T18:41:10.098403] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-15T18:41:10.715126] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T18:41:10.762407] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-15T18:41:10.857826] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-09-15T18:41:11.657917] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-09-15T18:41:12.457926] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-09-15T18:41:12.580110] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-15T18:41:12.597520] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T18:41:13.257927] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-09-15T18:41:13.407540] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-15T18:41:13.799584] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-15T18:41:14.057895] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-09-15T18:41:14.460009] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-15T18:41:14.857879] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-09-15T18:41:15.657870] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-09-15T18:41:16.131687] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-15T18:41:16.457885] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-09-15T18:41:17.257883] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-09-15T18:41:17.402238] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-15T18:41:17.407716] [INFO ] [REMOTE ] GOOS: Full fetch complete (50117 records). [2025-09-15T18:41:17.407900] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-09-15T18:41:17.795702] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-09-15T18:41:17.795786] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-09-15T18:41:17.796475] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-09-15T18:41:17.796516] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-09-15T18:41:17.797522] [DEBUG] [LOCAL ] GOOS: Trimmed 50117 records to 33701 (keeping 150 days of data) [2025-09-15T18:41:18.007067] [DEBUG] [LOCAL ] GOOS: Primary data saved (33701 records). [2025-09-15T18:41:18.007198] [INFO ] [MAIN ] GOOS: Full history saved. [2025-09-15T18:41:18.007281] [INFO ] [MAIN ] Update Progress: 956/2369 symbols completed. GOOS took 33.7s. Estimated remaining: 2h 29m 39s. Rate: 9.4 symbols/min [2025-09-15T18:41:18.076187] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-09-15T18:41:18.186617] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:41:18.212192] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T18:41:18.213331] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-15T18:41:18.222857] [INFO ] [REMOTE ] GPC: Full fetch complete (51267 records). [2025-09-15T18:41:18.222959] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-09-15T18:41:18.485730] [DEBUG] [LOCAL ] GPK: Loaded 39725 existing records from primary storage. [2025-09-15T18:41:18.507964] [INFO ] [MAIN ] GPK: Loaded 39725 existing records. [2025-09-15T18:41:18.574273] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-15T18:41:18.767001] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-09-15T18:41:18.795493] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-09-15T18:41:18.823498] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-09-15T18:41:18.823609] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:41:18.823749] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-09-15T18:41:18.824026] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-09-15T18:41:18.824076] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-09-15T18:41:18.825133] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-09-15T18:41:18.825208] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-09-15T18:41:18.825091] [DEBUG] [LOCAL ] GPC: Trimmed 51267 records to 33780 (keeping 150 days of data) [2025-09-15T18:41:18.862923] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-09-15T18:41:19.298552] [INFO ] [REMOTE ] GPK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:41:19.411995] [DEBUG] [LOCAL ] GPC: Primary data saved (33780 records). [2025-09-15T18:41:19.412141] [INFO ] [MAIN ] GPC: Full history saved. [2025-09-15T18:41:19.412848] [INFO ] [MAIN ] Update Progress: 957/2369 symbols completed. GPC took 25.6s. Estimated remaining: 2h 29m 25s. Rate: 9.5 symbols/min [2025-09-15T18:41:19.657861] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-09-15T18:41:19.682799] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T18:41:20.457873] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-09-15T18:41:21.257876] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-09-15T18:41:21.396935] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-15T18:41:21.574317] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-15T18:41:21.678677] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-15T18:41:22.057878] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-09-15T18:41:22.857917] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-09-15T18:41:23.553200] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T18:41:23.555233] [INFO ] [REMOTE ] GPI: Full fetch complete (16114 records). [2025-09-15T18:41:23.555312] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-09-15T18:41:23.658406] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-09-15T18:41:23.927880] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-09-15T18:41:23.927985] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-09-15T18:41:23.928448] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-09-15T18:41:23.928532] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-09-15T18:41:23.929331] [DEBUG] [LOCAL ] GPI: Trimmed 16114 records to 10095 (keeping 150 days of data) [2025-09-15T18:41:24.023616] [DEBUG] [LOCAL ] GPI: Primary data saved (10095 records). [2025-09-15T18:41:24.024252] [INFO ] [MAIN ] GPI: Full history saved. [2025-09-15T18:41:24.024368] [INFO ] [MAIN ] Update Progress: 958/2369 symbols completed. GPI took 26.8s. Estimated remaining: 2h 29m 16s. Rate: 9.5 symbols/min [2025-09-15T18:41:24.025444] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-15T18:41:24.425106] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-15T18:41:24.457901] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-09-15T18:41:25.257897] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-09-15T18:41:25.862745] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-15T18:41:25.863903] [INFO ] [REMOTE ] GPJA: Full fetch complete (4332 records). [2025-09-15T18:41:25.863977] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-09-15T18:41:26.222164] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-09-15T18:41:26.222333] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-09-15T18:41:26.222518] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-09-15T18:41:26.222571] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-09-15T18:41:26.223134] [DEBUG] [LOCAL ] GPJA: Trimmed 4332 records to 3082 (keeping 150 days of data) [2025-09-15T18:41:26.271011] [DEBUG] [LOCAL ] GPJA: Primary data saved (3082 records). [2025-09-15T18:41:26.271479] [INFO ] [MAIN ] GPJA: Full history saved. [2025-09-15T18:41:26.272725] [INFO ] [MAIN ] Update Progress: 959/2369 symbols completed. GPJA took 18.2s. Estimated remaining: 2h 29m 4s. Rate: 9.5 symbols/min [2025-09-15T18:41:26.272539] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-15T18:41:26.283942] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-09-15T18:41:28.097766] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-15T18:41:28.109135] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-09-15T18:41:29.590613] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-15T18:41:29.601553] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-09-15T18:41:30.786303] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-15T18:41:30.797950] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-09-15T18:41:32.321595] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T18:41:32.333443] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-09-15T18:41:33.972117] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T18:41:33.978036] [INFO ] [REMOTE ] GPK: Full fetch complete (57062 records). [2025-09-15T18:41:33.978158] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-09-15T18:41:34.360092] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-09-15T18:41:34.360195] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-09-15T18:41:34.361115] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-09-15T18:41:34.361179] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-09-15T18:41:34.362562] [DEBUG] [LOCAL ] GPK: Trimmed 57062 records to 39013 (keeping 150 days of data) [2025-09-15T18:41:34.620730] [DEBUG] [LOCAL ] GPK: Primary data saved (39013 records). [2025-09-15T18:41:34.620875] [INFO ] [MAIN ] GPK: Full history saved. [2025-09-15T18:41:34.620959] [INFO ] [MAIN ] Update Progress: 960/2369 symbols completed. GPK took 16.6s. Estimated remaining: 2h 29m 0s. Rate: 9.5 symbols/min [2025-09-15T18:41:35.185117] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:41:35.240114] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:41:35.270049] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:41:35.315895] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:41:35.359931] [DEBUG] [LOCAL ] GPRK: Loaded 28993 existing records from primary storage. [2025-09-15T18:41:35.361071] [INFO ] [MAIN ] GPRK: Loaded 28993 existing records. [2025-09-15T18:41:35.360758] [DEBUG] [LOCAL ] GPOR: Loaded 16535 existing records from primary storage. [2025-09-15T18:41:35.403427] [INFO ] [MAIN ] GPOR: Loaded 16535 existing records. [2025-09-15T18:41:35.498215] [DEBUG] [LOCAL ] GPMT: Loaded 20904 existing records from primary storage. [2025-09-15T18:41:35.535574] [DEBUG] [LOCAL ] GPN: Loaded 39199 existing records from primary storage. [2025-09-15T18:41:35.534604] [INFO ] [MAIN ] GPMT: Loaded 20904 existing records. [2025-09-15T18:41:35.551149] [INFO ] [MAIN ] GPN: Loaded 39199 existing records. [2025-09-15T18:41:36.013001] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:41:36.012821] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:41:36.081300] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-09-15T18:41:36.105252] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-09-15T18:41:36.124981] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-09-15T18:41:36.128372] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-09-15T18:41:36.128760] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-09-15T18:41:36.128984] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-09-15T18:41:36.128896] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:41:36.128502] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:41:36.150165] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-09-15T18:41:36.159793] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-09-15T18:41:36.170294] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-09-15T18:41:36.199626] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-09-15T18:41:36.199395] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-09-15T18:41:36.199548] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-09-15T18:41:36.236671] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-09-15T18:41:36.236863] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-09-15T18:41:36.220568] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-09-15T18:41:36.273168] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-09-15T18:41:37.517950] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:41:37.567062] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-09-15T18:41:37.581628] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:41:37.618354] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-09-15T18:41:37.679360] [INFO ] [REMOTE ] GPN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:41:37.734048] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-09-15T18:41:37.741159] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:41:37.742569] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-09-15T18:41:38.717456] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-15T18:41:38.722325] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-09-15T18:41:39.080280] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-15T18:41:39.085286] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-09-15T18:41:39.482568] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-15T18:41:39.491088] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-09-15T18:41:39.578473] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-15T18:41:39.589211] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-09-15T18:41:39.622593] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T18:41:39.628048] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-09-15T18:41:40.053082] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-15T18:41:40.058874] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-09-15T18:41:40.977224] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-15T18:41:40.985861] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-09-15T18:41:41.181537] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T18:41:41.189308] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-09-15T18:41:41.250552] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-15T18:41:41.257168] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-09-15T18:41:41.358633] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-15T18:41:41.369674] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-09-15T18:41:41.965097] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-15T18:41:41.970337] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-09-15T18:41:42.152722] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-15T18:41:42.161987] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-09-15T18:41:42.223141] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-15T18:41:42.618604] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-15T18:41:42.857910] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-09-15T18:41:42.928381] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-15T18:41:43.356973] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-15T18:41:43.657892] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-09-15T18:41:44.222811] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-15T18:41:44.462343] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-09-15T18:41:44.466996] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-15T18:41:45.263159] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-09-15T18:41:45.272913] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-15T18:41:46.057887] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-09-15T18:41:46.857879] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-09-15T18:41:47.097760] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-15T18:41:47.121296] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T18:41:47.657901] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-09-15T18:41:47.873618] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T18:41:48.457891] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-09-15T18:41:48.972224] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T18:41:49.257871] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-09-15T18:41:50.056465] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-15T18:41:50.064282] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-09-15T18:41:50.498438] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-15T18:41:50.857875] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-09-15T18:41:51.110051] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-15T18:41:51.112187] [INFO ] [REMOTE ] GPMT: Full fetch complete (29205 records). [2025-09-15T18:41:51.112261] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-09-15T18:41:51.483242] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-09-15T18:41:51.483366] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-09-15T18:41:51.484615] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-09-15T18:41:51.484693] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-09-15T18:41:51.485836] [DEBUG] [LOCAL ] GPMT: Trimmed 29205 records to 20224 (keeping 150 days of data) [2025-09-15T18:41:51.616801] [DEBUG] [LOCAL ] GPMT: Primary data saved (20224 records). [2025-09-15T18:41:51.616995] [INFO ] [MAIN ] GPMT: Full history saved. [2025-09-15T18:41:51.617155] [INFO ] [MAIN ] Update Progress: 961/2369 symbols completed. GPMT took 17.0s. Estimated remaining: 2h 29m 9s. Rate: 9.4 symbols/min [2025-09-15T18:41:51.663119] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-09-15T18:41:51.812743] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:41:51.835074] [DEBUG] [LOCAL ] GRBK: Loaded 19882 existing records from primary storage. [2025-09-15T18:41:51.835289] [INFO ] [MAIN ] GRBK: Loaded 19882 existing records. [2025-09-15T18:41:52.021179] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:41:52.021529] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-09-15T18:41:52.021581] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-09-15T18:41:52.022196] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-09-15T18:41:52.022251] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-09-15T18:41:52.417164] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:41:52.453802] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-15T18:41:52.458349] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-09-15T18:41:52.926917] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T18:41:52.930508] [INFO ] [REMOTE ] GPOR: Full fetch complete (24937 records). [2025-09-15T18:41:52.930604] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-09-15T18:41:53.263092] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-09-15T18:41:53.295100] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-09-15T18:41:53.295171] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-09-15T18:41:53.295687] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-09-15T18:41:53.295735] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-09-15T18:41:53.296405] [DEBUG] [LOCAL ] GPOR: Trimmed 24937 records to 16284 (keeping 150 days of data) [2025-09-15T18:41:53.399373] [DEBUG] [LOCAL ] GPOR: Primary data saved (16284 records). [2025-09-15T18:41:53.399533] [INFO ] [MAIN ] GPOR: Full history saved. [2025-09-15T18:41:53.399622] [INFO ] [MAIN ] Update Progress: 962/2369 symbols completed. GPOR took 18.8s. Estimated remaining: 2h 28m 56s. Rate: 9.4 symbols/min [2025-09-15T18:41:53.564889] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:41:53.572575] [DEBUG] [LOCAL ] GRC: Loaded 6363 existing records from primary storage. [2025-09-15T18:41:53.572894] [INFO ] [MAIN ] GRC: Loaded 6363 existing records. [2025-09-15T18:41:53.748836] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:41:53.749229] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-09-15T18:41:53.749343] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-09-15T18:41:53.749723] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-09-15T18:41:53.749786] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-09-15T18:41:53.869853] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T18:41:54.063032] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-09-15T18:41:54.126334] [INFO ] [REMOTE ] GRC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:41:54.857900] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-09-15T18:41:55.052834] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-15T18:41:55.287018] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T18:41:55.657932] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-09-15T18:41:56.035613] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-15T18:41:56.457886] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-09-15T18:41:56.681945] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T18:41:56.685878] [INFO ] [REMOTE ] GPRK: Full fetch complete (42558 records). [2025-09-15T18:41:56.685974] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-09-15T18:41:57.082710] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-09-15T18:41:57.082798] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-09-15T18:41:57.083450] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-09-15T18:41:57.083491] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-09-15T18:41:57.084599] [DEBUG] [LOCAL ] GPRK: Trimmed 42558 records to 28378 (keeping 150 days of data) [2025-09-15T18:41:57.248387] [DEBUG] [LOCAL ] GPRK: Primary data saved (28378 records). [2025-09-15T18:41:57.248531] [INFO ] [MAIN ] GPRK: Full history saved. [2025-09-15T18:41:57.248620] [INFO ] [MAIN ] Update Progress: 963/2369 symbols completed. GPRK took 22.6s. Estimated remaining: 2h 28m 46s. Rate: 9.5 symbols/min [2025-09-15T18:41:57.262947] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-09-15T18:41:57.417937] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:41:57.432340] [DEBUG] [LOCAL ] GRDN: Loaded 15117 existing records from primary storage. [2025-09-15T18:41:57.432446] [INFO ] [MAIN ] GRDN: Loaded 15117 existing records. [2025-09-15T18:41:57.604912] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:41:57.605167] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-09-15T18:41:57.605223] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-09-15T18:41:57.605628] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-09-15T18:41:57.605711] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-09-15T18:41:57.957965] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:41:58.057907] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-09-15T18:41:58.312690] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-15T18:41:58.349012] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-15T18:41:58.615835] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-15T18:41:58.857886] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-09-15T18:41:59.657906] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-09-15T18:42:00.215464] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-15T18:42:00.221063] [INFO ] [REMOTE ] GPN: Full fetch complete (56620 records). [2025-09-15T18:42:00.221184] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-09-15T18:42:00.463907] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-09-15T18:42:00.577299] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-15T18:42:00.625805] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-09-15T18:42:00.625877] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-09-15T18:42:00.626681] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-09-15T18:42:00.626728] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-09-15T18:42:00.627776] [DEBUG] [LOCAL ] GPN: Trimmed 56620 records to 38444 (keeping 150 days of data) [2025-09-15T18:42:00.867050] [DEBUG] [LOCAL ] GPN: Primary data saved (38444 records). [2025-09-15T18:42:00.867231] [INFO ] [MAIN ] GPN: Full history saved. [2025-09-15T18:42:00.867313] [INFO ] [MAIN ] Update Progress: 964/2369 symbols completed. GPN took 26.2s. Estimated remaining: 2h 28m 36s. Rate: 9.5 symbols/min [2025-09-15T18:42:01.035550] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:42:01.066078] [DEBUG] [LOCAL ] GRMN: Loaded 30492 existing records from primary storage. [2025-09-15T18:42:01.066219] [INFO ] [MAIN ] GRMN: Loaded 30492 existing records. [2025-09-15T18:42:01.239899] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:42:01.240154] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-09-15T18:42:01.240203] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-09-15T18:42:01.241043] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-09-15T18:42:01.241094] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-09-15T18:42:01.263040] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-09-15T18:42:01.596535] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:42:02.059865] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-09-15T18:42:02.062547] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-15T18:42:02.857889] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-09-15T18:42:03.005508] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-15T18:42:03.657880] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-09-15T18:42:04.457920] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-09-15T18:42:04.488146] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T18:42:05.257838] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-09-15T18:42:05.350045] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (3.29 seconds). [2025-09-15T18:42:05.483635] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-15T18:42:05.728458] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-15T18:42:05.966667] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-15T18:42:06.057931] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-09-15T18:42:06.857875] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-09-15T18:42:06.929901] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-15T18:42:07.657894] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-09-15T18:42:08.108992] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-15T18:42:08.185844] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-15T18:42:08.457869] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-09-15T18:42:09.257923] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-09-15T18:42:09.842092] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T18:42:10.057937] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-09-15T18:42:10.456079] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-15T18:42:10.751873] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-15T18:42:10.753282] [INFO ] [REMOTE ] GRC: Full fetch complete (9638 records). [2025-09-15T18:42:10.753353] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-09-15T18:42:10.858539] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-09-15T18:42:11.116332] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-09-15T18:42:11.116411] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-09-15T18:42:11.116629] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-09-15T18:42:11.116693] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-09-15T18:42:11.117131] [DEBUG] [LOCAL ] GRC: Trimmed 9638 records to 6266 (keeping 150 days of data) [2025-09-15T18:42:11.156776] [DEBUG] [LOCAL ] GRC: Primary data saved (6266 records). [2025-09-15T18:42:11.156893] [INFO ] [MAIN ] GRC: Full history saved. [2025-09-15T18:42:11.156985] [INFO ] [MAIN ] Update Progress: 965/2369 symbols completed. GRC took 17.8s. Estimated remaining: 2h 28m 36s. Rate: 9.4 symbols/min [2025-09-15T18:42:11.326965] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:42:11.367226] [DEBUG] [LOCAL ] GRND: Loaded 37643 existing records from primary storage. [2025-09-15T18:42:11.367382] [INFO ] [MAIN ] GRND: Loaded 37643 existing records. [2025-09-15T18:42:11.547524] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:42:11.547832] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-09-15T18:42:11.547889] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-09-15T18:42:11.549375] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-09-15T18:42:11.549433] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-09-15T18:42:11.662962] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-09-15T18:42:11.913492] [INFO ] [REMOTE ] GRND: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:42:11.924844] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T18:42:12.457915] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-09-15T18:42:13.257903] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-09-15T18:42:13.424612] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T18:42:13.446393] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T18:42:14.057906] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-09-15T18:42:14.226284] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-15T18:42:14.229419] [INFO ] [REMOTE ] GRBK: Full fetch complete (30128 records). [2025-09-15T18:42:14.229493] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-09-15T18:42:14.597763] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-09-15T18:42:14.597846] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-09-15T18:42:14.598451] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-09-15T18:42:14.598492] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-09-15T18:42:14.599233] [DEBUG] [LOCAL ] GRBK: Trimmed 30128 records to 19511 (keeping 150 days of data) [2025-09-15T18:42:14.713675] [DEBUG] [LOCAL ] GRBK: Primary data saved (19511 records). [2025-09-15T18:42:14.713839] [INFO ] [MAIN ] GRBK: Full history saved. [2025-09-15T18:42:14.713947] [INFO ] [MAIN ] Update Progress: 966/2369 symbols completed. GRBK took 23.1s. Estimated remaining: 2h 28m 25s. Rate: 9.5 symbols/min [2025-09-15T18:42:14.858684] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-09-15T18:42:14.890622] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:42:14.922724] [DEBUG] [LOCAL ] GRNT: Loaded 25252 existing records from primary storage. [2025-09-15T18:42:14.922945] [INFO ] [MAIN ] GRNT: Loaded 25252 existing records. [2025-09-15T18:42:15.108169] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:42:15.108413] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-09-15T18:42:15.108460] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-09-15T18:42:15.109432] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-09-15T18:42:15.109485] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-09-15T18:42:15.460476] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:42:15.498717] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T18:42:15.657872] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-09-15T18:42:16.457898] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-09-15T18:42:16.945739] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-15T18:42:17.257916] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-09-15T18:42:17.460472] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-09-15T18:42:17.516502] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-15T18:42:18.057883] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-09-15T18:42:18.857877] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-09-15T18:42:18.897830] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-15T18:42:19.657833] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-09-15T18:42:19.918200] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-15T18:42:20.003884] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-15T18:42:20.457878] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-09-15T18:42:20.854674] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-15T18:42:21.257941] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-09-15T18:42:22.057861] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-09-15T18:42:22.281431] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T18:42:22.284630] [INFO ] [REMOTE ] GRDN: Full fetch complete (19300 records). [2025-09-15T18:42:22.284749] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-09-15T18:42:22.285210] [FATAL] [VALIDATOR ] GRDN: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:42:22.285293] [FATAL] [MAIN ] GRDN: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:42:22.285331] [WARN ] [MAIN ] GRDN: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:42:22.285369] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-09-15T18:42:22.285426] [DEBUG] [LOCAL ] GRDN: No primary data file found to delete. [2025-09-15T18:42:22.285473] [INFO ] [LOCAL ] GRDN: Starting deletion of derivative data. [2025-09-15T18:42:22.285915] [DEBUG] [LOCAL ] GRDN: Deleted derivative data file. [2025-09-15T18:42:22.286013] [INFO ] [MAIN ] Update Progress: 967/2369 symbols completed. GRDN took 25.0s. Estimated remaining: 2h 28m 21s. Rate: 9.5 symbols/min [2025-09-15T18:42:22.461191] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:42:22.506002] [DEBUG] [LOCAL ] GROV: Loaded 6894 existing records from primary storage. [2025-09-15T18:42:22.506176] [INFO ] [MAIN ] GROV: Loaded 6894 existing records. [2025-09-15T18:42:22.589680] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-15T18:42:22.704374] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:42:22.704693] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-09-15T18:42:22.704749] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-09-15T18:42:22.705041] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-09-15T18:42:22.705087] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-09-15T18:42:22.861708] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-09-15T18:42:23.061896] [INFO ] [REMOTE ] GROV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:42:23.649631] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-15T18:42:23.659340] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-09-15T18:42:24.457894] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-09-15T18:42:24.840804] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-15T18:42:24.960853] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-15T18:42:25.257869] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-09-15T18:42:25.717032] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T18:42:26.057886] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-09-15T18:42:26.554973] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-15T18:42:26.857878] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-09-15T18:42:27.557914] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T18:42:27.562513] [INFO ] [REMOTE ] GRMN: Full fetch complete (45736 records). [2025-09-15T18:42:27.562605] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-09-15T18:42:27.663133] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-09-15T18:42:27.951986] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-09-15T18:42:27.952092] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-09-15T18:42:27.952831] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-09-15T18:42:27.952874] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-09-15T18:42:27.953813] [DEBUG] [LOCAL ] GRMN: Trimmed 45736 records to 29826 (keeping 150 days of data) [2025-09-15T18:42:28.149947] [DEBUG] [LOCAL ] GRMN: Primary data saved (29826 records). [2025-09-15T18:42:28.150114] [INFO ] [MAIN ] GRMN: Full history saved. [2025-09-15T18:42:28.150230] [INFO ] [MAIN ] Update Progress: 968/2369 symbols completed. GRMN took 27.3s. Estimated remaining: 2h 28m 13s. Rate: 9.5 symbols/min [2025-09-15T18:42:28.324041] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:42:28.329191] [DEBUG] [LOCAL ] GRX: Loaded 3275 existing records from primary storage. [2025-09-15T18:42:28.329284] [INFO ] [MAIN ] GRX: Loaded 3275 existing records. [2025-09-15T18:42:28.473830] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-09-15T18:42:28.512061] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:42:28.513117] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-09-15T18:42:28.513163] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-09-15T18:42:28.513431] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-09-15T18:42:28.513496] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-09-15T18:42:28.875131] [INFO ] [REMOTE ] GRX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:42:28.904653] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-15T18:42:29.181115] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-15T18:42:29.257811] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-09-15T18:42:29.351340] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-15T18:42:30.057896] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-09-15T18:42:30.857951] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-09-15T18:42:31.398005] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-15T18:42:31.464548] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T18:42:31.519918] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-15T18:42:31.657876] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-09-15T18:42:32.457925] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-09-15T18:42:32.627563] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-15T18:42:33.257894] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-09-15T18:42:34.057933] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-09-15T18:42:34.210254] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-15T18:42:34.399741] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-15T18:42:34.781437] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-15T18:42:34.857937] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-09-15T18:42:35.657890] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-09-15T18:42:35.992429] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T18:42:36.457939] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-09-15T18:42:37.005283] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-15T18:42:37.118349] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T18:42:37.124556] [INFO ] [REMOTE ] GRND: Full fetch complete (54259 records). [2025-09-15T18:42:37.124820] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-09-15T18:42:37.274151] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-09-15T18:42:37.519778] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-09-15T18:42:37.519861] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-09-15T18:42:37.520679] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-09-15T18:42:37.520724] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-09-15T18:42:37.521902] [DEBUG] [LOCAL ] GRND: Trimmed 54259 records to 36943 (keeping 150 days of data) [2025-09-15T18:42:37.751040] [DEBUG] [LOCAL ] GRND: Primary data saved (36943 records). [2025-09-15T18:42:37.751208] [INFO ] [MAIN ] GRND: Full history saved. [2025-09-15T18:42:37.752515] [INFO ] [MAIN ] Update Progress: 969/2369 symbols completed. GRND took 26.6s. Estimated remaining: 2h 28m 12s. Rate: 9.4 symbols/min [2025-09-15T18:42:37.912211] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-15T18:42:37.930615] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:42:37.975388] [DEBUG] [LOCAL ] GS: Loaded 39082 existing records from primary storage. [2025-09-15T18:42:37.975543] [INFO ] [MAIN ] GS: Loaded 39082 existing records. [2025-09-15T18:42:38.063123] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-09-15T18:42:38.155342] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:42:38.155690] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-09-15T18:42:38.155740] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-09-15T18:42:38.156850] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-09-15T18:42:38.156904] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-09-15T18:42:38.513662] [INFO ] [REMOTE ] GS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:42:38.857894] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-09-15T18:42:39.494132] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T18:42:39.498529] [INFO ] [REMOTE ] GRNT: Full fetch complete (36531 records). [2025-09-15T18:42:39.498629] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-09-15T18:42:39.662758] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-09-15T18:42:39.715553] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T18:42:39.885995] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-09-15T18:42:39.886087] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-09-15T18:42:39.886756] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-09-15T18:42:39.886801] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-09-15T18:42:39.887765] [DEBUG] [LOCAL ] GRNT: Trimmed 36531 records to 24663 (keeping 150 days of data) [2025-09-15T18:42:40.044891] [DEBUG] [LOCAL ] GRNT: Primary data saved (24663 records). [2025-09-15T18:42:40.045084] [INFO ] [MAIN ] GRNT: Full history saved. [2025-09-15T18:42:40.045214] [INFO ] [MAIN ] Update Progress: 970/2369 symbols completed. GRNT took 25.3s. Estimated remaining: 2h 27m 60s. Rate: 9.5 symbols/min [2025-09-15T18:42:40.219619] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:42:40.249038] [DEBUG] [LOCAL ] GSBD: Loaded 28373 existing records from primary storage. [2025-09-15T18:42:40.249192] [INFO ] [MAIN ] GSBD: Loaded 28373 existing records. [2025-09-15T18:42:40.428055] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:42:40.428321] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-09-15T18:42:40.428367] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-09-15T18:42:40.429125] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-09-15T18:42:40.429177] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-09-15T18:42:40.463004] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-09-15T18:42:40.785907] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:42:41.126718] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T18:42:41.257872] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-09-15T18:42:42.031263] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-15T18:42:42.057819] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-09-15T18:42:42.448036] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T18:42:42.857924] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-09-15T18:42:43.310599] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-15T18:42:43.657933] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-09-15T18:42:43.932105] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-15T18:42:44.194053] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-15T18:42:44.457867] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-09-15T18:42:45.007105] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-15T18:42:45.257907] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-09-15T18:42:46.057881] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-09-15T18:42:46.269325] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T18:42:46.857881] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-09-15T18:42:47.474252] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-15T18:42:47.571559] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-15T18:42:47.657888] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-09-15T18:42:48.457885] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-09-15T18:42:49.029626] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-15T18:42:49.031005] [INFO ] [REMOTE ] GRX: Full fetch complete (4511 records). [2025-09-15T18:42:49.031079] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-09-15T18:42:49.269670] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-09-15T18:42:49.346629] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-15T18:42:49.441677] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-09-15T18:42:49.441762] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-09-15T18:42:49.441903] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-09-15T18:42:49.441950] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-09-15T18:42:49.442345] [DEBUG] [LOCAL ] GRX: Trimmed 4511 records to 3278 (keeping 150 days of data) [2025-09-15T18:42:49.463679] [DEBUG] [LOCAL ] GRX: Primary data saved (3278 records). [2025-09-15T18:42:49.463824] [INFO ] [MAIN ] GRX: Full history saved. [2025-09-15T18:42:49.463928] [INFO ] [MAIN ] Update Progress: 971/2369 symbols completed. GRX took 21.3s. Estimated remaining: 2h 27m 58s. Rate: 9.4 symbols/min [2025-09-15T18:42:49.637068] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:42:49.674808] [DEBUG] [LOCAL ] GSK: Loaded 40276 existing records from primary storage. [2025-09-15T18:42:49.674988] [INFO ] [MAIN ] GSK: Loaded 40276 existing records. [2025-09-15T18:42:49.850341] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:42:49.850628] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-09-15T18:42:49.850696] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-09-15T18:42:49.851703] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-09-15T18:42:49.851755] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-09-15T18:42:50.067708] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-09-15T18:42:50.225676] [INFO ] [REMOTE ] GSK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:42:50.857901] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-09-15T18:42:50.930999] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-15T18:42:51.276503] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-15T18:42:51.657894] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-09-15T18:42:51.962466] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-15T18:42:52.457892] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-09-15T18:42:53.057508] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-15T18:42:53.058726] [INFO ] [REMOTE ] GROV: Full fetch complete (10079 records). [2025-09-15T18:42:53.058791] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-09-15T18:42:53.263042] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-09-15T18:42:53.434813] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-09-15T18:42:53.434911] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-09-15T18:42:53.435180] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-09-15T18:42:53.435229] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-09-15T18:42:53.435904] [DEBUG] [LOCAL ] GROV: Trimmed 10079 records to 6809 (keeping 150 days of data) [2025-09-15T18:42:53.500449] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-15T18:42:53.517776] [DEBUG] [LOCAL ] GROV: Primary data saved (6809 records). [2025-09-15T18:42:53.517860] [INFO ] [MAIN ] GROV: Full history saved. [2025-09-15T18:42:53.517942] [INFO ] [MAIN ] Update Progress: 972/2369 symbols completed. GROV took 31.2s. Estimated remaining: 2h 27m 48s. Rate: 9.5 symbols/min [2025-09-15T18:42:53.683549] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:42:53.706488] [DEBUG] [LOCAL ] GSL: Loaded 24791 existing records from primary storage. [2025-09-15T18:42:53.706609] [INFO ] [MAIN ] GSL: Loaded 24791 existing records. [2025-09-15T18:42:53.883199] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:42:53.883485] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-09-15T18:42:53.883532] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-09-15T18:42:53.884298] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-09-15T18:42:53.884358] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-09-15T18:42:54.068553] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-09-15T18:42:54.242888] [INFO ] [REMOTE ] GSL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:42:54.864024] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-09-15T18:42:54.877892] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T18:42:55.657941] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-09-15T18:42:55.793429] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-15T18:42:56.402419] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-15T18:42:56.457829] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-09-15T18:42:57.145246] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-15T18:42:57.257865] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-09-15T18:42:57.899476] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-15T18:42:58.057864] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-09-15T18:42:58.350525] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-15T18:42:58.857881] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-09-15T18:42:59.441259] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-15T18:42:59.657896] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-09-15T18:43:00.457920] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-09-15T18:43:00.798369] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-15T18:43:01.215328] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T18:43:01.257815] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-09-15T18:43:02.057935] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-09-15T18:43:02.152540] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T18:43:02.358520] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-15T18:43:02.857935] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-09-15T18:43:03.629547] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T18:43:03.657819] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-09-15T18:43:04.457977] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-09-15T18:43:04.962820] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-15T18:43:05.257885] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-09-15T18:43:05.328684] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-15T18:43:06.063909] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-09-15T18:43:06.077730] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-15T18:43:06.857945] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-09-15T18:43:07.237437] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-15T18:43:07.658150] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-09-15T18:43:07.689512] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-15T18:43:07.908223] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-15T18:43:07.912134] [INFO ] [REMOTE ] GSBD: Full fetch complete (42238 records). [2025-09-15T18:43:07.912224] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-09-15T18:43:07.912870] [FATAL] [VALIDATOR ] GSBD: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:43:07.912947] [FATAL] [MAIN ] GSBD: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:43:07.912984] [WARN ] [MAIN ] GSBD: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:43:07.913022] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-09-15T18:43:07.913079] [DEBUG] [LOCAL ] GSBD: No primary data file found to delete. [2025-09-15T18:43:07.913137] [INFO ] [LOCAL ] GSBD: Starting deletion of derivative data. [2025-09-15T18:43:07.913429] [DEBUG] [LOCAL ] GSBD: Deleted derivative data file. [2025-09-15T18:43:07.913515] [INFO ] [MAIN ] Update Progress: 973/2369 symbols completed. GSBD took 27.9s. Estimated remaining: 2h 27m 53s. Rate: 9.4 symbols/min [2025-09-15T18:43:08.082577] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:43:08.119172] [DEBUG] [LOCAL ] GTES: Loaded 37744 existing records from primary storage. [2025-09-15T18:43:08.119355] [INFO ] [MAIN ] GTES: Loaded 37744 existing records. [2025-09-15T18:43:08.299428] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:43:08.299746] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-09-15T18:43:08.299794] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-09-15T18:43:08.300527] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-09-15T18:43:08.300581] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-09-15T18:43:08.470536] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-09-15T18:43:08.653675] [INFO ] [REMOTE ] GTES: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:43:09.257898] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-09-15T18:43:09.570133] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-15T18:43:09.603273] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T18:43:10.057896] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-09-15T18:43:10.857902] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-09-15T18:43:10.945303] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T18:43:11.657896] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-09-15T18:43:11.879896] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-15T18:43:12.265699] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T18:43:12.269572] [INFO ] [REMOTE ] GSL: Full fetch complete (37030 records). [2025-09-15T18:43:12.269686] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-09-15T18:43:12.462978] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-09-15T18:43:12.660631] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-09-15T18:43:12.660727] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-09-15T18:43:12.661354] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-09-15T18:43:12.661408] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-09-15T18:43:12.662525] [DEBUG] [LOCAL ] GSL: Trimmed 37030 records to 24348 (keeping 150 days of data) [2025-09-15T18:43:12.819465] [DEBUG] [LOCAL ] GSL: Primary data saved (24348 records). [2025-09-15T18:43:12.819624] [INFO ] [MAIN ] GSL: Full history saved. [2025-09-15T18:43:12.819747] [INFO ] [MAIN ] Update Progress: 974/2369 symbols completed. GSL took 19.3s. Estimated remaining: 2h 27m 45s. Rate: 9.4 symbols/min [2025-09-15T18:43:12.992282] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:43:13.026200] [DEBUG] [LOCAL ] GTLS: Loaded 32460 existing records from primary storage. [2025-09-15T18:43:13.026346] [INFO ] [MAIN ] GTLS: Loaded 32460 existing records. [2025-09-15T18:43:13.213547] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:43:13.214037] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-09-15T18:43:13.214137] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-09-15T18:43:13.215044] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-09-15T18:43:13.215100] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-09-15T18:43:13.258186] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-09-15T18:43:13.537547] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-15T18:43:13.626947] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:43:14.041860] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-15T18:43:14.049237] [INFO ] [REMOTE ] GS: Full fetch complete (56916 records). [2025-09-15T18:43:14.049365] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-09-15T18:43:14.063381] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-09-15T18:43:14.448818] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-09-15T18:43:14.448933] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-09-15T18:43:14.449856] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-09-15T18:43:14.449909] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-09-15T18:43:14.452916] [DEBUG] [LOCAL ] GS: Trimmed 56916 records to 38263 (keeping 150 days of data) [2025-09-15T18:43:14.739568] [DEBUG] [LOCAL ] GS: Primary data saved (38263 records). [2025-09-15T18:43:14.739753] [INFO ] [MAIN ] GS: Full history saved. [2025-09-15T18:43:14.741284] [INFO ] [MAIN ] Update Progress: 975/2369 symbols completed. GS took 37.0s. Estimated remaining: 2h 27m 32s. Rate: 9.4 symbols/min [2025-09-15T18:43:14.863018] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-09-15T18:43:14.919566] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:43:14.962737] [DEBUG] [LOCAL ] GTN: Loaded 33979 existing records from primary storage. [2025-09-15T18:43:14.962926] [INFO ] [MAIN ] GTN: Loaded 33979 existing records. [2025-09-15T18:43:15.143480] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:43:15.143745] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-09-15T18:43:15.143794] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-09-15T18:43:15.144483] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-09-15T18:43:15.144540] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-09-15T18:43:15.489377] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-15T18:43:15.522028] [INFO ] [REMOTE ] GTN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:43:15.529525] [INFO ] [REMOTE ] GSK: Full fetch complete (58180 records). [2025-09-15T18:43:15.529710] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-09-15T18:43:15.660403] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-09-15T18:43:15.856436] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-15T18:43:15.952045] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-09-15T18:43:15.952146] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-09-15T18:43:15.953037] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-09-15T18:43:15.953087] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-09-15T18:43:15.954525] [DEBUG] [LOCAL ] GSK: Trimmed 58180 records to 39497 (keeping 150 days of data) [2025-09-15T18:43:16.243365] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-15T18:43:16.262965] [DEBUG] [LOCAL ] GSK: Primary data saved (39497 records). [2025-09-15T18:43:16.263208] [INFO ] [MAIN ] GSK: Full history saved. [2025-09-15T18:43:16.263957] [INFO ] [MAIN ] Update Progress: 976/2369 symbols completed. GSK took 26.8s. Estimated remaining: 2h 27m 19s. Rate: 9.5 symbols/min [2025-09-15T18:43:16.437383] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:43:16.461237] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-09-15T18:43:16.462859] [DEBUG] [LOCAL ] GTY: Loaded 22048 existing records from primary storage. [2025-09-15T18:43:16.463019] [INFO ] [MAIN ] GTY: Loaded 22048 existing records. [2025-09-15T18:43:16.637741] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:43:16.638046] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-09-15T18:43:16.638104] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-09-15T18:43:16.638603] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-09-15T18:43:16.638676] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-09-15T18:43:17.002456] [INFO ] [REMOTE ] GTY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:43:17.257880] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-09-15T18:43:17.622707] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-15T18:43:17.688723] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-15T18:43:18.056470] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-15T18:43:18.058479] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-09-15T18:43:18.857864] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-09-15T18:43:19.537721] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T18:43:19.657822] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-09-15T18:43:20.227916] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-15T18:43:20.457933] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-09-15T18:43:20.980429] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T18:43:21.257880] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-09-15T18:43:21.721361] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-15T18:43:22.057888] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-09-15T18:43:22.561755] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T18:43:22.857903] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-09-15T18:43:23.664049] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-09-15T18:43:23.666773] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T18:43:24.417099] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-15T18:43:24.457929] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-09-15T18:43:24.945586] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-15T18:43:25.257911] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-09-15T18:43:25.635850] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-15T18:43:26.057877] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-09-15T18:43:26.432436] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-15T18:43:26.857889] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-09-15T18:43:27.657912] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-09-15T18:43:27.761741] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-15T18:43:28.198599] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-15T18:43:28.457939] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-09-15T18:43:29.257854] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-09-15T18:43:29.293091] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-15T18:43:29.963352] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T18:43:30.057865] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-09-15T18:43:30.857840] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-09-15T18:43:30.910840] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T18:43:31.529242] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T18:43:31.657850] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-09-15T18:43:32.304481] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-15T18:43:32.457882] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-09-15T18:43:33.168279] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T18:43:33.257831] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-09-15T18:43:34.057912] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-09-15T18:43:34.169323] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-15T18:43:34.857870] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-09-15T18:43:34.897623] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-15T18:43:35.657987] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-09-15T18:43:35.796306] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-15T18:43:36.113115] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T18:43:36.118432] [INFO ] [REMOTE ] GTLS: Full fetch complete (46445 records). [2025-09-15T18:43:36.118561] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-09-15T18:43:36.468011] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-09-15T18:43:36.512265] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-09-15T18:43:36.512358] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-09-15T18:43:36.513127] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-09-15T18:43:36.513186] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-09-15T18:43:36.514159] [DEBUG] [LOCAL ] GTLS: Trimmed 46445 records to 31961 (keeping 150 days of data) [2025-09-15T18:43:36.647776] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T18:43:36.659956] [INFO ] [REMOTE ] GTY: Full fetch complete (32915 records). [2025-09-15T18:43:36.691149] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-09-15T18:43:37.112227] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-09-15T18:43:37.112866] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-09-15T18:43:37.114197] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-09-15T18:43:37.114868] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-09-15T18:43:37.118202] [DEBUG] [LOCAL ] GTY: Trimmed 32915 records to 21698 (keeping 150 days of data) [2025-09-15T18:43:37.122655] [DEBUG] [LOCAL ] GTLS: Primary data saved (31961 records). [2025-09-15T18:43:37.122743] [INFO ] [MAIN ] GTLS: Full history saved. [2025-09-15T18:43:37.122847] [INFO ] [MAIN ] Update Progress: 977/2369 symbols completed. GTLS took 24.3s. Estimated remaining: 2h 27m 33s. Rate: 9.4 symbols/min [2025-09-15T18:43:37.261201] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-09-15T18:43:37.474384] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:43:37.475816] [DEBUG] [LOCAL ] GTY: Primary data saved (21698 records). [2025-09-15T18:43:37.476263] [INFO ] [MAIN ] GTY: Full history saved. [2025-09-15T18:43:37.476375] [INFO ] [MAIN ] Update Progress: 978/2369 symbols completed. GTY took 21.2s. Estimated remaining: 2h 27m 18s. Rate: 9.4 symbols/min [2025-09-15T18:43:37.597509] [DEBUG] [LOCAL ] GUG: Loaded 9060 existing records from primary storage. [2025-09-15T18:43:37.607902] [INFO ] [MAIN ] GUG: Loaded 9060 existing records. [2025-09-15T18:43:37.769218] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:43:37.850399] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:43:37.850757] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-09-15T18:43:37.850810] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-09-15T18:43:37.851310] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-09-15T18:43:37.856025] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-09-15T18:43:37.925213] [DEBUG] [LOCAL ] GUT: Loaded 11603 existing records from primary storage. [2025-09-15T18:43:37.956834] [INFO ] [MAIN ] GUT: Loaded 11603 existing records. [2025-09-15T18:43:38.327766] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:43:38.351982] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-09-15T18:43:38.355860] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-09-15T18:43:38.434343] [INFO ] [REMOTE ] GUG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:43:38.434420] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-09-15T18:43:38.434846] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-09-15T18:43:38.435150] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-09-15T18:43:38.532494] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-15T18:43:38.578345] [INFO ] [REMOTE ] GTES: Full fetch complete (55314 records). [2025-09-15T18:43:38.601943] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-09-15T18:43:39.017532] [INFO ] [REMOTE ] GUT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:43:39.050070] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-09-15T18:43:39.138091] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-15T18:43:39.198719] [INFO ] [REMOTE ] GTN: Full fetch complete (49861 records). [2025-09-15T18:43:39.199770] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-15T18:43:39.199327] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-09-15T18:43:39.332938] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-09-15T18:43:39.347801] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-09-15T18:43:39.359606] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-09-15T18:43:39.359798] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-09-15T18:43:39.420590] [DEBUG] [LOCAL ] GTES: Trimmed 55314 records to 37017 (keeping 150 days of data) [2025-09-15T18:43:39.658781] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-09-15T18:43:39.734851] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-09-15T18:43:39.735177] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-09-15T18:43:39.736524] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-09-15T18:43:39.736839] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-09-15T18:43:39.740542] [DEBUG] [LOCAL ] GTN: Trimmed 49861 records to 33382 (keeping 150 days of data) [2025-09-15T18:43:39.851307] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-15T18:43:40.080251] [DEBUG] [LOCAL ] GTN: Primary data saved (33382 records). [2025-09-15T18:43:40.080918] [INFO ] [MAIN ] GTN: Full history saved. [2025-09-15T18:43:40.081256] [INFO ] [MAIN ] Update Progress: 979/2369 symbols completed. GTN took 25.3s. Estimated remaining: 2h 27m 7s. Rate: 9.4 symbols/min [2025-09-15T18:43:40.258213] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:43:40.260779] [DEBUG] [LOCAL ] GTES: Primary data saved (37017 records). [2025-09-15T18:43:40.261159] [INFO ] [MAIN ] GTES: Full history saved. [2025-09-15T18:43:40.262293] [INFO ] [MAIN ] Update Progress: 980/2369 symbols completed. GTES took 32.3s. Estimated remaining: 2h 26m 52s. Rate: 9.5 symbols/min [2025-09-15T18:43:40.447498] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:43:40.456330] [DEBUG] [LOCAL ] GVA: Loaded 24401 existing records from primary storage. [2025-09-15T18:43:40.456507] [INFO ] [MAIN ] GVA: Loaded 24401 existing records. [2025-09-15T18:43:40.468327] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-09-15T18:43:40.626535] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-15T18:43:40.626015] [DEBUG] [LOCAL ] GWH: Loaded 12881 existing records from primary storage. [2025-09-15T18:43:40.662584] [INFO ] [MAIN ] GWH: Loaded 12881 existing records. [2025-09-15T18:43:40.710244] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:43:40.767864] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-09-15T18:43:40.770499] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-09-15T18:43:40.776211] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-09-15T18:43:40.786477] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-09-15T18:43:40.928296] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:43:40.952600] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-09-15T18:43:40.968209] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-09-15T18:43:41.001115] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-09-15T18:43:41.026571] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-09-15T18:43:41.260849] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-09-15T18:43:41.418864] [INFO ] [REMOTE ] GVA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:43:41.572905] [INFO ] [REMOTE ] GWH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:43:41.573861] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-15T18:43:42.057929] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-09-15T18:43:42.080565] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-15T18:43:42.857872] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-09-15T18:43:42.882614] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-15T18:43:43.399472] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-15T18:43:43.657867] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-09-15T18:43:44.457912] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-09-15T18:43:44.614740] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-15T18:43:44.883218] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-15T18:43:45.257905] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-09-15T18:43:46.057897] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-09-15T18:43:46.677505] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T18:43:46.835427] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-15T18:43:46.857820] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-09-15T18:43:47.657859] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-09-15T18:43:47.846434] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T18:43:48.457933] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-09-15T18:43:48.493106] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-15T18:43:49.169692] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-15T18:43:49.257924] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-09-15T18:43:50.057893] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-09-15T18:43:50.640116] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T18:43:50.857902] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-09-15T18:43:51.126497] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-15T18:43:51.657871] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-09-15T18:43:51.813284] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-15T18:43:52.457914] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-09-15T18:43:52.770538] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-15T18:43:53.257937] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-09-15T18:43:53.525550] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T18:43:54.057885] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-09-15T18:43:54.076526] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-15T18:43:54.831393] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-15T18:43:54.857859] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-09-15T18:43:55.450841] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-15T18:43:55.452820] [INFO ] [REMOTE ] GUG: Full fetch complete (13486 records). [2025-09-15T18:43:55.452940] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-09-15T18:43:55.663145] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-09-15T18:43:56.036771] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-09-15T18:43:56.036909] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-09-15T18:43:56.037535] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-09-15T18:43:56.037610] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-09-15T18:43:56.038750] [DEBUG] [LOCAL ] GUG: Trimmed 13486 records to 8754 (keeping 150 days of data) [2025-09-15T18:43:56.106887] [DEBUG] [LOCAL ] GUG: Primary data saved (8754 records). [2025-09-15T18:43:56.107098] [INFO ] [MAIN ] GUG: Full history saved. [2025-09-15T18:43:56.107210] [INFO ] [MAIN ] Update Progress: 981/2369 symbols completed. GUG took 19.0s. Estimated remaining: 2h 26m 59s. Rate: 9.4 symbols/min [2025-09-15T18:43:56.323669] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:43:56.339125] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T18:43:56.384791] [DEBUG] [LOCAL ] GWRE: Loaded 30251 existing records from primary storage. [2025-09-15T18:43:56.384953] [INFO ] [MAIN ] GWRE: Loaded 30251 existing records. [2025-09-15T18:43:56.463035] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-09-15T18:43:56.577685] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:43:56.577966] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-09-15T18:43:56.578014] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-09-15T18:43:56.578936] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-09-15T18:43:56.578999] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-09-15T18:43:56.942776] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:43:57.257884] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-09-15T18:43:57.841383] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-15T18:43:58.057899] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-09-15T18:43:58.108034] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-15T18:43:58.110165] [INFO ] [REMOTE ] GUT: Full fetch complete (16936 records). [2025-09-15T18:43:58.110236] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-09-15T18:43:58.471310] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-09-15T18:43:58.471388] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-09-15T18:43:58.471777] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-09-15T18:43:58.471822] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-09-15T18:43:58.472386] [DEBUG] [LOCAL ] GUT: Trimmed 16936 records to 11442 (keeping 150 days of data) [2025-09-15T18:43:58.540610] [DEBUG] [LOCAL ] GUT: Primary data saved (11442 records). [2025-09-15T18:43:58.540768] [INFO ] [MAIN ] GUT: Full history saved. [2025-09-15T18:43:58.540855] [INFO ] [MAIN ] Update Progress: 982/2369 symbols completed. GUT took 21.1s. Estimated remaining: 2h 26m 47s. Rate: 9.4 symbols/min [2025-09-15T18:43:58.708806] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:43:58.724613] [DEBUG] [LOCAL ] GWW: Loaded 14121 existing records from primary storage. [2025-09-15T18:43:58.724768] [INFO ] [MAIN ] GWW: Loaded 14121 existing records. [2025-09-15T18:43:58.863029] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-09-15T18:43:58.931057] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:43:58.931376] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-09-15T18:43:58.931428] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-09-15T18:43:58.932184] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-09-15T18:43:58.932424] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-09-15T18:43:59.123025] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-15T18:43:59.316248] [INFO ] [REMOTE ] GWW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:43:59.657931] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-09-15T18:44:00.457904] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-09-15T18:44:00.661547] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-15T18:44:00.664065] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-15T18:44:00.670507] [INFO ] [REMOTE ] GWH: Full fetch complete (16172 records). [2025-09-15T18:44:00.678824] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-09-15T18:44:01.048160] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-09-15T18:44:01.048242] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-09-15T18:44:01.048611] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-09-15T18:44:01.048671] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-09-15T18:44:01.049224] [DEBUG] [LOCAL ] GWH: Trimmed 16172 records to 12801 (keeping 150 days of data) [2025-09-15T18:44:01.124826] [DEBUG] [LOCAL ] GWH: Primary data saved (12801 records). [2025-09-15T18:44:01.124973] [INFO ] [MAIN ] GWH: Full history saved. [2025-09-15T18:44:01.125060] [INFO ] [MAIN ] Update Progress: 983/2369 symbols completed. GWH took 20.9s. Estimated remaining: 2h 26m 35s. Rate: 9.5 symbols/min [2025-09-15T18:44:01.271611] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-09-15T18:44:01.305196] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:44:01.341553] [DEBUG] [LOCAL ] GXO: Loaded 34988 existing records from primary storage. [2025-09-15T18:44:01.341788] [INFO ] [MAIN ] GXO: Loaded 34988 existing records. [2025-09-15T18:44:01.529106] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:44:01.529404] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-09-15T18:44:01.529466] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-09-15T18:44:01.530316] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-09-15T18:44:01.530402] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-09-15T18:44:01.888724] [INFO ] [REMOTE ] GXO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:44:01.910795] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-15T18:44:02.057869] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-09-15T18:44:02.862279] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-09-15T18:44:02.868138] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-15T18:44:03.241185] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-15T18:44:03.657881] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-09-15T18:44:04.457896] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-09-15T18:44:04.664113] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-15T18:44:04.706933] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-15T18:44:05.257889] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-09-15T18:44:05.923983] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T18:44:06.057901] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-09-15T18:44:06.857900] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-09-15T18:44:06.933135] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T18:44:07.347574] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T18:44:07.657838] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-09-15T18:44:07.723768] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-15T18:44:08.457875] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-09-15T18:44:09.257897] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-09-15T18:44:09.328941] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T18:44:09.430391] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-15T18:44:10.057901] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-09-15T18:44:10.215967] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-15T18:44:10.219439] [INFO ] [REMOTE ] GVA: Full fetch complete (37254 records). [2025-09-15T18:44:10.219526] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-09-15T18:44:10.615936] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-09-15T18:44:10.616016] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-09-15T18:44:10.616701] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-09-15T18:44:10.616755] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-09-15T18:44:10.617600] [DEBUG] [LOCAL ] GVA: Trimmed 37254 records to 23856 (keeping 150 days of data) [2025-09-15T18:44:10.760598] [DEBUG] [LOCAL ] GVA: Primary data saved (23856 records). [2025-09-15T18:44:10.760742] [INFO ] [MAIN ] GVA: Full history saved. [2025-09-15T18:44:10.760839] [INFO ] [MAIN ] Update Progress: 984/2369 symbols completed. GVA took 30.7s. Estimated remaining: 2h 26m 33s. Rate: 9.5 symbols/min [2025-09-15T18:44:10.859622] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-09-15T18:44:10.929282] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:44:10.932178] [DEBUG] [LOCAL ] GYLD: Loaded 1127 existing records from primary storage. [2025-09-15T18:44:10.932250] [INFO ] [MAIN ] GYLD: Loaded 1127 existing records. [2025-09-15T18:44:11.108396] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:44:11.108681] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-09-15T18:44:11.108728] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-09-15T18:44:11.108890] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-09-15T18:44:11.108933] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-09-15T18:44:11.461347] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:44:11.657847] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-09-15T18:44:11.700270] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-15T18:44:11.740009] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-15T18:44:12.021797] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-15T18:44:12.457925] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-09-15T18:44:12.884206] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-15T18:44:13.257885] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-09-15T18:44:14.057876] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-09-15T18:44:14.862944] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-09-15T18:44:14.878752] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-15T18:44:15.015717] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-15T18:44:15.657938] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-09-15T18:44:16.160412] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-15T18:44:16.411298] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-15T18:44:16.457911] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-09-15T18:44:17.257885] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-09-15T18:44:17.465439] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-15T18:44:18.057878] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-09-15T18:44:18.649559] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-15T18:44:18.685150] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-15T18:44:18.857874] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-09-15T18:44:19.657962] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-09-15T18:44:20.356250] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-15T18:44:20.457864] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-09-15T18:44:21.091130] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T18:44:21.257911] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-09-15T18:44:22.054502] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T18:44:22.058903] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-09-15T18:44:22.060358] [INFO ] [REMOTE ] GWRE: Full fetch complete (45330 records). [2025-09-15T18:44:22.060449] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-09-15T18:44:22.441085] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-09-15T18:44:22.441187] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-09-15T18:44:22.441962] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-09-15T18:44:22.442019] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-09-15T18:44:22.443291] [DEBUG] [LOCAL ] GWRE: Trimmed 45330 records to 29708 (keeping 150 days of data) [2025-09-15T18:44:22.633320] [DEBUG] [LOCAL ] GWRE: Primary data saved (29708 records). [2025-09-15T18:44:22.633552] [INFO ] [MAIN ] GWRE: Full history saved. [2025-09-15T18:44:22.633811] [INFO ] [MAIN ] Update Progress: 985/2369 symbols completed. GWRE took 26.5s. Estimated remaining: 2h 26m 35s. Rate: 9.4 symbols/min [2025-09-15T18:44:22.768789] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-15T18:44:22.850001] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:44:22.857908] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-09-15T18:44:22.887559] [DEBUG] [LOCAL ] H: Loaded 33612 existing records from primary storage. [2025-09-15T18:44:22.887727] [INFO ] [MAIN ] H: Loaded 33612 existing records. [2025-09-15T18:44:23.082528] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:44:23.082816] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-09-15T18:44:23.082862] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-09-15T18:44:23.083798] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-09-15T18:44:23.083850] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-09-15T18:44:23.449852] [INFO ] [REMOTE ] H: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:44:23.452768] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-15T18:44:23.468163] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-15T18:44:23.657814] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-09-15T18:44:24.457917] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-09-15T18:44:24.893744] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-15T18:44:25.257837] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-09-15T18:44:25.326417] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-15T18:44:25.539365] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-15T18:44:26.057874] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-09-15T18:44:26.857885] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-09-15T18:44:27.311006] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-15T18:44:27.657883] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-09-15T18:44:28.106074] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-15T18:44:28.106923] [INFO ] [REMOTE ] GYLD: Full fetch complete (1628 records). [2025-09-15T18:44:28.106994] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-09-15T18:44:28.457917] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-09-15T18:44:28.480752] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-09-15T18:44:28.481813] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-09-15T18:44:28.482120] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-09-15T18:44:28.482202] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-09-15T18:44:28.482872] [DEBUG] [LOCAL ] GYLD: Trimmed 1628 records to 1104 (keeping 150 days of data) [2025-09-15T18:44:28.491381] [DEBUG] [LOCAL ] GYLD: Primary data saved (1104 records). [2025-09-15T18:44:28.491483] [INFO ] [MAIN ] GYLD: Full history saved. [2025-09-15T18:44:28.491681] [INFO ] [MAIN ] Update Progress: 986/2369 symbols completed. GYLD took 17.7s. Estimated remaining: 2h 26m 28s. Rate: 9.4 symbols/min [2025-09-15T18:44:28.679978] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-15T18:44:28.697390] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:44:28.734968] [DEBUG] [LOCAL ] HAE: Loaded 28379 existing records from primary storage. [2025-09-15T18:44:28.735187] [INFO ] [MAIN ] HAE: Loaded 28379 existing records. [2025-09-15T18:44:28.909230] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:44:28.909513] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-09-15T18:44:28.909573] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-09-15T18:44:28.910274] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-09-15T18:44:28.910325] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-09-15T18:44:29.263051] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-09-15T18:44:29.267206] [INFO ] [REMOTE ] HAE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:44:29.888175] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T18:44:30.057836] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-09-15T18:44:30.802485] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-15T18:44:30.807574] [INFO ] [REMOTE ] GXO: Full fetch complete (52519 records). [2025-09-15T18:44:30.807720] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-09-15T18:44:30.870230] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-09-15T18:44:31.189495] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-09-15T18:44:31.189584] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-09-15T18:44:31.190336] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-09-15T18:44:31.190386] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-09-15T18:44:31.191532] [DEBUG] [LOCAL ] GXO: Trimmed 52519 records to 34160 (keeping 150 days of data) [2025-09-15T18:44:31.399820] [DEBUG] [LOCAL ] GXO: Primary data saved (34160 records). [2025-09-15T18:44:31.399972] [INFO ] [MAIN ] GXO: Full history saved. [2025-09-15T18:44:31.400595] [INFO ] [MAIN ] Update Progress: 987/2369 symbols completed. GXO took 30.3s. Estimated remaining: 2h 26m 17s. Rate: 9.4 symbols/min [2025-09-15T18:44:31.567062] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:44:31.600235] [DEBUG] [LOCAL ] HAFN: Loaded 32231 existing records from primary storage. [2025-09-15T18:44:31.600382] [INFO ] [MAIN ] HAFN: Loaded 32231 existing records. [2025-09-15T18:44:31.664966] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-09-15T18:44:31.781397] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:44:31.781954] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-09-15T18:44:31.782039] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-09-15T18:44:31.797722] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-09-15T18:44:31.805447] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-09-15T18:44:31.864956] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-15T18:44:31.935152] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T18:44:32.214759] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:44:32.457863] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-09-15T18:44:33.206988] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-15T18:44:33.257833] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-09-15T18:44:34.057871] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-09-15T18:44:34.322592] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-15T18:44:34.846145] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-15T18:44:34.857802] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-09-15T18:44:35.428789] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T18:44:35.657864] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-09-15T18:44:36.387128] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-15T18:44:36.457831] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-09-15T18:44:36.834471] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-15T18:44:36.837057] [INFO ] [REMOTE ] GWW: Full fetch complete (21713 records). [2025-09-15T18:44:36.837127] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-09-15T18:44:37.220046] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-09-15T18:44:37.220136] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-09-15T18:44:37.220619] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-09-15T18:44:37.220684] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-09-15T18:44:37.221345] [DEBUG] [LOCAL ] GWW: Trimmed 21713 records to 13875 (keeping 150 days of data) [2025-09-15T18:44:37.261552] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-09-15T18:44:37.315353] [DEBUG] [LOCAL ] GWW: Primary data saved (13875 records). [2025-09-15T18:44:37.315510] [INFO ] [MAIN ] GWW: Full history saved. [2025-09-15T18:44:37.315598] [INFO ] [MAIN ] Update Progress: 988/2369 symbols completed. GWW took 38.8s. Estimated remaining: 2h 26m 10s. Rate: 9.4 symbols/min [2025-09-15T18:44:37.489225] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:44:37.529489] [DEBUG] [LOCAL ] HAL: Loaded 40458 existing records from primary storage. [2025-09-15T18:44:37.529687] [INFO ] [MAIN ] HAL: Loaded 40458 existing records. [2025-09-15T18:44:37.711086] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:44:37.711350] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-09-15T18:44:37.711395] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-09-15T18:44:37.712417] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-09-15T18:44:37.712469] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-09-15T18:44:38.058121] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-09-15T18:44:38.081550] [INFO ] [REMOTE ] HAL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:44:38.102836] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-15T18:44:38.849610] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-15T18:44:38.859764] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-09-15T18:44:39.658432] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-09-15T18:44:39.660925] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-15T18:44:40.457896] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-09-15T18:44:40.523395] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-15T18:44:41.084588] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T18:44:41.257920] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-09-15T18:44:42.067752] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-09-15T18:44:42.072896] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-15T18:44:42.857909] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-09-15T18:44:42.972519] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-15T18:44:43.565440] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T18:44:43.657827] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-09-15T18:44:44.457949] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-09-15T18:44:44.955979] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-15T18:44:45.155302] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-15T18:44:45.257906] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-09-15T18:44:46.057882] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-09-15T18:44:46.268230] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-15T18:44:46.530673] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T18:44:46.535869] [INFO ] [REMOTE ] HAE: Full fetch complete (43944 records). [2025-09-15T18:44:46.536001] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-09-15T18:44:46.863638] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-09-15T18:44:46.911500] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-09-15T18:44:46.911575] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-09-15T18:44:46.912253] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-09-15T18:44:46.912296] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-09-15T18:44:46.913297] [DEBUG] [LOCAL ] HAE: Trimmed 43944 records to 27848 (keeping 150 days of data) [2025-09-15T18:44:47.097117] [DEBUG] [LOCAL ] HAE: Primary data saved (27848 records). [2025-09-15T18:44:47.097265] [INFO ] [MAIN ] HAE: Full history saved. [2025-09-15T18:44:47.097370] [INFO ] [MAIN ] Update Progress: 989/2369 symbols completed. HAE took 18.6s. Estimated remaining: 2h 26m 8s. Rate: 9.4 symbols/min [2025-09-15T18:44:47.282795] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:44:47.321813] [DEBUG] [LOCAL ] HASI: Loaded 35913 existing records from primary storage. [2025-09-15T18:44:47.321962] [INFO ] [MAIN ] HASI: Loaded 35913 existing records. [2025-09-15T18:44:47.503029] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:44:47.503304] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-09-15T18:44:47.503352] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-09-15T18:44:47.504236] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-09-15T18:44:47.504313] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-09-15T18:44:47.664419] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-09-15T18:44:47.885169] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-15T18:44:47.905881] [INFO ] [REMOTE ] HASI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:44:47.910879] [INFO ] [REMOTE ] H: Full fetch complete (49112 records). [2025-09-15T18:44:47.910989] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-09-15T18:44:48.477177] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-09-15T18:44:48.514072] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-09-15T18:44:48.517840] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-15T18:44:48.530563] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-09-15T18:44:48.533682] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-09-15T18:44:48.534679] [DEBUG] [LOCAL ] H: Saving primary data. [2025-09-15T18:44:48.536889] [DEBUG] [LOCAL ] H: Trimmed 49112 records to 32936 (keeping 150 days of data) [2025-09-15T18:44:48.855702] [DEBUG] [LOCAL ] H: Primary data saved (32936 records). [2025-09-15T18:44:48.855875] [INFO ] [MAIN ] H: Full history saved. [2025-09-15T18:44:48.855983] [INFO ] [MAIN ] Update Progress: 990/2369 symbols completed. H took 26.2s. Estimated remaining: 2h 25m 55s. Rate: 9.5 symbols/min [2025-09-15T18:44:49.078150] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:44:49.123875] [DEBUG] [LOCAL ] HAYW: Loaded 36396 existing records from primary storage. [2025-09-15T18:44:49.124057] [INFO ] [MAIN ] HAYW: Loaded 36396 existing records. [2025-09-15T18:44:49.275718] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-09-15T18:44:49.318190] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:44:49.318480] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-09-15T18:44:49.318553] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-09-15T18:44:49.319485] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-09-15T18:44:49.319550] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-09-15T18:44:49.688934] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:44:49.724910] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-15T18:44:49.823479] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T18:44:50.057879] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-09-15T18:44:50.857905] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-09-15T18:44:50.951973] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-15T18:44:51.215123] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-15T18:44:51.657877] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-09-15T18:44:52.458981] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-09-15T18:44:52.461334] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T18:44:53.010142] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T18:44:53.257908] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-09-15T18:44:54.057920] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-09-15T18:44:54.184834] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-15T18:44:54.806183] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T18:44:54.857890] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-09-15T18:44:55.286466] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-15T18:44:55.657929] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-09-15T18:44:56.457883] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-09-15T18:44:56.504513] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-15T18:44:56.509888] [INFO ] [REMOTE ] HAFN: Full fetch complete (48403 records). [2025-09-15T18:44:56.510082] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-09-15T18:44:56.911402] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-09-15T18:44:56.911543] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-09-15T18:44:56.912305] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-09-15T18:44:56.912389] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-09-15T18:44:56.913598] [DEBUG] [LOCAL ] HAFN: Trimmed 48403 records to 31519 (keeping 150 days of data) [2025-09-15T18:44:57.034624] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T18:44:57.143335] [DEBUG] [LOCAL ] HAFN: Primary data saved (31519 records). [2025-09-15T18:44:57.143477] [INFO ] [MAIN ] HAFN: Full history saved. [2025-09-15T18:44:57.143571] [INFO ] [MAIN ] Update Progress: 991/2369 symbols completed. HAFN took 25.7s. Estimated remaining: 2h 25m 52s. Rate: 9.4 symbols/min [2025-09-15T18:44:57.262985] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-09-15T18:44:57.324675] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:44:57.331566] [DEBUG] [LOCAL ] HBB: Loaded 4952 existing records from primary storage. [2025-09-15T18:44:57.331756] [INFO ] [MAIN ] HBB: Loaded 4952 existing records. [2025-09-15T18:44:57.520151] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:44:57.520477] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-09-15T18:44:57.520543] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-09-15T18:44:57.520888] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-09-15T18:44:57.520961] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-09-15T18:44:57.880813] [INFO ] [REMOTE ] HBB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:44:57.932816] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T18:44:58.057867] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-09-15T18:44:58.857889] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-09-15T18:44:59.432524] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-15T18:44:59.657887] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-09-15T18:44:59.680125] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-15T18:44:59.718861] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-15T18:45:00.457894] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-09-15T18:45:01.257900] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-09-15T18:45:01.439287] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-15T18:45:02.057928] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-09-15T18:45:02.101210] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-15T18:45:02.293480] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-15T18:45:02.857917] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-09-15T18:45:03.657918] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-09-15T18:45:04.399379] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-15T18:45:04.457877] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-09-15T18:45:05.183804] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-15T18:45:05.257888] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-09-15T18:45:05.716394] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T18:45:05.987714] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-15T18:45:06.057916] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-09-15T18:45:06.241595] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-09-15T18:45:06.857876] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-09-15T18:45:07.657910] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-09-15T18:45:07.725080] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-15T18:45:08.410901] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-15T18:45:08.416910] [INFO ] [REMOTE ] HAL: Full fetch complete (58398 records). [2025-09-15T18:45:08.417107] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-09-15T18:45:08.463025] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-09-15T18:45:08.801841] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-09-15T18:45:08.801935] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-09-15T18:45:08.802731] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-09-15T18:45:08.802776] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-09-15T18:45:08.804075] [DEBUG] [LOCAL ] HAL: Trimmed 58398 records to 39678 (keeping 150 days of data) [2025-09-15T18:45:09.037378] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-15T18:45:09.069042] [DEBUG] [LOCAL ] HAL: Primary data saved (39678 records). [2025-09-15T18:45:09.069180] [INFO ] [MAIN ] HAL: Full history saved. [2025-09-15T18:45:09.070054] [INFO ] [MAIN ] Update Progress: 992/2369 symbols completed. HAL took 31.8s. Estimated remaining: 2h 25m 53s. Rate: 9.4 symbols/min [2025-09-15T18:45:09.239443] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:45:09.254059] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T18:45:09.258719] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-09-15T18:45:09.260282] [INFO ] [REMOTE ] HASI: Full fetch complete (51399 records). [2025-09-15T18:45:09.260389] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-09-15T18:45:09.553182] [DEBUG] [LOCAL ] HBI: Loaded 39850 existing records from primary storage. [2025-09-15T18:45:09.564595] [INFO ] [MAIN ] HBI: Loaded 39850 existing records. [2025-09-15T18:45:09.846913] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-09-15T18:45:09.851263] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:45:09.851342] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-09-15T18:45:09.852331] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-09-15T18:45:09.851572] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-09-15T18:45:09.852461] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-09-15T18:45:09.852431] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-09-15T18:45:09.853361] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-09-15T18:45:09.853426] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-09-15T18:45:09.884901] [DEBUG] [LOCAL ] HASI: Trimmed 51399 records to 35139 (keeping 150 days of data) [2025-09-15T18:45:10.083829] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-09-15T18:45:10.361760] [INFO ] [REMOTE ] HBI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:45:10.481952] [DEBUG] [LOCAL ] HASI: Primary data saved (35139 records). [2025-09-15T18:45:10.482091] [INFO ] [MAIN ] HASI: Full history saved. [2025-09-15T18:45:10.482176] [INFO ] [MAIN ] Update Progress: 993/2369 symbols completed. HASI took 23.4s. Estimated remaining: 2h 25m 40s. Rate: 9.4 symbols/min [2025-09-15T18:45:10.657575] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:45:10.695633] [DEBUG] [LOCAL ] HBM: Loaded 39770 existing records from primary storage. [2025-09-15T18:45:10.695791] [INFO ] [MAIN ] HBM: Loaded 39770 existing records. [2025-09-15T18:45:10.857838] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-09-15T18:45:10.877408] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:45:10.878480] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-09-15T18:45:10.878587] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-09-15T18:45:10.879452] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-09-15T18:45:10.879504] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-09-15T18:45:11.134138] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-15T18:45:11.209405] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-15T18:45:11.309388] [INFO ] [REMOTE ] HBM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:45:11.657885] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-09-15T18:45:12.378452] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-15T18:45:12.457891] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-09-15T18:45:12.623865] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-15T18:45:12.945681] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-15T18:45:12.946574] [INFO ] [REMOTE ] HBB: Full fetch complete (7573 records). [2025-09-15T18:45:12.946660] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-09-15T18:45:12.947042] [FATAL] [VALIDATOR ] HBB: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:45:12.947120] [FATAL] [MAIN ] HBB: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:45:12.947157] [WARN ] [MAIN ] HBB: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:45:12.947194] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-09-15T18:45:12.947250] [DEBUG] [LOCAL ] HBB: No primary data file found to delete. [2025-09-15T18:45:12.947297] [INFO ] [LOCAL ] HBB: Starting deletion of derivative data. [2025-09-15T18:45:12.947609] [DEBUG] [LOCAL ] HBB: Deleted derivative data file. [2025-09-15T18:45:12.947708] [INFO ] [MAIN ] Update Progress: 994/2369 symbols completed. HBB took 15.8s. Estimated remaining: 2h 25m 28s. Rate: 9.5 symbols/min [2025-09-15T18:45:13.116082] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:45:13.152576] [DEBUG] [LOCAL ] HCA: Loaded 35505 existing records from primary storage. [2025-09-15T18:45:13.152766] [INFO ] [MAIN ] HCA: Loaded 35505 existing records. [2025-09-15T18:45:13.263027] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-09-15T18:45:13.335266] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:45:13.335539] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-09-15T18:45:13.335606] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-09-15T18:45:13.336639] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-09-15T18:45:13.336730] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-09-15T18:45:13.708159] [INFO ] [REMOTE ] HCA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:45:14.057876] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-09-15T18:45:14.857875] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-09-15T18:45:15.108993] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-15T18:45:15.494741] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-15T18:45:15.657875] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-09-15T18:45:16.457867] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-09-15T18:45:17.257850] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-09-15T18:45:17.338102] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-09-15T18:45:17.989420] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-15T18:45:17.995122] [INFO ] [REMOTE ] HAYW: Full fetch complete (53053 records). [2025-09-15T18:45:17.995227] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-09-15T18:45:18.064781] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-09-15T18:45:18.389945] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-09-15T18:45:18.390053] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-09-15T18:45:18.391122] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-09-15T18:45:18.391177] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-09-15T18:45:18.392540] [DEBUG] [LOCAL ] HAYW: Trimmed 53053 records to 35753 (keeping 150 days of data) [2025-09-15T18:45:18.619890] [DEBUG] [LOCAL ] HAYW: Primary data saved (35753 records). [2025-09-15T18:45:18.620040] [INFO ] [MAIN ] HAYW: Full history saved. [2025-09-15T18:45:18.620158] [INFO ] [MAIN ] Update Progress: 995/2369 symbols completed. HAYW took 29.8s. Estimated remaining: 2h 25m 21s. Rate: 9.5 symbols/min [2025-09-15T18:45:18.850443] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:45:18.882897] [DEBUG] [LOCAL ] HCC: Loaded 34006 existing records from primary storage. [2025-09-15T18:45:18.883043] [INFO ] [MAIN ] HCC: Loaded 34006 existing records. [2025-09-15T18:45:19.067442] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:45:19.067748] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-09-15T18:45:19.067800] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-09-15T18:45:19.068500] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-09-15T18:45:19.068556] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-09-15T18:45:19.436089] [INFO ] [REMOTE ] HCC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:45:19.436544] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-09-15T18:45:19.470986] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (3.01 seconds). [2025-09-15T18:45:19.515696] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-15T18:45:19.657876] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-09-15T18:45:20.069561] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-15T18:45:20.457864] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-09-15T18:45:20.905062] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-15T18:45:21.133477] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T18:45:21.257879] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-09-15T18:45:22.057882] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-09-15T18:45:22.096046] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T18:45:22.614811] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-15T18:45:22.857883] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-09-15T18:45:23.657887] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-09-15T18:45:23.890149] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-15T18:45:24.244160] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-15T18:45:24.457860] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-09-15T18:45:25.257861] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-09-15T18:45:25.315951] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-15T18:45:26.057866] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-09-15T18:45:26.458308] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-15T18:45:26.857876] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-09-15T18:45:26.993030] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-15T18:45:27.441371] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T18:45:27.657823] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-09-15T18:45:28.457891] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-09-15T18:45:28.490942] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T18:45:29.257844] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-09-15T18:45:29.302534] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-15T18:45:30.057865] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-09-15T18:45:30.167982] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-15T18:45:30.697316] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T18:45:30.857867] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-09-15T18:45:31.516454] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T18:45:31.522441] [INFO ] [REMOTE ] HBM: Full fetch complete (57558 records). [2025-09-15T18:45:31.522563] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-09-15T18:45:31.666997] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-09-15T18:45:31.915663] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-09-15T18:45:31.915795] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-09-15T18:45:31.916657] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-09-15T18:45:31.916732] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-09-15T18:45:31.919215] [DEBUG] [LOCAL ] HBM: Trimmed 57558 records to 38996 (keeping 150 days of data) [2025-09-15T18:45:32.165724] [DEBUG] [LOCAL ] HBM: Primary data saved (38996 records). [2025-09-15T18:45:32.165871] [INFO ] [MAIN ] HBM: Full history saved. [2025-09-15T18:45:32.166660] [INFO ] [MAIN ] Update Progress: 996/2369 symbols completed. HBM took 21.7s. Estimated remaining: 2h 25m 24s. Rate: 9.4 symbols/min [2025-09-15T18:45:32.338505] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:45:32.353031] [DEBUG] [LOCAL ] HCI: Loaded 10468 existing records from primary storage. [2025-09-15T18:45:32.353165] [INFO ] [MAIN ] HCI: Loaded 10468 existing records. [2025-09-15T18:45:32.462959] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-09-15T18:45:32.537937] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:45:32.538381] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-09-15T18:45:32.538595] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-09-15T18:45:32.539094] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-09-15T18:45:32.539157] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-09-15T18:45:32.939819] [INFO ] [REMOTE ] HCI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:45:32.945283] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-15T18:45:33.000511] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T18:45:33.257907] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-09-15T18:45:34.067432] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-09-15T18:45:34.088111] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-15T18:45:34.436090] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-15T18:45:34.857874] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-09-15T18:45:34.982434] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-15T18:45:35.657888] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-09-15T18:45:36.457906] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-09-15T18:45:36.706397] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-15T18:45:37.079029] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T18:45:37.257899] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-09-15T18:45:37.983332] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-15T18:45:38.057830] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-09-15T18:45:38.424972] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-15T18:45:38.857915] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-09-15T18:45:39.657889] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-09-15T18:45:39.769311] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-15T18:45:39.778977] [INFO ] [REMOTE ] HCA: Full fetch complete (51819 records). [2025-09-15T18:45:39.779251] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-09-15T18:45:40.155888] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-09-15T18:45:40.155980] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-09-15T18:45:40.156720] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-09-15T18:45:40.156822] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-09-15T18:45:40.158589] [DEBUG] [LOCAL ] HCA: Trimmed 51819 records to 34822 (keeping 150 days of data) [2025-09-15T18:45:40.387668] [DEBUG] [LOCAL ] HCA: Primary data saved (34822 records). [2025-09-15T18:45:40.387824] [INFO ] [MAIN ] HCA: Full history saved. [2025-09-15T18:45:40.388394] [INFO ] [MAIN ] Update Progress: 997/2369 symbols completed. HCA took 27.4s. Estimated remaining: 2h 25m 21s. Rate: 9.4 symbols/min [2025-09-15T18:45:40.457869] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-09-15T18:45:40.609610] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-15T18:45:40.617158] [INFO ] [REMOTE ] HBI: Full fetch complete (57724 records). [2025-09-15T18:45:40.617280] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-09-15T18:45:40.997754] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-09-15T18:45:40.997911] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-09-15T18:45:40.998828] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-09-15T18:45:40.998911] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-09-15T18:45:41.012544] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T18:45:41.012676] [DEBUG] [LOCAL ] HBI: Trimmed 57724 records to 39082 (keeping 150 days of data) [2025-09-15T18:45:41.017728] [INFO ] [REMOTE ] HCC: Full fetch complete (49549 records). [2025-09-15T18:45:41.017805] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-09-15T18:45:41.295332] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-15T18:45:41.354043] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-09-15T18:45:41.521974] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-09-15T18:45:41.523688] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-09-15T18:45:41.525094] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-09-15T18:45:41.525457] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-09-15T18:45:41.530033] [DEBUG] [LOCAL ] HCC: Trimmed 49549 records to 33376 (keeping 150 days of data) [2025-09-15T18:45:41.834075] [DEBUG] [LOCAL ] HCC: Primary data saved (33376 records). [2025-09-15T18:45:41.835893] [INFO ] [MAIN ] HCC: Full history saved. [2025-09-15T18:45:41.837105] [INFO ] [MAIN ] Update Progress: 998/2369 symbols completed. HCC took 23.2s. Estimated remaining: 2h 25m 8s. Rate: 9.4 symbols/min [2025-09-15T18:45:41.859180] [DEBUG] [LOCAL ] HBI: Primary data saved (39082 records). [2025-09-15T18:45:41.859347] [INFO ] [MAIN ] HBI: Full history saved. [2025-09-15T18:45:41.860183] [INFO ] [MAIN ] Update Progress: 999/2369 symbols completed. HBI took 32.8s. Estimated remaining: 2h 24m 52s. Rate: 9.5 symbols/min [2025-09-15T18:45:42.062124] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-15T18:45:42.065723] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-09-15T18:45:42.973811] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-15T18:45:42.977387] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-09-15T18:45:43.720847] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-15T18:45:43.724845] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-09-15T18:45:44.693121] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-15T18:45:44.697152] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-09-15T18:45:45.638472] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-15T18:45:45.641865] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-09-15T18:45:46.594463] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-15T18:45:46.596520] [INFO ] [REMOTE ] HCI: Full fetch complete (14966 records). [2025-09-15T18:45:46.596604] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-09-15T18:45:46.967419] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-09-15T18:45:46.967498] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-09-15T18:45:46.967837] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-09-15T18:45:46.967881] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-09-15T18:45:46.968390] [DEBUG] [LOCAL ] HCI: Trimmed 14966 records to 10345 (keeping 150 days of data) [2025-09-15T18:45:47.036183] [DEBUG] [LOCAL ] HCI: Primary data saved (10345 records). [2025-09-15T18:45:47.036325] [INFO ] [MAIN ] HCI: Full history saved. [2025-09-15T18:45:47.036409] [INFO ] [MAIN ] Update Progress: 1000/2369 symbols completed. HCI took 14.9s. Estimated remaining: 2h 24m 45s. Rate: 9.5 symbols/min [2025-09-15T18:45:47.578605] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:45:47.706590] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:45:47.749827] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-09-15T18:45:47.756255] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:45:47.771376] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-09-15T18:45:47.773602] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:45:47.774659] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-09-15T18:45:47.775062] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-15T18:45:47.775326] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-15T18:45:47.775369] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-09-15T18:45:48.079379] [DEBUG] [LOCAL ] HDB: Loaded 38803 existing records from primary storage. [2025-09-15T18:45:48.085786] [DEBUG] [LOCAL ] HE: Loaded 36684 existing records from primary storage. [2025-09-15T18:45:48.104431] [INFO ] [MAIN ] HE: Loaded 36684 existing records. [2025-09-15T18:45:48.099051] [INFO ] [MAIN ] HDB: Loaded 38803 existing records. [2025-09-15T18:45:48.227697] [DEBUG] [LOCAL ] HD: Loaded 40285 existing records from primary storage. [2025-09-15T18:45:48.276081] [INFO ] [MAIN ] HD: Loaded 40285 existing records. [2025-09-15T18:45:48.555306] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:45:48.628378] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-09-15T18:45:48.695963] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:45:48.731287] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-09-15T18:45:48.731146] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:45:48.741848] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-09-15T18:45:48.752847] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-09-15T18:45:48.783911] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-09-15T18:45:48.747417] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-09-15T18:45:48.794361] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-09-15T18:45:48.866868] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:45:48.873094] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-09-15T18:45:48.894456] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-09-15T18:45:48.899749] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-09-15T18:45:48.931376] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-09-15T18:45:49.011145] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-09-15T18:45:49.061539] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-09-15T18:45:49.299370] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-15T18:45:49.404095] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-09-15T18:45:49.733821] [INFO ] [REMOTE ] HDB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:45:49.777069] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-09-15T18:45:49.837979] [INFO ] [REMOTE ] HE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:45:49.861055] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-09-15T18:45:49.920129] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-15T18:45:49.939782] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-09-15T18:45:49.942812] [INFO ] [REMOTE ] HD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:45:50.057837] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-09-15T18:45:50.169144] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-09-15T18:45:50.857920] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-09-15T18:45:51.395333] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-15T18:45:51.426010] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T18:45:51.505092] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-15T18:45:51.657877] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-09-15T18:45:51.910631] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-15T18:45:52.124342] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-15T18:45:52.457912] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-09-15T18:45:53.257880] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-09-15T18:45:53.508274] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-09-15T18:45:54.057869] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-09-15T18:45:54.181315] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-15T18:45:54.294791] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-09-15T18:45:54.857878] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-09-15T18:45:55.249577] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-15T18:45:55.250291] [INFO ] [REMOTE ] HCXY: Full fetch complete (388 records). [2025-09-15T18:45:55.250362] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-09-15T18:45:55.429929] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 119 unique days, need 150 days [2025-09-15T18:45:55.430120] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:45:55.430180] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:45:55.430229] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-15T18:45:55.430325] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-15T18:45:55.430363] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-09-15T18:45:55.430424] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-09-15T18:45:55.430495] [INFO ] [MAIN ] Update Progress: 1001/2369 symbols completed. HCXY took 8.4s. Estimated remaining: 2h 24m 41s. Rate: 9.5 symbols/min [2025-09-15T18:45:55.604098] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:45:55.630008] [DEBUG] [LOCAL ] HEI: Loaded 23960 existing records from primary storage. [2025-09-15T18:45:55.630162] [INFO ] [MAIN ] HEI: Loaded 23960 existing records. [2025-09-15T18:45:55.662966] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-09-15T18:45:55.815708] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:45:55.815954] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-09-15T18:45:55.816000] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-09-15T18:45:55.816862] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-09-15T18:45:55.816919] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-09-15T18:45:56.166928] [INFO ] [REMOTE ] HEI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:45:56.457896] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-09-15T18:45:57.257903] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-09-15T18:45:57.855389] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-15T18:45:58.057898] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-09-15T18:45:58.148363] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T18:45:58.278122] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-15T18:45:58.857870] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-09-15T18:45:59.657912] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-09-15T18:45:59.980606] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-15T18:46:00.288390] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T18:46:00.457940] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-09-15T18:46:01.257948] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-09-15T18:46:01.556924] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-15T18:46:01.960937] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-15T18:46:02.057885] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-09-15T18:46:02.857912] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-09-15T18:46:03.251117] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-15T18:46:03.437616] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T18:46:03.657878] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-09-15T18:46:04.457860] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-09-15T18:46:04.750041] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-15T18:46:05.257839] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-09-15T18:46:05.697723] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-15T18:46:05.708995] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-15T18:46:06.057885] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-09-15T18:46:06.857882] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-09-15T18:46:07.009314] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-15T18:46:07.657832] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-09-15T18:46:07.927003] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-15T18:46:08.421444] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T18:46:08.457830] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-09-15T18:46:09.257870] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-09-15T18:46:09.328492] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-15T18:46:09.629486] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-15T18:46:10.057928] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-09-15T18:46:10.865896] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-09-15T18:46:10.890813] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-15T18:46:11.657915] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-09-15T18:46:11.825917] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-15T18:46:12.457916] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-09-15T18:46:12.977324] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-15T18:46:13.110505] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-15T18:46:13.257870] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-09-15T18:46:13.935375] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-15T18:46:14.057884] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-09-15T18:46:14.578178] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T18:46:14.583987] [INFO ] [REMOTE ] HDB: Full fetch complete (56504 records). [2025-09-15T18:46:14.584121] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-09-15T18:46:14.864429] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-09-15T18:46:14.967137] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-09-15T18:46:14.967241] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-09-15T18:46:14.968233] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-09-15T18:46:14.968288] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-09-15T18:46:14.969581] [DEBUG] [LOCAL ] HDB: Trimmed 56504 records to 38022 (keeping 150 days of data) [2025-09-15T18:46:15.212568] [DEBUG] [LOCAL ] HDB: Primary data saved (38022 records). [2025-09-15T18:46:15.212904] [INFO ] [MAIN ] HDB: Full history saved. [2025-09-15T18:46:15.213493] [INFO ] [MAIN ] Update Progress: 1002/2369 symbols completed. HDB took 28.2s. Estimated remaining: 2h 24m 53s. Rate: 9.4 symbols/min [2025-09-15T18:46:15.379378] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-15T18:46:15.409918] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:46:15.417786] [DEBUG] [LOCAL ] HEQ: Loaded 4247 existing records from primary storage. [2025-09-15T18:46:15.417922] [INFO ] [MAIN ] HEQ: Loaded 4247 existing records. [2025-09-15T18:46:15.597006] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:46:15.597304] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-09-15T18:46:15.597370] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-09-15T18:46:15.597756] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-09-15T18:46:15.597827] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-09-15T18:46:15.662955] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-09-15T18:46:15.947198] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:46:16.457916] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-09-15T18:46:16.931124] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-15T18:46:17.043909] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-15T18:46:17.049820] [INFO ] [REMOTE ] HD: Full fetch complete (58179 records). [2025-09-15T18:46:17.049941] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-09-15T18:46:17.264774] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-09-15T18:46:17.365810] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-15T18:46:17.418914] [INFO ] [REMOTE ] HE: Full fetch complete (53951 records). [2025-09-15T18:46:17.448849] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-09-15T18:46:17.535694] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-09-15T18:46:17.546771] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-09-15T18:46:17.565696] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-09-15T18:46:17.567943] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-09-15T18:46:17.641875] [DEBUG] [LOCAL ] HD: Trimmed 58179 records to 39510 (keeping 150 days of data) [2025-09-15T18:46:17.954722] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-09-15T18:46:17.955997] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-09-15T18:46:17.957782] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-09-15T18:46:17.960898] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-09-15T18:46:17.966224] [DEBUG] [LOCAL ] HE: Trimmed 53951 records to 35907 (keeping 150 days of data) [2025-09-15T18:46:18.035208] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-15T18:46:18.062358] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-09-15T18:46:18.308667] [DEBUG] [LOCAL ] HD: Primary data saved (39510 records). [2025-09-15T18:46:18.309080] [INFO ] [MAIN ] HD: Full history saved. [2025-09-15T18:46:18.309867] [INFO ] [MAIN ] Update Progress: 1003/2369 symbols completed. HD took 31.3s. Estimated remaining: 2h 24m 42s. Rate: 9.4 symbols/min [2025-09-15T18:46:18.485794] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:46:18.500981] [DEBUG] [LOCAL ] HE: Primary data saved (35907 records). [2025-09-15T18:46:18.501135] [INFO ] [MAIN ] HE: Full history saved. [2025-09-15T18:46:18.501272] [INFO ] [MAIN ] Update Progress: 1004/2369 symbols completed. HE took 31.4s. Estimated remaining: 2h 24m 27s. Rate: 9.4 symbols/min [2025-09-15T18:46:18.648777] [DEBUG] [LOCAL ] HESM: Loaded 36270 existing records from primary storage. [2025-09-15T18:46:18.674858] [INFO ] [MAIN ] HESM: Loaded 36270 existing records. [2025-09-15T18:46:18.769136] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:46:18.804289] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-09-15T18:46:18.806571] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-09-15T18:46:18.817474] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-09-15T18:46:18.832899] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-15T18:46:18.862485] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-09-15T18:46:18.884924] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-15T18:46:18.885959] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:46:18.886268] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-09-15T18:46:18.886317] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-09-15T18:46:18.886108] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-09-15T18:46:18.892946] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-09-15T18:46:18.933417] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-09-15T18:46:19.611204] [INFO ] [REMOTE ] HF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:46:19.630987] [INFO ] [REMOTE ] HESM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:46:19.653880] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-15T18:46:19.661125] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-09-15T18:46:19.670062] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-15T18:46:20.085582] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-15T18:46:20.457864] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-09-15T18:46:21.257879] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-09-15T18:46:21.698744] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-15T18:46:21.702611] [INFO ] [REMOTE ] HEI: Full fetch complete (36388 records). [2025-09-15T18:46:21.702783] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-09-15T18:46:22.069554] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-09-15T18:46:22.084590] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-09-15T18:46:22.084695] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-09-15T18:46:22.085366] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-09-15T18:46:22.085415] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-09-15T18:46:22.086446] [DEBUG] [LOCAL ] HEI: Trimmed 36388 records to 23374 (keeping 150 days of data) [2025-09-15T18:46:22.240886] [DEBUG] [LOCAL ] HEI: Primary data saved (23374 records). [2025-09-15T18:46:22.241036] [INFO ] [MAIN ] HEI: Full history saved. [2025-09-15T18:46:22.241139] [INFO ] [MAIN ] Update Progress: 1005/2369 symbols completed. HEI took 26.8s. Estimated remaining: 2h 24m 18s. Rate: 9.5 symbols/min [2025-09-15T18:46:22.414273] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:46:22.414479] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-09-15T18:46:22.414516] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-09-15T18:46:22.414635] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-09-15T18:46:22.414694] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-15T18:46:22.414735] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-15T18:46:22.414766] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-09-15T18:46:22.770002] [INFO ] [REMOTE ] HFND: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:46:22.841071] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-15T18:46:22.857815] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-09-15T18:46:22.930911] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T18:46:23.657925] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-09-15T18:46:24.457888] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-09-15T18:46:24.477352] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T18:46:24.515343] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-15T18:46:24.851574] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-15T18:46:25.257875] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-09-15T18:46:25.511662] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-15T18:46:26.057900] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-09-15T18:46:26.727383] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-15T18:46:26.857872] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-09-15T18:46:27.657874] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-09-15T18:46:27.887281] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-09-15T18:46:28.462936] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-09-15T18:46:28.480866] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-15T18:46:28.773227] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-15T18:46:29.257882] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-09-15T18:46:30.057875] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-09-15T18:46:30.290354] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-09-15T18:46:30.759695] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-15T18:46:30.857840] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-09-15T18:46:31.657874] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-09-15T18:46:32.388778] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T18:46:32.417463] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-15T18:46:32.457815] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-09-15T18:46:33.257869] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-09-15T18:46:33.529214] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-09-15T18:46:34.057957] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-09-15T18:46:34.147957] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-15T18:46:34.749733] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-15T18:46:34.751419] [INFO ] [REMOTE ] HEQ: Full fetch complete (6530 records). [2025-09-15T18:46:34.751495] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-09-15T18:46:34.862338] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-09-15T18:46:35.133423] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-09-15T18:46:35.133524] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-09-15T18:46:35.133760] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-09-15T18:46:35.133804] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-09-15T18:46:35.134268] [DEBUG] [LOCAL ] HEQ: Trimmed 6530 records to 4271 (keeping 150 days of data) [2025-09-15T18:46:35.162524] [DEBUG] [LOCAL ] HEQ: Primary data saved (4271 records). [2025-09-15T18:46:35.162696] [INFO ] [MAIN ] HEQ: Full history saved. [2025-09-15T18:46:35.162851] [INFO ] [MAIN ] Update Progress: 1006/2369 symbols completed. HEQ took 19.9s. Estimated remaining: 2h 24m 20s. Rate: 9.4 symbols/min [2025-09-15T18:46:35.349939] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-15T18:46:35.354288] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:46:35.371916] [DEBUG] [LOCAL ] HFRO: Loaded 12029 existing records from primary storage. [2025-09-15T18:46:35.372162] [INFO ] [MAIN ] HFRO: Loaded 12029 existing records. [2025-09-15T18:46:35.568009] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:46:35.568378] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-09-15T18:46:35.568458] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-09-15T18:46:35.569090] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-09-15T18:46:35.569148] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-09-15T18:46:35.663123] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-09-15T18:46:35.944400] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-15T18:46:35.947443] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:46:36.457872] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-09-15T18:46:36.683748] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-09-15T18:46:37.257877] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-09-15T18:46:37.580295] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-15T18:46:37.581132] [INFO ] [REMOTE ] HF: Full fetch complete (291 records). [2025-09-15T18:46:37.581219] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-09-15T18:46:37.792270] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 102 unique days, need 150 days [2025-09-15T18:46:37.792478] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:46:37.792528] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:46:37.792573] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-15T18:46:37.792636] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-15T18:46:37.792707] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-09-15T18:46:37.792763] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-09-15T18:46:37.792861] [INFO ] [MAIN ] Update Progress: 1007/2369 symbols completed. HF took 19.3s. Estimated remaining: 2h 24m 9s. Rate: 9.4 symbols/min [2025-09-15T18:46:37.963272] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:46:37.974368] [DEBUG] [LOCAL ] HGER: Loaded 10025 existing records from primary storage. [2025-09-15T18:46:37.974488] [INFO ] [MAIN ] HGER: Loaded 10025 existing records. [2025-09-15T18:46:38.063234] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-09-15T18:46:38.156165] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:46:38.156393] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-09-15T18:46:38.156441] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-09-15T18:46:38.156801] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-09-15T18:46:38.156850] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-09-15T18:46:38.432896] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-15T18:46:38.508390] [INFO ] [REMOTE ] HGER: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:46:38.857942] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-09-15T18:46:39.657913] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-09-15T18:46:39.853455] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-15T18:46:39.894032] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-09-15T18:46:40.457855] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-09-15T18:46:41.054141] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-15T18:46:41.257892] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-09-15T18:46:41.576058] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-15T18:46:42.057886] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-09-15T18:46:42.342014] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-15T18:46:42.857864] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-09-15T18:46:43.300633] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-15T18:46:43.301455] [INFO ] [REMOTE ] HFND: Full fetch complete (1352 records). [2025-09-15T18:46:43.301534] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-09-15T18:46:43.478750] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-15T18:46:43.478954] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:46:43.479021] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:46:43.479077] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-15T18:46:43.479157] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-15T18:46:43.479209] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-09-15T18:46:43.479284] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-09-15T18:46:43.479386] [INFO ] [MAIN ] Update Progress: 1008/2369 symbols completed. HFND took 21.2s. Estimated remaining: 2h 24m 1s. Rate: 9.4 symbols/min [2025-09-15T18:46:43.647098] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:46:43.654861] [DEBUG] [LOCAL ] HGLB: Loaded 6627 existing records from primary storage. [2025-09-15T18:46:43.654951] [INFO ] [MAIN ] HGLB: Loaded 6627 existing records. [2025-09-15T18:46:43.665839] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-09-15T18:46:43.835110] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:46:43.835389] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-09-15T18:46:43.835434] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-09-15T18:46:43.835790] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-09-15T18:46:43.835840] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-09-15T18:46:44.201173] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:46:44.457865] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-09-15T18:46:45.257861] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-09-15T18:46:45.307366] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-15T18:46:45.569165] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-15T18:46:45.772307] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-15T18:46:46.057930] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-09-15T18:46:46.857979] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-09-15T18:46:46.878131] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-15T18:46:47.657949] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-09-15T18:46:47.707958] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-15T18:46:48.279606] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-15T18:46:48.457878] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-09-15T18:46:49.257944] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-09-15T18:46:50.057881] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-09-15T18:46:50.146950] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-15T18:46:50.152799] [INFO ] [REMOTE ] HESM: Full fetch complete (52505 records). [2025-09-15T18:46:50.152950] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-09-15T18:46:50.390969] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-15T18:46:50.554147] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-09-15T18:46:50.557711] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-09-15T18:46:50.558522] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-09-15T18:46:50.558574] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-09-15T18:46:50.559916] [DEBUG] [LOCAL ] HESM: Trimmed 52505 records to 35628 (keeping 150 days of data) [2025-09-15T18:46:50.632805] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-15T18:46:50.792516] [DEBUG] [LOCAL ] HESM: Primary data saved (35628 records). [2025-09-15T18:46:50.792689] [INFO ] [MAIN ] HESM: Full history saved. [2025-09-15T18:46:50.792792] [INFO ] [MAIN ] Update Progress: 1009/2369 symbols completed. HESM took 32.5s. Estimated remaining: 2h 23m 56s. Rate: 9.4 symbols/min [2025-09-15T18:46:50.863004] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-09-15T18:46:50.962305] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:46:50.973057] [DEBUG] [LOCAL ] HGTY: Loaded 9766 existing records from primary storage. [2025-09-15T18:46:50.973169] [INFO ] [MAIN ] HGTY: Loaded 9766 existing records. [2025-09-15T18:46:51.145429] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:46:51.145731] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-09-15T18:46:51.145780] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-09-15T18:46:51.146101] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-09-15T18:46:51.146145] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-09-15T18:46:51.500105] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:46:51.657880] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-09-15T18:46:51.743231] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-15T18:46:52.252998] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-15T18:46:52.457883] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-09-15T18:46:52.981796] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-15T18:46:53.257914] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-09-15T18:46:54.057930] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-09-15T18:46:54.288380] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-15T18:46:54.857934] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-09-15T18:46:54.924552] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-15T18:46:55.657910] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-09-15T18:46:55.854247] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-15T18:46:55.856812] [INFO ] [REMOTE ] HGER: Full fetch complete (12894 records). [2025-09-15T18:46:55.856905] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-09-15T18:46:56.219836] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-09-15T18:46:56.219977] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-09-15T18:46:56.220275] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-09-15T18:46:56.227523] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-09-15T18:46:56.228425] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-15T18:46:56.232144] [DEBUG] [LOCAL ] HGER: Trimmed 12894 records to 9870 (keeping 150 days of data) [2025-09-15T18:46:56.292237] [DEBUG] [LOCAL ] HGER: Primary data saved (9870 records). [2025-09-15T18:46:56.292380] [INFO ] [MAIN ] HGER: Full history saved. [2025-09-15T18:46:56.292466] [INFO ] [MAIN ] Update Progress: 1010/2369 symbols completed. HGER took 18.5s. Estimated remaining: 2h 23m 49s. Rate: 9.4 symbols/min [2025-09-15T18:46:56.463207] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-09-15T18:46:56.466235] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:46:56.501593] [DEBUG] [LOCAL ] HGV: Loaded 35452 existing records from primary storage. [2025-09-15T18:46:56.501775] [INFO ] [MAIN ] HGV: Loaded 35452 existing records. [2025-09-15T18:46:56.677007] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:46:56.677270] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-09-15T18:46:56.677319] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-09-15T18:46:56.678179] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-09-15T18:46:56.678239] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-09-15T18:46:57.047192] [INFO ] [REMOTE ] HGV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:46:57.257873] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-09-15T18:46:57.492526] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-15T18:46:58.057878] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-09-15T18:46:58.232585] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-15T18:46:58.857922] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-09-15T18:46:58.910858] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-15T18:46:59.385714] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-15T18:46:59.657868] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-09-15T18:47:00.218554] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-15T18:47:00.457860] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-09-15T18:47:01.207124] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-15T18:47:01.257865] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-09-15T18:47:02.019793] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-15T18:47:02.057882] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-09-15T18:47:02.857931] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-09-15T18:47:03.657887] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-09-15T18:47:03.703680] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-15T18:47:03.738506] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T18:47:04.214264] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-15T18:47:04.457864] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-09-15T18:47:05.191478] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-15T18:47:05.257911] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-09-15T18:47:05.821513] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-15T18:47:06.057897] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-09-15T18:47:06.844139] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-15T18:47:06.857822] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-09-15T18:47:07.657919] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-09-15T18:47:07.917256] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T18:47:08.457882] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-09-15T18:47:08.667344] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T18:47:09.257910] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-09-15T18:47:09.925584] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T18:47:10.057876] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-09-15T18:47:10.149532] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-15T18:47:10.152063] [INFO ] [REMOTE ] HFRO: Full fetch complete (19730 records). [2025-09-15T18:47:10.152140] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-09-15T18:47:10.549361] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-09-15T18:47:10.549448] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-09-15T18:47:10.549877] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-09-15T18:47:10.549919] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-09-15T18:47:10.550476] [DEBUG] [LOCAL ] HFRO: Trimmed 19730 records to 11867 (keeping 150 days of data) [2025-09-15T18:47:10.620156] [DEBUG] [LOCAL ] HFRO: Primary data saved (11867 records). [2025-09-15T18:47:10.620300] [INFO ] [MAIN ] HFRO: Full history saved. [2025-09-15T18:47:10.620394] [INFO ] [MAIN ] Update Progress: 1011/2369 symbols completed. HFRO took 35.5s. Estimated remaining: 2h 23m 53s. Rate: 9.4 symbols/min [2025-09-15T18:47:10.821103] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:47:10.845946] [DEBUG] [LOCAL ] HHH: Loaded 25705 existing records from primary storage. [2025-09-15T18:47:10.846103] [INFO ] [MAIN ] HHH: Loaded 25705 existing records. [2025-09-15T18:47:10.866406] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-09-15T18:47:10.963008] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-15T18:47:10.993719] [INFO ] [REMOTE ] HGLB: Full fetch complete (10839 records). [2025-09-15T18:47:11.009128] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-09-15T18:47:11.062606] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:47:11.123201] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-09-15T18:47:11.133825] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-09-15T18:47:11.139659] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-09-15T18:47:11.149926] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-09-15T18:47:11.661546] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-09-15T18:47:11.672833] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-09-15T18:47:11.680417] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-09-15T18:47:11.684551] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-09-15T18:47:11.684886] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-09-15T18:47:11.741752] [DEBUG] [LOCAL ] HGLB: Trimmed 10839 records to 6515 (keeping 150 days of data) [2025-09-15T18:47:11.764918] [INFO ] [REMOTE ] HHH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:47:11.805972] [DEBUG] [LOCAL ] HGLB: Primary data saved (6515 records). [2025-09-15T18:47:11.806086] [INFO ] [MAIN ] HGLB: Full history saved. [2025-09-15T18:47:11.806175] [INFO ] [MAIN ] Update Progress: 1012/2369 symbols completed. HGLB took 28.3s. Estimated remaining: 2h 23m 40s. Rate: 9.4 symbols/min [2025-09-15T18:47:11.978908] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:47:12.004321] [DEBUG] [LOCAL ] HI: Loaded 26236 existing records from primary storage. [2025-09-15T18:47:12.004466] [INFO ] [MAIN ] HI: Loaded 26236 existing records. [2025-09-15T18:47:12.192924] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T18:47:12.221157] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:47:12.221718] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-09-15T18:47:12.221773] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-09-15T18:47:12.222452] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-09-15T18:47:12.222502] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-09-15T18:47:12.463971] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-09-15T18:47:12.581985] [INFO ] [REMOTE ] HI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:47:12.593259] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-15T18:47:12.596848] [INFO ] [REMOTE ] HGTY: Full fetch complete (13034 records). [2025-09-15T18:47:12.597034] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-09-15T18:47:12.967469] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-09-15T18:47:12.967554] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-09-15T18:47:12.967931] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-09-15T18:47:12.967978] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-09-15T18:47:12.968523] [DEBUG] [LOCAL ] HGTY: Trimmed 13034 records to 9760 (keeping 150 days of data) [2025-09-15T18:47:13.026847] [DEBUG] [LOCAL ] HGTY: Primary data saved (9760 records). [2025-09-15T18:47:13.027000] [INFO ] [MAIN ] HGTY: Full history saved. [2025-09-15T18:47:13.027104] [INFO ] [MAIN ] Update Progress: 1013/2369 symbols completed. HGTY took 22.2s. Estimated remaining: 2h 23m 27s. Rate: 9.5 symbols/min [2025-09-15T18:47:13.197549] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:47:13.236891] [DEBUG] [LOCAL ] HIG: Loaded 38704 existing records from primary storage. [2025-09-15T18:47:13.237045] [INFO ] [MAIN ] HIG: Loaded 38704 existing records. [2025-09-15T18:47:13.267416] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-09-15T18:47:13.420476] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:47:13.420776] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-09-15T18:47:13.420827] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-09-15T18:47:13.421713] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-09-15T18:47:13.421771] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-09-15T18:47:13.775129] [INFO ] [REMOTE ] HIG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:47:13.839368] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-15T18:47:14.057919] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-09-15T18:47:14.341014] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-15T18:47:14.848595] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-15T18:47:14.857805] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-09-15T18:47:15.657869] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-09-15T18:47:16.072049] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-15T18:47:16.457868] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-09-15T18:47:17.193061] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-15T18:47:17.257819] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-09-15T18:47:17.456574] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-15T18:47:18.057920] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-09-15T18:47:18.857916] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-09-15T18:47:18.983149] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-15T18:47:19.605660] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T18:47:19.657839] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-09-15T18:47:20.408313] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T18:47:20.457908] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-09-15T18:47:21.016414] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-15T18:47:21.257892] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-09-15T18:47:21.436502] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-15T18:47:22.057882] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-09-15T18:47:22.465045] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-15T18:47:22.470166] [INFO ] [REMOTE ] HGV: Full fetch complete (51006 records). [2025-09-15T18:47:22.470290] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-09-15T18:47:22.853120] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-09-15T18:47:22.853202] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-09-15T18:47:22.853958] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-09-15T18:47:22.854013] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-09-15T18:47:22.855575] [DEBUG] [LOCAL ] HGV: Trimmed 51006 records to 34755 (keeping 150 days of data) [2025-09-15T18:47:22.857951] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-09-15T18:47:23.070631] [DEBUG] [LOCAL ] HGV: Primary data saved (34755 records). [2025-09-15T18:47:23.070792] [INFO ] [MAIN ] HGV: Full history saved. [2025-09-15T18:47:23.070879] [INFO ] [MAIN ] Update Progress: 1014/2369 symbols completed. HGV took 26.8s. Estimated remaining: 2h 23m 25s. Rate: 9.4 symbols/min [2025-09-15T18:47:23.239872] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:47:23.264715] [DEBUG] [LOCAL ] HII: Loaded 24776 existing records from primary storage. [2025-09-15T18:47:23.264858] [INFO ] [MAIN ] HII: Loaded 24776 existing records. [2025-09-15T18:47:23.442920] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:47:23.443280] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-09-15T18:47:23.443340] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-09-15T18:47:23.444172] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-09-15T18:47:23.444314] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-09-15T18:47:23.663450] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-09-15T18:47:23.851545] [INFO ] [REMOTE ] HII: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:47:23.853160] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-15T18:47:24.348979] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T18:47:24.457823] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-09-15T18:47:24.747051] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-15T18:47:25.257865] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-09-15T18:47:25.744036] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-15T18:47:26.057928] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-09-15T18:47:26.547389] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-15T18:47:26.857873] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-09-15T18:47:27.640297] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-15T18:47:27.657828] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-09-15T18:47:27.906557] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-15T18:47:28.457914] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-09-15T18:47:29.257901] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-09-15T18:47:29.352375] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T18:47:29.917383] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-15T18:47:30.057918] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-09-15T18:47:30.305977] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-15T18:47:30.857951] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-09-15T18:47:31.444823] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-15T18:47:31.657865] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-09-15T18:47:32.310713] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-15T18:47:32.314602] [INFO ] [REMOTE ] HHH: Full fetch complete (35932 records). [2025-09-15T18:47:32.314715] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-09-15T18:47:32.462919] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-09-15T18:47:32.684742] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-09-15T18:47:32.684832] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-09-15T18:47:32.685537] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-09-15T18:47:32.685618] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-09-15T18:47:32.687703] [DEBUG] [LOCAL ] HHH: Trimmed 35932 records to 25501 (keeping 150 days of data) [2025-09-15T18:47:32.846689] [DEBUG] [LOCAL ] HHH: Primary data saved (25501 records). [2025-09-15T18:47:32.846823] [INFO ] [MAIN ] HHH: Full history saved. [2025-09-15T18:47:32.846940] [INFO ] [MAIN ] Update Progress: 1015/2369 symbols completed. HHH took 22.2s. Estimated remaining: 2h 23m 24s. Rate: 9.4 symbols/min [2025-09-15T18:47:33.030122] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:47:33.081232] [DEBUG] [LOCAL ] HIMS: Loaded 40557 existing records from primary storage. [2025-09-15T18:47:33.081444] [INFO ] [MAIN ] HIMS: Loaded 40557 existing records. [2025-09-15T18:47:33.281102] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:47:33.275817] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-09-15T18:47:33.284794] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-09-15T18:47:33.284917] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-09-15T18:47:33.286852] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-09-15T18:47:33.286794] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T18:47:33.286998] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-09-15T18:47:33.653801] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:47:33.907305] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-15T18:47:34.057879] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-09-15T18:47:34.722314] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-15T18:47:34.857865] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-09-15T18:47:35.450208] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-15T18:47:35.454497] [INFO ] [REMOTE ] HI: Full fetch complete (38052 records). [2025-09-15T18:47:35.454599] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-09-15T18:47:35.666919] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-09-15T18:47:35.840607] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-09-15T18:47:35.840712] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-09-15T18:47:35.841377] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-09-15T18:47:35.841420] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-09-15T18:47:35.842954] [DEBUG] [LOCAL ] HI: Trimmed 38052 records to 25684 (keeping 150 days of data) [2025-09-15T18:47:36.004562] [DEBUG] [LOCAL ] HI: Primary data saved (25684 records). [2025-09-15T18:47:36.004729] [INFO ] [MAIN ] HI: Full history saved. [2025-09-15T18:47:36.004830] [INFO ] [MAIN ] Update Progress: 1016/2369 symbols completed. HI took 24.2s. Estimated remaining: 2h 23m 13s. Rate: 9.4 symbols/min [2025-09-15T18:47:36.174624] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:47:36.189765] [DEBUG] [LOCAL ] HIO: Loaded 16072 existing records from primary storage. [2025-09-15T18:47:36.189879] [INFO ] [MAIN ] HIO: Loaded 16072 existing records. [2025-09-15T18:47:36.368679] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:47:36.368924] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-09-15T18:47:36.368976] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-09-15T18:47:36.369400] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-09-15T18:47:36.369445] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-09-15T18:47:36.468018] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-09-15T18:47:36.725229] [INFO ] [REMOTE ] HIO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:47:36.760329] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-15T18:47:37.257879] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-09-15T18:47:37.851952] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-15T18:47:37.945596] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-15T18:47:38.057907] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-09-15T18:47:38.752264] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T18:47:38.857933] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-09-15T18:47:39.459844] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T18:47:39.657890] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-09-15T18:47:40.463004] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-09-15T18:47:40.479574] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-15T18:47:41.003823] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T18:47:41.257960] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-09-15T18:47:41.565690] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-15T18:47:42.057871] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-09-15T18:47:42.857876] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-09-15T18:47:43.464946] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T18:47:43.469091] [INFO ] [REMOTE ] HII: Full fetch complete (39791 records). [2025-09-15T18:47:43.469187] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-09-15T18:47:43.688632] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-09-15T18:47:43.850304] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-09-15T18:47:43.850476] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-09-15T18:47:43.851159] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-09-15T18:47:43.851273] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-09-15T18:47:43.852566] [DEBUG] [LOCAL ] HII: Trimmed 39791 records to 24141 (keeping 150 days of data) [2025-09-15T18:47:44.012120] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.75 seconds). [2025-09-15T18:47:44.064880] [DEBUG] [LOCAL ] HII: Primary data saved (24141 records). [2025-09-15T18:47:44.065054] [INFO ] [MAIN ] HII: Full history saved. [2025-09-15T18:47:44.065173] [INFO ] [MAIN ] Update Progress: 1017/2369 symbols completed. HII took 21.0s. Estimated remaining: 2h 23m 9s. Rate: 9.4 symbols/min [2025-09-15T18:47:44.237192] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:47:44.255431] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-15T18:47:44.262212] [INFO ] [REMOTE ] HIG: Full fetch complete (55559 records). [2025-09-15T18:47:44.262441] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-09-15T18:47:44.382568] [DEBUG] [LOCAL ] HIPO: Loaded 16864 existing records from primary storage. [2025-09-15T18:47:44.388218] [INFO ] [MAIN ] HIPO: Loaded 16864 existing records. [2025-09-15T18:47:44.465392] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-09-15T18:47:44.758529] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:47:44.766751] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-09-15T18:47:44.782201] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-09-15T18:47:44.818448] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-09-15T18:47:44.819321] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-09-15T18:47:44.912371] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-09-15T18:47:44.921748] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-09-15T18:47:44.934533] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-09-15T18:47:44.939719] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-09-15T18:47:45.070316] [DEBUG] [LOCAL ] HIG: Trimmed 55559 records to 37942 (keeping 150 days of data) [2025-09-15T18:47:45.384445] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:47:45.388454] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-09-15T18:47:45.388090] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-15T18:47:45.528326] [DEBUG] [LOCAL ] HIG: Primary data saved (37942 records). [2025-09-15T18:47:45.528510] [INFO ] [MAIN ] HIG: Full history saved. [2025-09-15T18:47:45.528630] [INFO ] [MAIN ] Update Progress: 1018/2369 symbols completed. HIG took 32.5s. Estimated remaining: 2h 22m 56s. Rate: 9.5 symbols/min [2025-09-15T18:47:45.699794] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:47:45.731767] [DEBUG] [LOCAL ] HIW: Loaded 33336 existing records from primary storage. [2025-09-15T18:47:45.731925] [INFO ] [MAIN ] HIW: Loaded 33336 existing records. [2025-09-15T18:47:45.907811] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:47:45.908063] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-09-15T18:47:45.908111] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-09-15T18:47:45.908992] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-09-15T18:47:45.909045] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-09-15T18:47:46.060033] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-09-15T18:47:46.263688] [INFO ] [REMOTE ] HIW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:47:46.277302] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-15T18:47:46.857938] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-09-15T18:47:47.176481] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-09-15T18:47:47.312670] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-15T18:47:47.648615] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-15T18:47:47.657857] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-09-15T18:47:48.457939] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-09-15T18:47:48.771298] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-15T18:47:49.257930] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-09-15T18:47:49.802202] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-15T18:47:50.057871] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-09-15T18:47:50.367800] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T18:47:50.857899] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-09-15T18:47:51.576845] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T18:47:51.657911] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-09-15T18:47:51.847707] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T18:47:52.457923] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-09-15T18:47:52.947460] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-15T18:47:53.083092] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-15T18:47:53.257938] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-09-15T18:47:54.048391] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-15T18:47:54.057807] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-09-15T18:47:54.772870] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-15T18:47:54.857842] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-09-15T18:47:55.657924] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-09-15T18:47:55.852443] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-15T18:47:56.457871] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-09-15T18:47:57.203852] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T18:47:57.256240] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-15T18:47:57.260464] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-09-15T18:47:58.057885] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-09-15T18:47:58.677961] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-15T18:47:58.857840] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-09-15T18:47:59.115289] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T18:47:59.118201] [INFO ] [REMOTE ] HIPO: Full fetch complete (24444 records). [2025-09-15T18:47:59.118280] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-09-15T18:47:59.521155] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-09-15T18:47:59.521233] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-09-15T18:47:59.521730] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-09-15T18:47:59.521773] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-09-15T18:47:59.522411] [DEBUG] [LOCAL ] HIPO: Trimmed 24444 records to 16581 (keeping 150 days of data) [2025-09-15T18:47:59.619567] [DEBUG] [LOCAL ] HIPO: Primary data saved (16581 records). [2025-09-15T18:47:59.619728] [INFO ] [MAIN ] HIPO: Full history saved. [2025-09-15T18:47:59.619815] [INFO ] [MAIN ] Update Progress: 1019/2369 symbols completed. HIPO took 15.6s. Estimated remaining: 2h 22m 60s. Rate: 9.4 symbols/min [2025-09-15T18:47:59.663021] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-09-15T18:47:59.792079] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:47:59.807352] [DEBUG] [LOCAL ] HIX: Loaded 15096 existing records from primary storage. [2025-09-15T18:47:59.807475] [INFO ] [MAIN ] HIX: Loaded 15096 existing records. [2025-09-15T18:47:59.986547] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:47:59.986805] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-09-15T18:47:59.986852] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-09-15T18:47:59.987399] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-09-15T18:47:59.987450] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-09-15T18:48:00.347198] [INFO ] [REMOTE ] HIX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:48:00.373308] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-15T18:48:00.457843] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-09-15T18:48:01.257862] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-09-15T18:48:01.543957] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-15T18:48:02.057892] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-09-15T18:48:02.867976] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-09-15T18:48:02.902806] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (3.24 seconds). [2025-09-15T18:48:03.392944] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-15T18:48:03.657893] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-09-15T18:48:04.457960] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-09-15T18:48:04.839812] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (2.78 seconds). [2025-09-15T18:48:04.862592] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-15T18:48:05.229942] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T18:48:05.235303] [INFO ] [REMOTE ] HIW: Full fetch complete (48967 records). [2025-09-15T18:48:05.235420] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-09-15T18:48:05.266668] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-09-15T18:48:05.615062] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-09-15T18:48:05.615149] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-09-15T18:48:05.615973] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-09-15T18:48:05.616019] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-09-15T18:48:05.617167] [DEBUG] [LOCAL ] HIW: Trimmed 48967 records to 32873 (keeping 150 days of data) [2025-09-15T18:48:05.822384] [DEBUG] [LOCAL ] HIW: Primary data saved (32873 records). [2025-09-15T18:48:05.822526] [INFO ] [MAIN ] HIW: Full history saved. [2025-09-15T18:48:05.822612] [INFO ] [MAIN ] Update Progress: 1020/2369 symbols completed. HIW took 20.3s. Estimated remaining: 2h 22m 53s. Rate: 9.4 symbols/min [2025-09-15T18:48:05.990525] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:48:06.004830] [DEBUG] [LOCAL ] HKD: Loaded 13529 existing records from primary storage. [2025-09-15T18:48:06.004978] [INFO ] [MAIN ] HKD: Loaded 13529 existing records. [2025-09-15T18:48:06.067497] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-09-15T18:48:06.183914] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:48:06.184175] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-09-15T18:48:06.184253] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-09-15T18:48:06.184710] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-09-15T18:48:06.184772] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-09-15T18:48:06.549190] [INFO ] [REMOTE ] HKD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:48:06.563823] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T18:48:06.857870] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-09-15T18:48:07.026219] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-15T18:48:07.030234] [INFO ] [REMOTE ] HIO: Full fetch complete (26944 records). [2025-09-15T18:48:07.030414] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-09-15T18:48:07.244091] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.79 seconds). [2025-09-15T18:48:07.458982] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-09-15T18:48:07.459063] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-09-15T18:48:07.459677] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-09-15T18:48:07.459723] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-09-15T18:48:07.460410] [DEBUG] [LOCAL ] HIO: Trimmed 26944 records to 15857 (keeping 150 days of data) [2025-09-15T18:48:07.555328] [DEBUG] [LOCAL ] HIO: Primary data saved (15857 records). [2025-09-15T18:48:07.555470] [INFO ] [MAIN ] HIO: Full history saved. [2025-09-15T18:48:07.555574] [INFO ] [MAIN ] Update Progress: 1021/2369 symbols completed. HIO took 31.6s. Estimated remaining: 2h 22m 41s. Rate: 9.4 symbols/min [2025-09-15T18:48:07.658099] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-09-15T18:48:07.731445] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:48:07.772940] [DEBUG] [LOCAL ] HL: Loaded 40416 existing records from primary storage. [2025-09-15T18:48:07.773092] [INFO ] [MAIN ] HL: Loaded 40416 existing records. [2025-09-15T18:48:07.952381] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:48:07.952810] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-09-15T18:48:07.952890] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-09-15T18:48:07.958948] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-09-15T18:48:07.965805] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-09-15T18:48:07.997835] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-15T18:48:08.328099] [INFO ] [REMOTE ] HL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:48:08.457865] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-09-15T18:48:09.257972] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-09-15T18:48:09.601456] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-15T18:48:09.893948] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-15T18:48:10.057868] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-09-15T18:48:10.316236] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-15T18:48:10.857880] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-09-15T18:48:11.510938] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-15T18:48:11.657884] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-09-15T18:48:12.455934] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-09-15T18:48:12.466412] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-09-15T18:48:12.718462] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-15T18:48:13.257895] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-09-15T18:48:14.067211] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-09-15T18:48:14.068423] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-15T18:48:14.221264] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-15T18:48:14.857871] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-09-15T18:48:15.657942] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-09-15T18:48:16.457871] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-09-15T18:48:16.726442] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T18:48:17.111446] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (3.04 seconds). [2025-09-15T18:48:17.117395] [INFO ] [REMOTE ] HIMS: Full fetch complete (58497 records). [2025-09-15T18:48:17.117496] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-09-15T18:48:17.259303] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-09-15T18:48:17.305300] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-15T18:48:17.345406] [INFO ] [REMOTE ] HIX: Full fetch complete (21839 records). [2025-09-15T18:48:17.394760] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-09-15T18:48:17.633289] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-09-15T18:48:17.633852] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-09-15T18:48:17.640948] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-09-15T18:48:17.651445] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-09-15T18:48:17.779768] [DEBUG] [LOCAL ] HIMS: Trimmed 58497 records to 39777 (keeping 150 days of data) [2025-09-15T18:48:17.938761] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (3.08 seconds). [2025-09-15T18:48:18.060950] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-09-15T18:48:18.061227] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-09-15T18:48:18.062519] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-09-15T18:48:18.068517] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-09-15T18:48:18.071536] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-09-15T18:48:18.097732] [DEBUG] [LOCAL ] HIX: Trimmed 21839 records to 14901 (keeping 150 days of data) [2025-09-15T18:48:18.303973] [DEBUG] [LOCAL ] HIMS: Primary data saved (39777 records). [2025-09-15T18:48:18.318847] [INFO ] [MAIN ] HIMS: Full history saved. [2025-09-15T18:48:18.320623] [INFO ] [MAIN ] Update Progress: 1022/2369 symbols completed. HIMS took 45.5s. Estimated remaining: 2h 22m 40s. Rate: 9.4 symbols/min [2025-09-15T18:48:18.323506] [DEBUG] [LOCAL ] HIX: Primary data saved (14901 records). [2025-09-15T18:48:18.321203] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-15T18:48:18.323960] [INFO ] [MAIN ] HIX: Full history saved. [2025-09-15T18:48:18.329174] [INFO ] [MAIN ] Update Progress: 1023/2369 symbols completed. HIX took 18.7s. Estimated remaining: 2h 22m 26s. Rate: 9.5 symbols/min [2025-09-15T18:48:18.665419] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:48:18.668214] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:48:18.691767] [DEBUG] [LOCAL ] HLI: Loaded 22943 existing records from primary storage. [2025-09-15T18:48:18.691903] [INFO ] [MAIN ] HLI: Loaded 22943 existing records. [2025-09-15T18:48:18.842827] [DEBUG] [LOCAL ] HLF: Loaded 36855 existing records from primary storage. [2025-09-15T18:48:18.860144] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-09-15T18:48:18.878663] [INFO ] [MAIN ] HLF: Loaded 36855 existing records. [2025-09-15T18:48:18.898881] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:48:18.977015] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-09-15T18:48:19.000311] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-09-15T18:48:19.008229] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-09-15T18:48:19.018521] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-09-15T18:48:19.181834] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:48:19.197932] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-09-15T18:48:19.203114] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-09-15T18:48:19.222158] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-09-15T18:48:19.240062] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-09-15T18:48:19.659090] [INFO ] [REMOTE ] HLI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:48:19.692539] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-09-15T18:48:19.811263] [INFO ] [REMOTE ] HLF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:48:19.967356] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-15T18:48:20.022541] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-15T18:48:20.457926] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-09-15T18:48:21.060130] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T18:48:21.137363] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-15T18:48:21.257864] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-09-15T18:48:22.057934] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-09-15T18:48:22.195979] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-15T18:48:22.857888] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-09-15T18:48:23.338970] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T18:48:23.657926] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-09-15T18:48:24.457945] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-09-15T18:48:24.500501] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-15T18:48:24.826078] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-15T18:48:25.257823] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-09-15T18:48:25.558190] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-15T18:48:25.561132] [INFO ] [REMOTE ] HKD: Full fetch complete (20120 records). [2025-09-15T18:48:25.561211] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-09-15T18:48:25.918098] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-09-15T18:48:25.918179] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-09-15T18:48:25.918623] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-09-15T18:48:25.918680] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-09-15T18:48:25.919258] [DEBUG] [LOCAL ] HKD: Trimmed 20120 records to 13415 (keeping 150 days of data) [2025-09-15T18:48:26.003919] [DEBUG] [LOCAL ] HKD: Primary data saved (13415 records). [2025-09-15T18:48:26.004300] [INFO ] [MAIN ] HKD: Full history saved. [2025-09-15T18:48:26.004465] [INFO ] [MAIN ] Update Progress: 1024/2369 symbols completed. HKD took 20.2s. Estimated remaining: 2h 22m 21s. Rate: 9.4 symbols/min [2025-09-15T18:48:26.068328] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-09-15T18:48:26.178468] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:48:26.203953] [DEBUG] [LOCAL ] HLIO: Loaded 22033 existing records from primary storage. [2025-09-15T18:48:26.204130] [INFO ] [MAIN ] HLIO: Loaded 22033 existing records. [2025-09-15T18:48:26.386828] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:48:26.387087] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-09-15T18:48:26.387148] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-09-15T18:48:26.387883] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-09-15T18:48:26.387958] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-09-15T18:48:26.744502] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:48:26.844161] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-15T18:48:26.857808] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-09-15T18:48:27.657842] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-09-15T18:48:27.758727] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T18:48:28.063235] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T18:48:28.307930] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-15T18:48:28.457862] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-09-15T18:48:29.257886] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-09-15T18:48:30.057875] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-09-15T18:48:30.380083] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-15T18:48:30.598717] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-15T18:48:30.857885] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-09-15T18:48:31.123076] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-15T18:48:31.657863] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-09-15T18:48:32.457871] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-09-15T18:48:32.789906] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-15T18:48:32.861471] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-15T18:48:33.257870] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-09-15T18:48:34.057873] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-09-15T18:48:34.143303] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-15T18:48:34.857885] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-09-15T18:48:35.192500] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-15T18:48:35.213738] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-15T18:48:35.217428] [INFO ] [REMOTE ] HLI: Full fetch complete (34088 records). [2025-09-15T18:48:35.217513] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-09-15T18:48:35.607514] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-09-15T18:48:35.607602] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-09-15T18:48:35.608251] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-09-15T18:48:35.608308] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-09-15T18:48:35.609205] [DEBUG] [LOCAL ] HLI: Trimmed 34088 records to 22468 (keeping 150 days of data) [2025-09-15T18:48:35.669266] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-09-15T18:48:35.758977] [DEBUG] [LOCAL ] HLI: Primary data saved (22468 records). [2025-09-15T18:48:35.759109] [INFO ] [MAIN ] HLI: Full history saved. [2025-09-15T18:48:35.759201] [INFO ] [MAIN ] Update Progress: 1025/2369 symbols completed. HLI took 17.4s. Estimated remaining: 2h 22m 19s. Rate: 9.4 symbols/min [2025-09-15T18:48:35.934336] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:48:35.957862] [DEBUG] [LOCAL ] HLLY: Loaded 24903 existing records from primary storage. [2025-09-15T18:48:35.958025] [INFO ] [MAIN ] HLLY: Loaded 24903 existing records. [2025-09-15T18:48:36.139727] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:48:36.140035] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-09-15T18:48:36.140086] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-09-15T18:48:36.140775] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-09-15T18:48:36.140830] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-09-15T18:48:36.458708] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-09-15T18:48:36.526683] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:48:36.558433] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-15T18:48:37.257883] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-09-15T18:48:37.553731] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-15T18:48:37.763106] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T18:48:38.057884] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-09-15T18:48:38.836601] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-15T18:48:38.857831] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-09-15T18:48:39.393935] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-15T18:48:39.657941] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-09-15T18:48:40.356104] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T18:48:40.457938] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-09-15T18:48:41.059305] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-15T18:48:41.066124] [INFO ] [REMOTE ] HL: Full fetch complete (58348 records). [2025-09-15T18:48:41.066440] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-09-15T18:48:41.267458] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-09-15T18:48:41.455335] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-09-15T18:48:41.455544] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-09-15T18:48:41.456502] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-09-15T18:48:41.463033] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-09-15T18:48:41.475442] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T18:48:41.483109] [DEBUG] [LOCAL ] HL: Trimmed 58348 records to 39637 (keeping 150 days of data) [2025-09-15T18:48:41.735950] [DEBUG] [LOCAL ] HL: Primary data saved (39637 records). [2025-09-15T18:48:41.736114] [INFO ] [MAIN ] HL: Full history saved. [2025-09-15T18:48:41.736840] [INFO ] [MAIN ] Update Progress: 1026/2369 symbols completed. HL took 34.2s. Estimated remaining: 2h 22m 12s. Rate: 9.4 symbols/min [2025-09-15T18:48:41.919462] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:48:41.962702] [DEBUG] [LOCAL ] HLN: Loaded 39960 existing records from primary storage. [2025-09-15T18:48:41.962891] [INFO ] [MAIN ] HLN: Loaded 39960 existing records. [2025-09-15T18:48:42.061721] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-09-15T18:48:42.138198] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:48:42.138426] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-09-15T18:48:42.138470] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-09-15T18:48:42.139366] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-09-15T18:48:42.139418] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-09-15T18:48:42.491552] [INFO ] [REMOTE ] HLN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:48:42.507115] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T18:48:42.857880] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-09-15T18:48:43.463435] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T18:48:43.657931] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-09-15T18:48:44.386873] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-15T18:48:44.457895] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-09-15T18:48:44.583258] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-15T18:48:45.257936] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-09-15T18:48:45.632146] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-15T18:48:46.057928] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-09-15T18:48:46.361332] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-15T18:48:46.367014] [INFO ] [REMOTE ] HLF: Full fetch complete (53456 records). [2025-09-15T18:48:46.367174] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-09-15T18:48:46.754613] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-09-15T18:48:46.754726] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-09-15T18:48:46.755517] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-09-15T18:48:46.755561] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-09-15T18:48:46.756700] [DEBUG] [LOCAL ] HLF: Trimmed 53456 records to 36076 (keeping 150 days of data) [2025-09-15T18:48:46.858904] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-09-15T18:48:46.968750] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-15T18:48:47.001030] [DEBUG] [LOCAL ] HLF: Primary data saved (36076 records). [2025-09-15T18:48:47.001163] [INFO ] [MAIN ] HLF: Full history saved. [2025-09-15T18:48:47.001257] [INFO ] [MAIN ] Update Progress: 1027/2369 symbols completed. HLF took 28.7s. Estimated remaining: 2h 22m 5s. Rate: 9.4 symbols/min [2025-09-15T18:48:47.168849] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:48:47.203876] [DEBUG] [LOCAL ] HLT: Loaded 37911 existing records from primary storage. [2025-09-15T18:48:47.204015] [INFO ] [MAIN ] HLT: Loaded 37911 existing records. [2025-09-15T18:48:47.379401] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:48:47.379673] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-09-15T18:48:47.379720] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-09-15T18:48:47.380570] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-09-15T18:48:47.380619] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-09-15T18:48:47.657848] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-09-15T18:48:47.736171] [INFO ] [REMOTE ] HLT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:48:48.429017] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-15T18:48:48.457818] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-09-15T18:48:48.649709] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-15T18:48:49.257881] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-09-15T18:48:50.057869] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-09-15T18:48:50.143959] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-15T18:48:50.708713] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T18:48:50.857852] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-09-15T18:48:51.090370] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-15T18:48:51.093184] [INFO ] [REMOTE ] HLIO: Full fetch complete (29730 records). [2025-09-15T18:48:51.093267] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-09-15T18:48:51.458863] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-09-15T18:48:51.458946] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-09-15T18:48:51.459593] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-09-15T18:48:51.459655] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-09-15T18:48:51.460443] [DEBUG] [LOCAL ] HLIO: Trimmed 29730 records to 21669 (keeping 150 days of data) [2025-09-15T18:48:51.595579] [DEBUG] [LOCAL ] HLIO: Primary data saved (21669 records). [2025-09-15T18:48:51.595734] [INFO ] [MAIN ] HLIO: Full history saved. [2025-09-15T18:48:51.595822] [INFO ] [MAIN ] Update Progress: 1028/2369 symbols completed. HLIO took 25.6s. Estimated remaining: 2h 21m 56s. Rate: 9.4 symbols/min [2025-09-15T18:48:51.663095] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-09-15T18:48:51.770051] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:48:51.808451] [DEBUG] [LOCAL ] HLX: Loaded 35929 existing records from primary storage. [2025-09-15T18:48:51.808627] [INFO ] [MAIN ] HLX: Loaded 35929 existing records. [2025-09-15T18:48:51.982576] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:48:51.982852] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-09-15T18:48:51.982899] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-09-15T18:48:51.983623] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-09-15T18:48:51.983702] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-09-15T18:48:52.354263] [INFO ] [REMOTE ] HLX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:48:52.457966] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-09-15T18:48:52.464190] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T18:48:53.033718] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-15T18:48:53.257875] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-09-15T18:48:54.000289] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-15T18:48:54.057823] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-09-15T18:48:54.352957] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-15T18:48:54.857895] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-09-15T18:48:55.516014] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T18:48:55.657913] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-09-15T18:48:56.457889] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-09-15T18:48:56.626242] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T18:48:57.146378] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T18:48:57.257862] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-09-15T18:48:57.281708] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-15T18:48:58.057862] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-09-15T18:48:58.671187] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-15T18:48:58.857921] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-09-15T18:48:59.122394] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T18:48:59.657943] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-09-15T18:49:00.006333] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-15T18:49:00.457937] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-09-15T18:49:00.733629] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-15T18:49:00.737927] [INFO ] [REMOTE ] HLLY: Full fetch complete (34894 records). [2025-09-15T18:49:00.738040] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-09-15T18:49:01.112675] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-09-15T18:49:01.112754] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-09-15T18:49:01.113355] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-09-15T18:49:01.113394] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-09-15T18:49:01.114181] [DEBUG] [LOCAL ] HLLY: Trimmed 34894 records to 24451 (keeping 150 days of data) [2025-09-15T18:49:01.252162] [DEBUG] [LOCAL ] HLLY: Primary data saved (24451 records). [2025-09-15T18:49:01.252291] [INFO ] [MAIN ] HLLY: Full history saved. [2025-09-15T18:49:01.252372] [INFO ] [MAIN ] Update Progress: 1029/2369 symbols completed. HLLY took 25.5s. Estimated remaining: 2h 21m 54s. Rate: 9.4 symbols/min [2025-09-15T18:49:01.263434] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-09-15T18:49:01.428607] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:49:01.463857] [DEBUG] [LOCAL ] HMC: Loaded 34740 existing records from primary storage. [2025-09-15T18:49:01.463995] [INFO ] [MAIN ] HMC: Loaded 34740 existing records. [2025-09-15T18:49:01.646077] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:49:01.646475] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-09-15T18:49:01.646627] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-09-15T18:49:01.647521] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-09-15T18:49:01.647580] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-09-15T18:49:01.776553] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T18:49:02.062975] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-09-15T18:49:02.067094] [INFO ] [REMOTE ] HMC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:49:02.857923] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-09-15T18:49:03.046996] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-15T18:49:03.657903] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-09-15T18:49:03.956418] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-15T18:49:04.417290] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-15T18:49:04.457878] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-09-15T18:49:05.257948] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-09-15T18:49:05.318510] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-15T18:49:05.878800] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T18:49:06.057862] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-09-15T18:49:06.857896] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-09-15T18:49:06.939443] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-15T18:49:07.363757] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-15T18:49:07.657889] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-09-15T18:49:08.425189] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-15T18:49:08.457850] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-09-15T18:49:09.257370] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-15T18:49:09.267608] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-09-15T18:49:10.054107] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T18:49:10.059431] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-09-15T18:49:10.061039] [INFO ] [REMOTE ] HLN: Full fetch complete (57683 records). [2025-09-15T18:49:10.061133] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-09-15T18:49:10.447738] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-09-15T18:49:10.447833] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-09-15T18:49:10.448672] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-09-15T18:49:10.448731] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-09-15T18:49:10.450038] [DEBUG] [LOCAL ] HLN: Trimmed 57683 records to 39179 (keeping 150 days of data) [2025-09-15T18:49:10.698544] [DEBUG] [LOCAL ] HLN: Primary data saved (39179 records). [2025-09-15T18:49:10.698702] [INFO ] [MAIN ] HLN: Full history saved. [2025-09-15T18:49:10.699244] [INFO ] [MAIN ] Update Progress: 1030/2369 symbols completed. HLN took 29.0s. Estimated remaining: 2h 21m 52s. Rate: 9.4 symbols/min [2025-09-15T18:49:10.870817] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:49:10.868469] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-09-15T18:49:10.890635] [DEBUG] [LOCAL ] HMN: Loaded 18068 existing records from primary storage. [2025-09-15T18:49:10.890792] [INFO ] [MAIN ] HMN: Loaded 18068 existing records. [2025-09-15T18:49:11.068338] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:49:11.068809] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-09-15T18:49:11.068868] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-09-15T18:49:11.069394] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-09-15T18:49:11.069448] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-09-15T18:49:11.379881] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-15T18:49:11.465371] [INFO ] [REMOTE ] HMN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:49:11.657833] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-09-15T18:49:11.735755] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T18:49:12.456328] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-15T18:49:12.460813] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-09-15T18:49:12.462102] [INFO ] [REMOTE ] HLX: Full fetch complete (52317 records). [2025-09-15T18:49:12.462222] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-09-15T18:49:12.774176] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-15T18:49:12.860305] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-09-15T18:49:12.860381] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-09-15T18:49:12.861128] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-09-15T18:49:12.861181] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-09-15T18:49:12.863597] [DEBUG] [LOCAL ] HLX: Trimmed 52317 records to 35148 (keeping 150 days of data) [2025-09-15T18:49:13.060137] [DEBUG] [LOCAL ] HLX: Primary data saved (35148 records). [2025-09-15T18:49:13.060270] [INFO ] [MAIN ] HLX: Full history saved. [2025-09-15T18:49:13.060363] [INFO ] [MAIN ] Update Progress: 1031/2369 symbols completed. HLX took 21.5s. Estimated remaining: 2h 21m 40s. Rate: 9.4 symbols/min [2025-09-15T18:49:13.230203] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:49:13.257887] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-09-15T18:49:13.272162] [DEBUG] [LOCAL ] HMY: Loaded 39927 existing records from primary storage. [2025-09-15T18:49:13.272318] [INFO ] [MAIN ] HMY: Loaded 39927 existing records. [2025-09-15T18:49:13.468115] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:49:13.468389] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-09-15T18:49:13.468434] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-09-15T18:49:13.469323] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-09-15T18:49:13.469381] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-09-15T18:49:13.824473] [INFO ] [REMOTE ] HMY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:49:13.889746] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T18:49:14.057876] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-09-15T18:49:14.239255] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-15T18:49:14.857871] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-09-15T18:49:15.657950] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-09-15T18:49:15.853358] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-15T18:49:15.909510] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-15T18:49:16.457891] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-09-15T18:49:17.005698] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T18:49:17.257904] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-09-15T18:49:17.810319] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T18:49:17.815957] [INFO ] [REMOTE ] HLT: Full fetch complete (55243 records). [2025-09-15T18:49:17.816078] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-09-15T18:49:18.064601] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-09-15T18:49:18.200093] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-09-15T18:49:18.200171] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-09-15T18:49:18.201059] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-09-15T18:49:18.201112] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-09-15T18:49:18.204025] [DEBUG] [LOCAL ] HLT: Trimmed 55243 records to 37122 (keeping 150 days of data) [2025-09-15T18:49:18.439191] [DEBUG] [LOCAL ] HLT: Primary data saved (37122 records). [2025-09-15T18:49:18.439331] [INFO ] [MAIN ] HLT: Full history saved. [2025-09-15T18:49:18.439449] [INFO ] [MAIN ] Update Progress: 1032/2369 symbols completed. HLT took 31.4s. Estimated remaining: 2h 21m 32s. Rate: 9.4 symbols/min [2025-09-15T18:49:18.608284] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:49:18.608487] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-09-15T18:49:18.608527] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-09-15T18:49:18.608679] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-09-15T18:49:18.608722] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-15T18:49:18.608766] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-15T18:49:18.608801] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-09-15T18:49:18.858060] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-09-15T18:49:18.968680] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:49:18.999966] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-15T18:49:19.025054] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-15T18:49:19.657858] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-09-15T18:49:20.213588] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-15T18:49:20.457863] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-02. [2025-09-15T18:49:20.650446] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T18:49:20.650735] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-02 [2025-09-15T18:49:21.257910] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-09-15T18:49:21.851945] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-15T18:49:22.057866] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-09-15T18:49:22.205563] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-15T18:49:22.857869] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-09-15T18:49:23.657905] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-03. [2025-09-15T18:49:23.721065] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-15T18:49:23.850472] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T18:49:23.850826] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-03 [2025-09-15T18:49:23.998396] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-15T18:49:24.457861] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-09-15T18:49:25.093129] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-15T18:49:25.257870] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-09-15T18:49:26.057873] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-04. [2025-09-15T18:49:26.249710] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T18:49:26.250076] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-04 [2025-09-15T18:49:26.857872] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-09-15T18:49:27.073751] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-15T18:49:27.578837] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-15T18:49:27.581599] [INFO ] [REMOTE ] HMN: Full fetch complete (24846 records). [2025-09-15T18:49:27.581700] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-09-15T18:49:27.662926] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-09-15T18:49:27.984950] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-09-15T18:49:27.985044] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-09-15T18:49:27.985702] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-09-15T18:49:27.985758] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-09-15T18:49:27.986578] [DEBUG] [LOCAL ] HMN: Trimmed 24846 records to 17769 (keeping 150 days of data) [2025-09-15T18:49:28.101081] [DEBUG] [LOCAL ] HMN: Primary data saved (17769 records). [2025-09-15T18:49:28.101243] [INFO ] [MAIN ] HMN: Full history saved. [2025-09-15T18:49:28.101365] [INFO ] [MAIN ] Update Progress: 1033/2369 symbols completed. HMN took 17.4s. Estimated remaining: 2h 21m 30s. Rate: 9.4 symbols/min [2025-09-15T18:49:28.273743] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:49:28.295726] [DEBUG] [LOCAL ] HNI: Loaded 21400 existing records from primary storage. [2025-09-15T18:49:28.295858] [INFO ] [MAIN ] HNI: Loaded 21400 existing records. [2025-09-15T18:49:28.466339] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-09-15T18:49:28.490323] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:49:28.490679] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-09-15T18:49:28.490736] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-09-15T18:49:28.491538] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-09-15T18:49:28.491635] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-09-15T18:49:28.882201] [INFO ] [REMOTE ] HNI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:49:29.257938] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-09-15T18:49:29.543142] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-15T18:49:29.819787] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T18:49:30.057924] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-09-15T18:49:30.177533] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-15T18:49:30.857891] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-09-15T18:49:31.513987] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T18:49:31.519985] [INFO ] [REMOTE ] HMC: Full fetch complete (51282 records). [2025-09-15T18:49:31.520174] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-09-15T18:49:31.665370] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-05. [2025-09-15T18:49:31.906451] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-09-15T18:49:31.906532] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-09-15T18:49:31.907286] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-09-15T18:49:31.907331] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-09-15T18:49:31.908445] [DEBUG] [LOCAL ] HMC: Trimmed 51282 records to 33997 (keeping 150 days of data) [2025-09-15T18:49:32.153151] [DEBUG] [LOCAL ] HMC: Primary data saved (33997 records). [2025-09-15T18:49:32.153325] [INFO ] [MAIN ] HMC: Full history saved. [2025-09-15T18:49:32.153417] [INFO ] [MAIN ] Update Progress: 1034/2369 symbols completed. HMC took 30.9s. Estimated remaining: 2h 21m 21s. Rate: 9.4 symbols/min [2025-09-15T18:49:32.330425] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T18:49:32.375245] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:49:32.419572] [DEBUG] [LOCAL ] HOG: Loaded 38253 existing records from primary storage. [2025-09-15T18:49:32.419806] [INFO ] [MAIN ] HOG: Loaded 38253 existing records. [2025-09-15T18:49:32.463491] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-09-15T18:49:32.612103] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:49:32.612397] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-09-15T18:49:32.612524] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-09-15T18:49:32.619503] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-09-15T18:49:32.620901] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-09-15T18:49:32.626844] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-15T18:49:33.008515] [INFO ] [REMOTE ] HOG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:49:33.257903] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-09-15T18:49:34.057867] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-06. [2025-09-15T18:49:34.118337] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-15T18:49:34.388118] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-15T18:49:34.857878] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-09-15T18:49:35.623714] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-15T18:49:35.657838] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-07. [2025-09-15T18:49:36.457886] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-09-15T18:49:36.514551] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-15T18:49:37.015226] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-15T18:49:37.257846] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-08. [2025-09-15T18:49:37.577849] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-15T18:49:38.057878] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-09-15T18:49:38.490256] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T18:49:38.857884] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-09. [2025-09-15T18:49:39.082750] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T18:49:39.657868] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-09-15T18:49:40.088105] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T18:49:40.094666] [INFO ] [REMOTE ] HNGE: Full fetch complete (23933 records). [2025-09-15T18:49:40.094808] [DEBUG] [VALIDATOR ] HNGE: Validating primary data. [2025-09-15T18:49:40.289933] [WARN ] [VALIDATOR ] HNGE: Validation failed - insufficient historical data. Have 79 unique days, need 150 days [2025-09-15T18:49:40.290362] [FATAL] [MAIN ] HNGE: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:49:40.290425] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:49:40.290476] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-15T18:49:40.290563] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-15T18:49:40.290616] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-09-15T18:49:40.290704] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-09-15T18:49:40.290802] [INFO ] [MAIN ] Update Progress: 1035/2369 symbols completed. HNGE took 21.9s. Estimated remaining: 2h 21m 17s. Rate: 9.4 symbols/min [2025-09-15T18:49:40.466320] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-09-15T18:49:40.469387] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:49:40.507292] [DEBUG] [LOCAL ] HOMB: Loaded 32060 existing records from primary storage. [2025-09-15T18:49:40.507541] [INFO ] [MAIN ] HOMB: Loaded 32060 existing records. [2025-09-15T18:49:40.686068] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:49:40.686391] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-09-15T18:49:40.686615] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-09-15T18:49:40.693175] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-09-15T18:49:40.700122] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-09-15T18:49:40.734443] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-15T18:49:41.063002] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:49:41.257885] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-09-15T18:49:42.057936] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-09-15T18:49:42.425655] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-15T18:49:42.611077] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T18:49:42.857887] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-09-15T18:49:43.509857] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T18:49:43.657865] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-09-15T18:49:44.457863] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-09-15T18:49:44.745704] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-15T18:49:44.751682] [INFO ] [REMOTE ] HMY: Full fetch complete (57767 records). [2025-09-15T18:49:44.751827] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-09-15T18:49:45.163847] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-09-15T18:49:45.164120] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-09-15T18:49:45.180051] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-09-15T18:49:45.189517] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-09-15T18:49:45.191865] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-15T18:49:45.201851] [DEBUG] [LOCAL ] HMY: Trimmed 57767 records to 39146 (keeping 150 days of data) [2025-09-15T18:49:45.262943] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-09-15T18:49:45.449098] [DEBUG] [LOCAL ] HMY: Primary data saved (39146 records). [2025-09-15T18:49:45.449246] [INFO ] [MAIN ] HMY: Full history saved. [2025-09-15T18:49:45.449332] [INFO ] [MAIN ] Update Progress: 1036/2369 symbols completed. HMY took 32.4s. Estimated remaining: 2h 21m 9s. Rate: 9.4 symbols/min [2025-09-15T18:49:45.619113] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:49:45.650083] [DEBUG] [LOCAL ] HOUS: Loaded 33145 existing records from primary storage. [2025-09-15T18:49:45.650219] [INFO ] [MAIN ] HOUS: Loaded 33145 existing records. [2025-09-15T18:49:45.826716] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:49:45.826942] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-09-15T18:49:45.826986] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-09-15T18:49:45.827818] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-09-15T18:49:45.827882] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-09-15T18:49:46.063867] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-09-15T18:49:46.179173] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:49:46.219911] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T18:49:46.746026] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T18:49:46.750612] [INFO ] [REMOTE ] HNI: Full fetch complete (31256 records). [2025-09-15T18:49:46.750740] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-09-15T18:49:46.863094] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-09-15T18:49:47.125801] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-09-15T18:49:47.125886] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-09-15T18:49:47.126526] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-09-15T18:49:47.126568] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-09-15T18:49:47.127362] [DEBUG] [LOCAL ] HNI: Trimmed 31256 records to 21203 (keeping 150 days of data) [2025-09-15T18:49:47.262706] [DEBUG] [LOCAL ] HNI: Primary data saved (21203 records). [2025-09-15T18:49:47.262859] [INFO ] [MAIN ] HNI: Full history saved. [2025-09-15T18:49:47.263098] [INFO ] [MAIN ] Update Progress: 1037/2369 symbols completed. HNI took 19.2s. Estimated remaining: 2h 20m 57s. Rate: 9.5 symbols/min [2025-09-15T18:49:47.291472] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-15T18:49:47.657901] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-09-15T18:49:48.280542] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T18:49:48.457861] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-09-15T18:49:48.745605] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-15T18:49:49.257898] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-09-15T18:49:49.920311] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T18:49:50.057866] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-09-15T18:49:50.493706] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T18:49:50.857889] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-09-15T18:49:51.657932] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-09-15T18:49:51.727118] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-15T18:49:52.005565] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-15T18:49:52.457881] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-09-15T18:49:52.675584] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T18:49:53.257915] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-09-15T18:49:54.036508] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-15T18:49:54.057857] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-09-15T18:49:54.586257] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-15T18:49:54.857885] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-09-15T18:49:55.657947] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-09-15T18:49:55.774853] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-15T18:49:55.951960] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-15T18:49:56.457918] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-09-15T18:49:57.149087] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-15T18:49:57.257897] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-09-15T18:49:58.057983] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-09-15T18:49:58.178286] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-15T18:49:58.346697] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-15T18:49:58.857893] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-09-15T18:49:59.209540] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T18:49:59.214447] [INFO ] [REMOTE ] HOMB: Full fetch complete (47578 records). [2025-09-15T18:49:59.214544] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-09-15T18:49:59.598991] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-09-15T18:49:59.599097] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-09-15T18:49:59.599818] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-09-15T18:49:59.599865] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-09-15T18:49:59.601064] [DEBUG] [LOCAL ] HOMB: Trimmed 47578 records to 31393 (keeping 150 days of data) [2025-09-15T18:49:59.659578] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-09-15T18:49:59.808052] [DEBUG] [LOCAL ] HOMB: Primary data saved (31393 records). [2025-09-15T18:49:59.808200] [INFO ] [MAIN ] HOMB: Full history saved. [2025-09-15T18:49:59.808289] [INFO ] [MAIN ] Update Progress: 1038/2369 symbols completed. HOMB took 19.5s. Estimated remaining: 2h 20m 58s. Rate: 9.4 symbols/min [2025-09-15T18:50:00.073470] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T18:50:00.457904] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-09-15T18:50:01.398825] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-15T18:50:01.404893] [INFO ] [REMOTE ] HOG: Full fetch complete (55938 records). [2025-09-15T18:50:01.405094] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-09-15T18:50:01.902750] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-09-15T18:50:01.902867] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-09-15T18:50:01.903902] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-09-15T18:50:01.903983] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-09-15T18:50:01.905462] [DEBUG] [LOCAL ] HOG: Trimmed 55938 records to 37469 (keeping 150 days of data) [2025-09-15T18:50:02.201134] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-15T18:50:02.214601] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-09-15T18:50:02.221437] [DEBUG] [LOCAL ] HOG: Primary data saved (37469 records). [2025-09-15T18:50:02.221619] [INFO ] [MAIN ] HOG: Full history saved. [2025-09-15T18:50:02.221745] [INFO ] [MAIN ] Update Progress: 1039/2369 symbols completed. HOG took 30.1s. Estimated remaining: 2h 20m 47s. Rate: 9.4 symbols/min [2025-09-15T18:50:04.370800] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-15T18:50:04.376169] [INFO ] [REMOTE ] HOUS: Full fetch complete (47526 records). [2025-09-15T18:50:04.376326] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-09-15T18:50:04.760829] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-09-15T18:50:04.760918] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-09-15T18:50:04.761714] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-09-15T18:50:04.761764] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-09-15T18:50:04.762896] [DEBUG] [LOCAL ] HOUS: Trimmed 47526 records to 32545 (keeping 150 days of data) [2025-09-15T18:50:04.946251] [DEBUG] [LOCAL ] HOUS: Primary data saved (32545 records). [2025-09-15T18:50:04.946394] [INFO ] [MAIN ] HOUS: Full history saved. [2025-09-15T18:50:04.946504] [INFO ] [MAIN ] Update Progress: 1040/2369 symbols completed. HOUS took 19.5s. Estimated remaining: 2h 20m 36s. Rate: 9.5 symbols/min [2025-09-15T18:50:05.612635] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:50:05.611668] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:50:05.660801] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:50:05.657811] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:50:05.670681] [DEBUG] [LOCAL ] HPF: Loaded 5597 existing records from primary storage. [2025-09-15T18:50:05.673164] [INFO ] [MAIN ] HPF: Loaded 5597 existing records. [2025-09-15T18:50:05.760684] [DEBUG] [LOCAL ] HOV: Loaded 10650 existing records from primary storage. [2025-09-15T18:50:05.792135] [INFO ] [MAIN ] HOV: Loaded 10650 existing records. [2025-09-15T18:50:06.003424] [DEBUG] [LOCAL ] HP: Loaded 39084 existing records from primary storage. [2025-09-15T18:50:06.002742] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:50:06.003959] [INFO ] [MAIN ] HP: Loaded 39084 existing records. [2025-09-15T18:50:06.058544] [DEBUG] [LOCAL ] HPE: Loaded 40437 existing records from primary storage. [2025-09-15T18:50:06.036408] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-09-15T18:50:06.087743] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-09-15T18:50:06.139987] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:50:06.129966] [INFO ] [MAIN ] HPE: Loaded 40437 existing records. [2025-09-15T18:50:06.187259] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-09-15T18:50:06.190379] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-09-15T18:50:06.200772] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-09-15T18:50:06.242816] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-09-15T18:50:06.268526] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-09-15T18:50:06.346615] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-09-15T18:50:06.537779] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:50:06.629801] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-09-15T18:50:06.640456] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-09-15T18:50:06.757482] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-09-15T18:50:06.731173] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:50:06.781610] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-09-15T18:50:06.795355] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-09-15T18:50:06.795400] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-09-15T18:50:06.870455] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-09-15T18:50:06.981704] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-09-15T18:50:07.371659] [INFO ] [REMOTE ] HPF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:50:07.531407] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-09-15T18:50:07.646855] [INFO ] [REMOTE ] HOV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:50:07.688589] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-09-15T18:50:07.901954] [INFO ] [REMOTE ] HP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:50:07.951505] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-09-15T18:50:07.951269] [INFO ] [REMOTE ] HPE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:50:07.952458] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-09-15T18:50:08.398995] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-15T18:50:08.400887] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-09-15T18:50:08.605493] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-15T18:50:08.608373] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-09-15T18:50:08.822843] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-15T18:50:08.824734] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-09-15T18:50:09.355420] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T18:50:09.365304] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-09-15T18:50:09.423735] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-15T18:50:09.427132] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-09-15T18:50:09.661940] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-15T18:50:09.664079] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-09-15T18:50:09.716863] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-15T18:50:10.057902] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-09-15T18:50:10.308532] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-15T18:50:10.356171] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-15T18:50:10.857900] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-09-15T18:50:11.047504] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T18:50:11.464865] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-15T18:50:11.631200] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-15T18:50:11.657847] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-09-15T18:50:12.457899] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-09-15T18:50:12.927347] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-15T18:50:13.257834] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-09-15T18:50:13.754036] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-15T18:50:14.021235] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-15T18:50:14.057831] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-09-15T18:50:14.857878] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-09-15T18:50:15.647761] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-15T18:50:15.658274] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-09-15T18:50:15.769654] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-15T18:50:16.457889] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-09-15T18:50:17.257880] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-09-15T18:50:17.596768] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-15T18:50:18.057928] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-09-15T18:50:18.607547] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T18:50:18.857879] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-09-15T18:50:19.454037] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (3.00 seconds). [2025-09-15T18:50:19.455535] [INFO ] [REMOTE ] HPF: Full fetch complete (7710 records). [2025-09-15T18:50:19.455606] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-09-15T18:50:19.671477] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-09-15T18:50:19.825234] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-09-15T18:50:19.825315] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-09-15T18:50:19.825559] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-09-15T18:50:19.825599] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-09-15T18:50:19.826045] [DEBUG] [LOCAL ] HPF: Trimmed 7710 records to 5553 (keeping 150 days of data) [2025-09-15T18:50:19.862893] [DEBUG] [LOCAL ] HPF: Primary data saved (5553 records). [2025-09-15T18:50:19.863033] [INFO ] [MAIN ] HPF: Full history saved. [2025-09-15T18:50:19.863133] [INFO ] [MAIN ] Update Progress: 1041/2369 symbols completed. HPF took 14.9s. Estimated remaining: 2h 20m 41s. Rate: 9.4 symbols/min [2025-09-15T18:50:20.042735] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:50:20.051551] [DEBUG] [LOCAL ] HPI: Loaded 7619 existing records from primary storage. [2025-09-15T18:50:20.051638] [INFO ] [MAIN ] HPI: Loaded 7619 existing records. [2025-09-15T18:50:20.236512] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:50:20.236940] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-09-15T18:50:20.237022] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-09-15T18:50:20.237420] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-09-15T18:50:20.237555] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-09-15T18:50:20.513099] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-15T18:50:20.557145] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-09-15T18:50:20.634747] [INFO ] [REMOTE ] HPI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:50:20.649434] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-15T18:50:21.257871] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-09-15T18:50:21.506411] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-15T18:50:22.057828] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-09-15T18:50:22.133319] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-15T18:50:22.235571] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-15T18:50:22.857872] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-09-15T18:50:23.657859] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-09-15T18:50:23.754514] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-15T18:50:23.756036] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-15T18:50:24.450908] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-15T18:50:24.452746] [INFO ] [REMOTE ] HOV: Full fetch complete (14791 records). [2025-09-15T18:50:24.452818] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-09-15T18:50:24.464020] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-09-15T18:50:24.839110] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-09-15T18:50:24.839229] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-09-15T18:50:24.839684] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-09-15T18:50:24.839745] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-09-15T18:50:24.840321] [DEBUG] [LOCAL ] HOV: Trimmed 14791 records to 10490 (keeping 150 days of data) [2025-09-15T18:50:24.906118] [DEBUG] [LOCAL ] HOV: Primary data saved (10490 records). [2025-09-15T18:50:24.906278] [INFO ] [MAIN ] HOV: Full history saved. [2025-09-15T18:50:24.906369] [INFO ] [MAIN ] Update Progress: 1042/2369 symbols completed. HOV took 20.0s. Estimated remaining: 2h 20m 33s. Rate: 9.4 symbols/min [2025-09-15T18:50:25.111331] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:50:25.147323] [DEBUG] [LOCAL ] HPP: Loaded 38521 existing records from primary storage. [2025-09-15T18:50:25.147475] [INFO ] [MAIN ] HPP: Loaded 38521 existing records. [2025-09-15T18:50:25.257858] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-09-15T18:50:25.367523] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:50:25.373891] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-15T18:50:25.377576] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-09-15T18:50:25.377687] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-09-15T18:50:25.378600] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-09-15T18:50:25.378833] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-09-15T18:50:25.743995] [INFO ] [REMOTE ] HPP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:50:26.057901] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-09-15T18:50:26.751089] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-15T18:50:26.857881] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-09-15T18:50:27.223727] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-15T18:50:27.647592] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-15T18:50:27.657849] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-09-15T18:50:28.375564] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-15T18:50:28.457884] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-09-15T18:50:29.257927] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-09-15T18:50:30.057951] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-09-15T18:50:30.358739] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-15T18:50:30.365131] [INFO ] [REMOTE ] HPE: Full fetch complete (58377 records). [2025-09-15T18:50:30.365274] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-09-15T18:50:30.752249] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-09-15T18:50:30.752346] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-09-15T18:50:30.753261] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-09-15T18:50:30.753331] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-09-15T18:50:30.754737] [DEBUG] [LOCAL ] HPE: Trimmed 58377 records to 39657 (keeping 150 days of data) [2025-09-15T18:50:30.857901] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-09-15T18:50:31.007707] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-15T18:50:31.038384] [DEBUG] [LOCAL ] HPE: Primary data saved (39657 records). [2025-09-15T18:50:31.038537] [INFO ] [MAIN ] HPE: Full history saved. [2025-09-15T18:50:31.038633] [INFO ] [MAIN ] Update Progress: 1043/2369 symbols completed. HPE took 26.1s. Estimated remaining: 2h 20m 26s. Rate: 9.4 symbols/min [2025-09-15T18:50:31.212103] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:50:31.249757] [DEBUG] [LOCAL ] HPQ: Loaded 40412 existing records from primary storage. [2025-09-15T18:50:31.249924] [INFO ] [MAIN ] HPQ: Loaded 40412 existing records. [2025-09-15T18:50:31.432142] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:50:31.432568] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-09-15T18:50:31.432730] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-09-15T18:50:31.439588] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-09-15T18:50:31.440553] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-09-15T18:50:31.440511] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-15T18:50:31.663345] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-09-15T18:50:31.806091] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:50:31.843795] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-15T18:50:32.457878] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-09-15T18:50:33.257877] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-09-15T18:50:33.272071] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-15T18:50:33.340050] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T18:50:34.057869] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-09-15T18:50:34.659249] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-15T18:50:34.661597] [INFO ] [REMOTE ] HPI: Full fetch complete (10181 records). [2025-09-15T18:50:34.661696] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-09-15T18:50:34.861533] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-09-15T18:50:34.992865] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-15T18:50:35.090903] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-09-15T18:50:35.091038] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-09-15T18:50:35.091515] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-09-15T18:50:35.091565] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-09-15T18:50:35.092125] [DEBUG] [LOCAL ] HPI: Trimmed 10181 records to 7603 (keeping 150 days of data) [2025-09-15T18:50:35.144496] [DEBUG] [LOCAL ] HPI: Primary data saved (7603 records). [2025-09-15T18:50:35.144781] [INFO ] [MAIN ] HPI: Full history saved. [2025-09-15T18:50:35.144920] [INFO ] [MAIN ] Update Progress: 1044/2369 symbols completed. HPI took 15.3s. Estimated remaining: 2h 20m 17s. Rate: 9.4 symbols/min [2025-09-15T18:50:35.320396] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:50:35.331043] [DEBUG] [LOCAL ] HPS: Loaded 7697 existing records from primary storage. [2025-09-15T18:50:35.331220] [INFO ] [MAIN ] HPS: Loaded 7697 existing records. [2025-09-15T18:50:35.521062] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:50:35.521477] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-09-15T18:50:35.521533] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-09-15T18:50:35.521959] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-09-15T18:50:35.522019] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-09-15T18:50:35.666912] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-09-15T18:50:35.886769] [INFO ] [REMOTE ] HPS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:50:36.378144] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T18:50:36.457899] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-09-15T18:50:37.257857] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-09-15T18:50:37.485173] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-15T18:50:37.640894] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-15T18:50:38.057881] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-09-15T18:50:38.582561] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-15T18:50:38.857875] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-09-15T18:50:39.657923] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-09-15T18:50:39.981382] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-15T18:50:40.420980] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T18:50:40.438346] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-15T18:50:40.457839] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-09-15T18:50:41.257890] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-09-15T18:50:41.999054] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-15T18:50:42.057864] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-09-15T18:50:42.857898] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-09-15T18:50:43.165634] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-15T18:50:43.309847] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-15T18:50:43.576839] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-15T18:50:43.657829] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-09-15T18:50:44.457902] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-09-15T18:50:45.261715] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-09-15T18:50:45.273171] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-15T18:50:45.859302] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-15T18:50:46.057947] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-09-15T18:50:46.837032] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-15T18:50:46.843451] [INFO ] [REMOTE ] HP: Full fetch complete (56271 records). [2025-09-15T18:50:46.843719] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-09-15T18:50:46.868185] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-09-15T18:50:47.264497] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-09-15T18:50:47.264629] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-09-15T18:50:47.265472] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-09-15T18:50:47.265536] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-09-15T18:50:47.281485] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-15T18:50:47.287466] [DEBUG] [LOCAL ] HP: Trimmed 56271 records to 38311 (keeping 150 days of data) [2025-09-15T18:50:47.287594] [INFO ] [REMOTE ] HPP: Full fetch complete (54547 records). [2025-09-15T18:50:47.288200] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-09-15T18:50:47.289340] [FATAL] [VALIDATOR ] HPP: Data is stale - most recent date (2025-09-12) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:50:47.289427] [FATAL] [MAIN ] HPP: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:50:47.289488] [WARN ] [MAIN ] HPP: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:50:47.289531] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-09-15T18:50:47.289593] [DEBUG] [LOCAL ] HPP: No primary data file found to delete. [2025-09-15T18:50:47.289664] [INFO ] [LOCAL ] HPP: Starting deletion of derivative data. [2025-09-15T18:50:47.290061] [DEBUG] [LOCAL ] HPP: Deleted derivative data file. [2025-09-15T18:50:47.291095] [INFO ] [MAIN ] Update Progress: 1045/2369 symbols completed. HPP took 22.4s. Estimated remaining: 2h 20m 18s. Rate: 9.4 symbols/min [2025-09-15T18:50:47.574455] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:50:47.607325] [DEBUG] [LOCAL ] HQH: Loaded 18918 existing records from primary storage. [2025-09-15T18:50:47.608098] [INFO ] [MAIN ] HQH: Loaded 18918 existing records. [2025-09-15T18:50:47.666568] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-09-15T18:50:47.802901] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:50:47.803748] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-09-15T18:50:47.804112] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-09-15T18:50:47.805212] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-09-15T18:50:47.805553] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-09-15T18:50:48.267755] [INFO ] [REMOTE ] HQH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:50:48.290436] [DEBUG] [LOCAL ] HP: Primary data saved (38311 records). [2025-09-15T18:50:48.290591] [INFO ] [MAIN ] HP: Full history saved. [2025-09-15T18:50:48.290722] [INFO ] [MAIN ] Update Progress: 1046/2369 symbols completed. HP took 43.3s. Estimated remaining: 2h 20m 5s. Rate: 9.4 symbols/min [2025-09-15T18:50:48.459241] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:50:48.459328] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-09-15T18:50:48.467085] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-15T18:50:48.479704] [DEBUG] [LOCAL ] HQL: Loaded 11831 existing records from primary storage. [2025-09-15T18:50:48.479820] [INFO ] [MAIN ] HQL: Loaded 11831 existing records. [2025-09-15T18:50:48.655717] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:50:48.656117] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-09-15T18:50:48.656202] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-09-15T18:50:48.656573] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-09-15T18:50:48.656622] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-09-15T18:50:48.980066] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-15T18:50:49.057789] [INFO ] [REMOTE ] HQL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:50:49.257912] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-09-15T18:50:49.458963] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-15T18:50:50.057937] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-09-15T18:50:50.657220] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-15T18:50:50.857876] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-09-15T18:50:50.986708] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-15T18:50:51.657885] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-09-15T18:50:51.798052] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T18:50:52.322353] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-15T18:50:52.457850] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-09-15T18:50:52.913727] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-15T18:50:53.257869] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-09-15T18:50:53.973838] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-15T18:50:53.975483] [INFO ] [REMOTE ] HPS: Full fetch complete (11403 records). [2025-09-15T18:50:53.975579] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-09-15T18:50:54.062998] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-09-15T18:50:54.368954] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-09-15T18:50:54.369032] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-09-15T18:50:54.369328] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-09-15T18:50:54.369368] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-09-15T18:50:54.369853] [DEBUG] [LOCAL ] HPS: Trimmed 11403 records to 7654 (keeping 150 days of data) [2025-09-15T18:50:54.416396] [DEBUG] [LOCAL ] HPS: Primary data saved (7654 records). [2025-09-15T18:50:54.416510] [INFO ] [MAIN ] HPS: Full history saved. [2025-09-15T18:50:54.416591] [INFO ] [MAIN ] Update Progress: 1047/2369 symbols completed. HPS took 19.3s. Estimated remaining: 2h 19m 58s. Rate: 9.4 symbols/min [2025-09-15T18:50:54.583447] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:50:54.622848] [DEBUG] [LOCAL ] HR: Loaded 39162 existing records from primary storage. [2025-09-15T18:50:54.622992] [INFO ] [MAIN ] HR: Loaded 39162 existing records. [2025-09-15T18:50:54.802679] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:50:54.802933] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-09-15T18:50:54.802979] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-09-15T18:50:54.803890] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-09-15T18:50:54.803991] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-09-15T18:50:54.864849] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-09-15T18:50:54.918949] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-15T18:50:55.181887] [INFO ] [REMOTE ] HR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:50:55.657899] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-09-15T18:50:56.457911] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-09-15T18:50:56.568064] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-15T18:50:56.574345] [INFO ] [REMOTE ] HPQ: Full fetch complete (58348 records). [2025-09-15T18:50:56.574490] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-09-15T18:50:56.903947] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-15T18:50:56.985255] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-09-15T18:50:56.985343] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-09-15T18:50:56.986193] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-09-15T18:50:56.986243] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-09-15T18:50:56.987625] [DEBUG] [LOCAL ] HPQ: Trimmed 58348 records to 39632 (keeping 150 days of data) [2025-09-15T18:50:57.192917] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-15T18:50:57.256385] [DEBUG] [LOCAL ] HPQ: Primary data saved (39632 records). [2025-09-15T18:50:57.256525] [INFO ] [MAIN ] HPQ: Full history saved. [2025-09-15T18:50:57.258318] [INFO ] [MAIN ] Update Progress: 1048/2369 symbols completed. HPQ took 26.2s. Estimated remaining: 2h 19m 47s. Rate: 9.5 symbols/min [2025-09-15T18:50:57.258371] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-09-15T18:50:57.435730] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:50:57.475093] [DEBUG] [LOCAL ] HRB: Loaded 36481 existing records from primary storage. [2025-09-15T18:50:57.475274] [INFO ] [MAIN ] HRB: Loaded 36481 existing records. [2025-09-15T18:50:57.655607] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:50:57.655890] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-09-15T18:50:57.655940] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-09-15T18:50:57.656632] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-09-15T18:50:57.656734] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-09-15T18:50:58.017267] [INFO ] [REMOTE ] HRB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:50:58.057858] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-09-15T18:50:58.307370] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-15T18:50:58.857870] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-09-15T18:50:59.489529] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-15T18:50:59.657869] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-09-15T18:50:59.733788] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-15T18:51:00.457921] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-09-15T18:51:00.964611] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T18:51:01.257896] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-09-15T18:51:02.057944] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-09-15T18:51:02.108315] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T18:51:02.857887] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-09-15T18:51:03.581422] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-15T18:51:03.657828] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-09-15T18:51:03.847108] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-15T18:51:04.457925] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-09-15T18:51:05.071720] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-15T18:51:05.257893] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-09-15T18:51:05.451089] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (3.39 seconds). [2025-09-15T18:51:05.607738] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-15T18:51:06.057915] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-09-15T18:51:06.515922] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-15T18:51:06.858064] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-09-15T18:51:06.857966] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-15T18:51:07.657934] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-09-15T18:51:07.823795] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-15T18:51:08.457907] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-09-15T18:51:09.218044] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T18:51:09.257886] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-09-15T18:51:09.645008] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-15T18:51:10.057919] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-09-15T18:51:10.473817] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T18:51:10.857890] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-09-15T18:51:11.405128] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T18:51:11.657831] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-09-15T18:51:11.815306] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T18:51:12.457920] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-09-15T18:51:13.257877] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-09-15T18:51:13.735589] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-15T18:51:13.769030] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-15T18:51:13.773028] [INFO ] [REMOTE ] HQH: Full fetch complete (27214 records). [2025-09-15T18:51:13.773167] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-09-15T18:51:14.065696] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-09-15T18:51:14.157748] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-09-15T18:51:14.157834] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-09-15T18:51:14.158469] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-09-15T18:51:14.158520] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-09-15T18:51:14.159748] [DEBUG] [LOCAL ] HQH: Trimmed 27214 records to 18689 (keeping 150 days of data) [2025-09-15T18:51:14.277906] [DEBUG] [LOCAL ] HQH: Primary data saved (18689 records). [2025-09-15T18:51:14.278062] [INFO ] [MAIN ] HQH: Full history saved. [2025-09-15T18:51:14.278172] [INFO ] [MAIN ] Update Progress: 1049/2369 symbols completed. HQH took 27.0s. Estimated remaining: 2h 19m 54s. Rate: 9.4 symbols/min [2025-09-15T18:51:14.454440] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:51:14.484518] [DEBUG] [LOCAL ] HRI: Loaded 24307 existing records from primary storage. [2025-09-15T18:51:14.484730] [INFO ] [MAIN ] HRI: Loaded 24307 existing records. [2025-09-15T18:51:14.663109] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:51:14.663388] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-09-15T18:51:14.663435] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-09-15T18:51:14.664136] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-09-15T18:51:14.664193] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-09-15T18:51:14.881285] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-09-15T18:51:15.033738] [INFO ] [REMOTE ] HRI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:51:15.234303] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-15T18:51:15.236418] [INFO ] [REMOTE ] HQL: Full fetch complete (17889 records). [2025-09-15T18:51:15.236497] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-09-15T18:51:15.604276] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-09-15T18:51:15.604360] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-09-15T18:51:15.604770] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-09-15T18:51:15.604814] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-09-15T18:51:15.605437] [DEBUG] [LOCAL ] HQL: Trimmed 17889 records to 11683 (keeping 150 days of data) [2025-09-15T18:51:15.665101] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-09-15T18:51:15.688530] [DEBUG] [LOCAL ] HQL: Primary data saved (11683 records). [2025-09-15T18:51:15.688717] [INFO ] [MAIN ] HQL: Full history saved. [2025-09-15T18:51:15.688863] [INFO ] [MAIN ] Update Progress: 1050/2369 symbols completed. HQL took 27.4s. Estimated remaining: 2h 19m 42s. Rate: 9.4 symbols/min [2025-09-15T18:51:15.873232] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:51:15.923488] [DEBUG] [LOCAL ] HRL: Loaded 39940 existing records from primary storage. [2025-09-15T18:51:15.923724] [INFO ] [MAIN ] HRL: Loaded 39940 existing records. [2025-09-15T18:51:16.108845] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:51:16.109189] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-09-15T18:51:16.109239] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-09-15T18:51:16.110111] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-09-15T18:51:16.110176] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-09-15T18:51:16.494249] [INFO ] [REMOTE ] HRL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:51:16.494745] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-09-15T18:51:16.530554] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-15T18:51:16.658694] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-15T18:51:16.713662] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-15T18:51:17.257879] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-09-15T18:51:17.812890] [DEBUG] [REMOTE ] HRL: Error fetching primary data for 2025-02: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-09-15T18:51:17.813052] [WARN ] [REMOTE ] HRL: No data returned for month 2025-02 [2025-09-15T18:51:18.057901] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-09-15T18:51:18.426067] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-15T18:51:18.432410] [INFO ] [REMOTE ] HRB: Full fetch complete (52876 records). [2025-09-15T18:51:18.432541] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-09-15T18:51:18.825327] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-09-15T18:51:18.825414] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-09-15T18:51:18.826320] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-09-15T18:51:18.826390] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-09-15T18:51:18.828228] [DEBUG] [LOCAL ] HRB: Trimmed 52876 records to 35716 (keeping 150 days of data) [2025-09-15T18:51:18.892632] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-09-15T18:51:19.066823] [DEBUG] [LOCAL ] HRB: Primary data saved (35716 records). [2025-09-15T18:51:19.066975] [INFO ] [MAIN ] HRB: Full history saved. [2025-09-15T18:51:19.068154] [INFO ] [MAIN ] Update Progress: 1051/2369 symbols completed. HRB took 21.8s. Estimated remaining: 2h 19m 32s. Rate: 9.4 symbols/min [2025-09-15T18:51:19.243455] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:51:19.272633] [DEBUG] [LOCAL ] HRTG: Loaded 25534 existing records from primary storage. [2025-09-15T18:51:19.272789] [INFO ] [MAIN ] HRTG: Loaded 25534 existing records. [2025-09-15T18:51:19.461269] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:51:19.461771] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-09-15T18:51:19.461919] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-09-15T18:51:19.462554] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-09-15T18:51:19.462603] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-09-15T18:51:19.665349] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-09-15T18:51:19.741494] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T18:51:19.854006] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:51:20.457905] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-09-15T18:51:20.550860] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-15T18:51:21.257877] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-09-15T18:51:21.462260] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-15T18:51:21.534592] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-15T18:51:22.057883] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-09-15T18:51:22.156261] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-15T18:51:22.857894] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-09-15T18:51:23.291802] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-15T18:51:23.657884] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-09-15T18:51:23.700552] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-15T18:51:24.457892] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-09-15T18:51:24.545414] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-15T18:51:25.257870] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-09-15T18:51:26.057894] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-09-15T18:51:26.204935] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-15T18:51:26.368545] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-15T18:51:26.857886] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-09-15T18:51:27.662986] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-09-15T18:51:27.686853] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-15T18:51:28.325743] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T18:51:28.332988] [INFO ] [REMOTE ] HR: Full fetch complete (56347 records). [2025-09-15T18:51:28.333116] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-09-15T18:51:28.462982] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-09-15T18:51:28.715332] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-09-15T18:51:28.715488] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-09-15T18:51:28.716287] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-09-15T18:51:28.716344] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-09-15T18:51:28.717690] [DEBUG] [LOCAL ] HR: Trimmed 56347 records to 38391 (keeping 150 days of data) [2025-09-15T18:51:28.865160] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-15T18:51:29.003191] [DEBUG] [LOCAL ] HR: Primary data saved (38391 records). [2025-09-15T18:51:29.003348] [INFO ] [MAIN ] HR: Full history saved. [2025-09-15T18:51:29.003449] [INFO ] [MAIN ] Update Progress: 1052/2369 symbols completed. HR took 34.6s. Estimated remaining: 2h 19m 30s. Rate: 9.4 symbols/min [2025-09-15T18:51:29.225910] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:51:29.265175] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-09-15T18:51:29.268114] [DEBUG] [LOCAL ] HSBC: Loaded 38237 existing records from primary storage. [2025-09-15T18:51:29.268347] [INFO ] [MAIN ] HSBC: Loaded 38237 existing records. [2025-09-15T18:51:29.454038] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:51:29.454303] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-09-15T18:51:29.454355] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-09-15T18:51:29.455179] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-09-15T18:51:29.455234] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-09-15T18:51:29.827552] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:51:30.057880] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-09-15T18:51:30.211833] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-15T18:51:30.215285] [INFO ] [REMOTE ] HRI: Full fetch complete (36667 records). [2025-09-15T18:51:30.215358] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-09-15T18:51:30.586124] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-09-15T18:51:30.586202] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-09-15T18:51:30.586861] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-09-15T18:51:30.586905] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-09-15T18:51:30.587954] [DEBUG] [LOCAL ] HRI: Trimmed 36667 records to 23844 (keeping 150 days of data) [2025-09-15T18:51:30.722836] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-15T18:51:30.787162] [DEBUG] [LOCAL ] HRI: Primary data saved (23844 records). [2025-09-15T18:51:30.787307] [INFO ] [MAIN ] HRI: Full history saved. [2025-09-15T18:51:30.787432] [INFO ] [MAIN ] Update Progress: 1053/2369 symbols completed. HRI took 16.5s. Estimated remaining: 2h 19m 18s. Rate: 9.4 symbols/min [2025-09-15T18:51:30.863000] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-09-15T18:51:30.962301] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:51:30.975349] [DEBUG] [LOCAL ] HSHP: Loaded 10277 existing records from primary storage. [2025-09-15T18:51:30.975519] [INFO ] [MAIN ] HSHP: Loaded 10277 existing records. [2025-09-15T18:51:31.157358] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:51:31.157677] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-09-15T18:51:31.157726] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-09-15T18:51:31.158108] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-09-15T18:51:31.158154] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-09-15T18:51:31.507508] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:51:31.668600] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-09-15T18:51:31.671446] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-15T18:51:32.457877] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-09-15T18:51:32.638739] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-15T18:51:32.696877] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-15T18:51:33.257883] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-09-15T18:51:34.057862] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-09-15T18:51:34.312943] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-15T18:51:34.390417] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-15T18:51:34.857862] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-09-15T18:51:35.533842] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T18:51:35.657876] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-09-15T18:51:36.408009] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T18:51:36.457826] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-09-15T18:51:37.257849] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-09-15T18:51:37.334288] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T18:51:37.781816] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T18:51:37.829496] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-15T18:51:38.057893] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-09-15T18:51:38.857927] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-09-15T18:51:39.050280] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-15T18:51:39.657888] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-09-15T18:51:40.457894] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-09-15T18:51:40.810342] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-15T18:51:40.816726] [INFO ] [REMOTE ] HRL: Full fetch complete (52309 records). [2025-09-15T18:51:40.816958] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-09-15T18:51:41.015092] [WARN ] [VALIDATOR ] HRL: Validation failed - insufficient historical data. Have 136 unique days, need 150 days [2025-09-15T18:51:41.015890] [FATAL] [MAIN ] HRL: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:51:41.025349] [WARN ] [MAIN ] HRL: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:51:41.038420] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-09-15T18:51:41.041235] [DEBUG] [LOCAL ] HRL: No primary data file found to delete. [2025-09-15T18:51:41.041298] [INFO ] [LOCAL ] HRL: Starting deletion of derivative data. [2025-09-15T18:51:41.042900] [DEBUG] [LOCAL ] HRL: Deleted derivative data file. [2025-09-15T18:51:41.042833] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-15T18:51:41.043926] [INFO ] [MAIN ] Update Progress: 1054/2369 symbols completed. HRL took 25.4s. Estimated remaining: 2h 19m 16s. Rate: 9.4 symbols/min [2025-09-15T18:51:41.232417] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:51:41.259869] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-09-15T18:51:41.277834] [DEBUG] [LOCAL ] HSY: Loaded 38032 existing records from primary storage. [2025-09-15T18:51:41.277989] [INFO ] [MAIN ] HSY: Loaded 38032 existing records. [2025-09-15T18:51:41.457986] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:51:41.458341] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-09-15T18:51:41.458504] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-09-15T18:51:41.459451] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-09-15T18:51:41.459507] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-09-15T18:51:41.648461] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T18:51:41.871528] [INFO ] [REMOTE ] HSY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:51:42.057881] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-09-15T18:51:42.206170] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-15T18:51:42.857886] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-09-15T18:51:43.426765] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-15T18:51:43.450398] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-15T18:51:43.657868] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-09-15T18:51:44.457875] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-09-15T18:51:44.698732] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-15T18:51:45.257918] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-09-15T18:51:45.890623] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-15T18:51:45.993568] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-15T18:51:46.057839] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-09-15T18:51:46.857874] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-09-15T18:51:47.013611] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-15T18:51:47.657880] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-09-15T18:51:48.214842] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-15T18:51:48.344977] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T18:51:48.457846] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-09-15T18:51:49.182420] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-15T18:51:49.184460] [INFO ] [REMOTE ] HSHP: Full fetch complete (17510 records). [2025-09-15T18:51:49.184546] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-09-15T18:51:49.262999] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-09-15T18:51:49.560082] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-09-15T18:51:49.560166] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-09-15T18:51:49.560613] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-09-15T18:51:49.560688] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-09-15T18:51:49.561290] [DEBUG] [LOCAL ] HSHP: Trimmed 17510 records to 10106 (keeping 150 days of data) [2025-09-15T18:51:49.620655] [DEBUG] [LOCAL ] HSHP: Primary data saved (10106 records). [2025-09-15T18:51:49.620810] [INFO ] [MAIN ] HSHP: Full history saved. [2025-09-15T18:51:49.620901] [INFO ] [MAIN ] Update Progress: 1055/2369 symbols completed. HSHP took 18.8s. Estimated remaining: 2h 19m 13s. Rate: 9.4 symbols/min [2025-09-15T18:51:49.789631] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:51:49.789843] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-09-15T18:51:49.789882] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-09-15T18:51:49.790006] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-09-15T18:51:49.790048] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-15T18:51:49.790112] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-15T18:51:49.790148] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-09-15T18:51:50.063122] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-09-15T18:51:50.142309] [INFO ] [REMOTE ] HTB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:51:50.565226] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-15T18:51:50.568624] [INFO ] [REMOTE ] HRTG: Full fetch complete (33724 records). [2025-09-15T18:51:50.568722] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-09-15T18:51:50.863047] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-09-15T18:51:50.934829] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-09-15T18:51:50.935000] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-09-15T18:51:50.935604] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-09-15T18:51:50.935664] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-09-15T18:51:50.936495] [DEBUG] [LOCAL ] HRTG: Trimmed 33724 records to 25072 (keeping 150 days of data) [2025-09-15T18:51:51.090438] [DEBUG] [LOCAL ] HRTG: Primary data saved (25072 records). [2025-09-15T18:51:51.090576] [INFO ] [MAIN ] HRTG: Full history saved. [2025-09-15T18:51:51.090677] [INFO ] [MAIN ] Update Progress: 1056/2369 symbols completed. HRTG took 32.0s. Estimated remaining: 2h 19m 0s. Rate: 9.4 symbols/min [2025-09-15T18:51:51.259662] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:51:51.270131] [DEBUG] [LOCAL ] HTD: Loaded 9986 existing records from primary storage. [2025-09-15T18:51:51.270234] [INFO ] [MAIN ] HTD: Loaded 9986 existing records. [2025-09-15T18:51:51.446074] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:51:51.446314] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-09-15T18:51:51.446359] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-09-15T18:51:51.446787] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-09-15T18:51:51.446839] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-09-15T18:51:51.662950] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-02. [2025-09-15T18:51:51.809011] [INFO ] [REMOTE ] HTD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:51:51.881615] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-15T18:51:51.905609] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-09-15T18:51:52.457881] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-09-15T18:51:52.579941] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-15T18:51:53.257850] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-09-15T18:51:53.436472] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-15T18:51:54.057923] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-09-15T18:51:54.664074] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T18:51:54.669539] [INFO ] [REMOTE ] HSBC: Full fetch complete (55790 records). [2025-09-15T18:51:54.669666] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-09-15T18:51:54.863065] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-03. [2025-09-15T18:51:55.066870] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-09-15T18:51:55.067277] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-09-15T18:51:55.067208] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-15T18:51:55.068230] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-09-15T18:51:55.071460] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-09-15T18:51:55.072920] [DEBUG] [LOCAL ] HSBC: Trimmed 55790 records to 37442 (keeping 150 days of data) [2025-09-15T18:51:55.306402] [DEBUG] [LOCAL ] HSBC: Primary data saved (37442 records). [2025-09-15T18:51:55.306578] [INFO ] [MAIN ] HSBC: Full history saved. [2025-09-15T18:51:55.306714] [INFO ] [MAIN ] Update Progress: 1057/2369 symbols completed. HSBC took 26.3s. Estimated remaining: 2h 18m 51s. Rate: 9.4 symbols/min [2025-09-15T18:51:55.476813] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:51:55.477006] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-09-15T18:51:55.477045] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-09-15T18:51:55.477162] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-09-15T18:51:55.477202] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-15T18:51:55.477242] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-15T18:51:55.477274] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-09-15T18:51:55.663273] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-09-15T18:51:55.826498] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-15T18:51:55.846423] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:51:56.457848] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-09-15T18:51:56.525369] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-15T18:51:57.257877] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-04. [2025-09-15T18:51:57.999466] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-15T18:51:58.029104] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T18:51:58.057814] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-09-15T18:51:58.857873] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-09-15T18:51:59.625329] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-15T18:51:59.657880] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-09-15T18:51:59.843823] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-15T18:52:00.281071] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-15T18:52:00.457882] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-09-15T18:52:01.075788] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-15T18:52:01.257919] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-09-15T18:52:02.057924] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-09-15T18:52:02.770544] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-15T18:52:02.857836] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-09-15T18:52:02.957864] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-15T18:52:03.432497] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-15T18:52:03.437541] [INFO ] [REMOTE ] HTD: Full fetch complete (14194 records). [2025-09-15T18:52:03.437636] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-09-15T18:52:03.666836] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-05. [2025-09-15T18:52:03.794486] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-09-15T18:52:03.794563] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-09-15T18:52:03.794907] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-09-15T18:52:03.794954] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-09-15T18:52:03.795444] [DEBUG] [LOCAL ] HTD: Trimmed 14194 records to 9858 (keeping 150 days of data) [2025-09-15T18:52:03.858888] [DEBUG] [LOCAL ] HTD: Primary data saved (9858 records). [2025-09-15T18:52:03.859029] [INFO ] [MAIN ] HTD: Full history saved. [2025-09-15T18:52:03.859125] [INFO ] [MAIN ] Update Progress: 1058/2369 symbols completed. HTD took 12.8s. Estimated remaining: 2h 18m 48s. Rate: 9.4 symbols/min [2025-09-15T18:52:04.026930] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:52:04.065331] [DEBUG] [LOCAL ] HTGC: Loaded 35510 existing records from primary storage. [2025-09-15T18:52:04.065471] [INFO ] [MAIN ] HTGC: Loaded 35510 existing records. [2025-09-15T18:52:04.252312] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:52:04.252884] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-09-15T18:52:04.252937] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-09-15T18:52:04.254113] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-09-15T18:52:04.254170] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-09-15T18:52:04.463066] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-09-15T18:52:04.553814] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-15T18:52:04.640473] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:52:05.257880] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-06. [2025-09-15T18:52:05.941526] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-15T18:52:06.057913] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-09-15T18:52:06.200267] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-15T18:52:06.857892] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-07. [2025-09-15T18:52:07.354810] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-15T18:52:07.636344] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-15T18:52:07.657826] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-09-15T18:52:08.457949] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-09-15T18:52:08.939808] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T18:52:09.257883] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-09-15T18:52:09.988528] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-15T18:52:10.057894] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-08. [2025-09-15T18:52:10.570499] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-15T18:52:10.784727] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T18:52:10.857947] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-09-15T18:52:11.657909] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-09-15T18:52:12.242279] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T18:52:12.457892] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-09-15T18:52:13.190475] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T18:52:13.195979] [INFO ] [REMOTE ] HSY: Full fetch complete (55094 records). [2025-09-15T18:52:13.196106] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-09-15T18:52:13.263076] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-09. [2025-09-15T18:52:13.598217] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-09-15T18:52:13.598314] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-09-15T18:52:13.599095] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-09-15T18:52:13.599139] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-09-15T18:52:13.600535] [DEBUG] [LOCAL ] HSY: Trimmed 55094 records to 37273 (keeping 150 days of data) [2025-09-15T18:52:13.844043] [DEBUG] [LOCAL ] HSY: Primary data saved (37273 records). [2025-09-15T18:52:13.844190] [INFO ] [MAIN ] HSY: Full history saved. [2025-09-15T18:52:13.844839] [INFO ] [MAIN ] Update Progress: 1059/2369 symbols completed. HSY took 32.8s. Estimated remaining: 2h 18m 46s. Rate: 9.4 symbols/min [2025-09-15T18:52:14.019732] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:52:14.046575] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-15T18:52:14.048515] [INFO ] [REMOTE ] HTB: Full fetch complete (6939 records). [2025-09-15T18:52:14.048746] [DEBUG] [VALIDATOR ] HTB: Validating primary data. [2025-09-15T18:52:14.070117] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-09-15T18:52:14.186286] [DEBUG] [LOCAL ] HTH: Loaded 25401 existing records from primary storage. [2025-09-15T18:52:14.190669] [INFO ] [MAIN ] HTH: Loaded 25401 existing records. [2025-09-15T18:52:14.190504] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-15T18:52:14.397483] [WARN ] [VALIDATOR ] HTB: Validation failed - insufficient historical data. Have 137 unique days, need 150 days [2025-09-15T18:52:14.431375] [FATAL] [MAIN ] HTB: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:52:14.445059] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:52:14.461247] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-15T18:52:14.461357] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-15T18:52:14.462485] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-09-15T18:52:14.466008] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-09-15T18:52:14.466162] [INFO ] [MAIN ] Update Progress: 1060/2369 symbols completed. HTB took 24.8s. Estimated remaining: 2h 18m 32s. Rate: 9.4 symbols/min [2025-09-15T18:52:14.465940] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:52:14.516902] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-15T18:52:14.516776] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-09-15T18:52:14.547744] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-09-15T18:52:14.583303] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-09-15T18:52:14.603976] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-09-15T18:52:14.755534] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:52:14.863000] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-09-15T18:52:15.024538] [INFO ] [REMOTE ] HTH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:52:15.035449] [DEBUG] [LOCAL ] HUBB: Loaded 27177 existing records from primary storage. [2025-09-15T18:52:15.035612] [INFO ] [MAIN ] HUBB: Loaded 27177 existing records. [2025-09-15T18:52:15.222936] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:52:15.223200] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-09-15T18:52:15.223255] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-09-15T18:52:15.224114] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-09-15T18:52:15.224166] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-09-15T18:52:15.577030] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:52:15.657881] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-09-15T18:52:16.457842] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-09-15T18:52:16.530867] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-15T18:52:16.826515] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-15T18:52:17.257869] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-09-15T18:52:17.790219] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-15T18:52:18.057948] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-09-15T18:52:18.337977] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-15T18:52:18.582676] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-15T18:52:18.857916] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-09-15T18:52:19.182492] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-15T18:52:19.657877] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-09-15T18:52:20.457901] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-09-15T18:52:20.972058] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T18:52:21.257953] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-09-15T18:52:21.905059] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T18:52:22.057883] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-09-15T18:52:22.434436] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-15T18:52:22.857879] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-09-15T18:52:23.165079] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-15T18:52:23.444190] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-15T18:52:23.657913] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-09-15T18:52:24.457891] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-09-15T18:52:24.755509] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-15T18:52:24.939801] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T18:52:25.257928] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-09-15T18:52:26.057868] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-09-15T18:52:26.291123] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-15T18:52:26.857867] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-09-15T18:52:27.077520] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-09-15T18:52:27.518363] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T18:52:27.523356] [INFO ] [REMOTE ] HTGC: Full fetch complete (51769 records). [2025-09-15T18:52:27.523467] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-09-15T18:52:27.663317] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-09-15T18:52:27.903100] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-09-15T18:52:27.903188] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-09-15T18:52:27.903937] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-09-15T18:52:27.903982] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-09-15T18:52:27.905134] [DEBUG] [LOCAL ] HTGC: Trimmed 51769 records to 34840 (keeping 150 days of data) [2025-09-15T18:52:28.006108] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-15T18:52:28.131524] [DEBUG] [LOCAL ] HTGC: Primary data saved (34840 records). [2025-09-15T18:52:28.131692] [INFO ] [MAIN ] HTGC: Full history saved. [2025-09-15T18:52:28.131801] [INFO ] [MAIN ] Update Progress: 1061/2369 symbols completed. HTGC took 24.3s. Estimated remaining: 2h 18m 35s. Rate: 9.4 symbols/min [2025-09-15T18:52:28.304080] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:52:28.335693] [DEBUG] [LOCAL ] HUBS: Loaded 29603 existing records from primary storage. [2025-09-15T18:52:28.335834] [INFO ] [MAIN ] HUBS: Loaded 29603 existing records. [2025-09-15T18:52:28.473394] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-09-15T18:52:28.511211] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:52:28.511410] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-09-15T18:52:28.511457] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-09-15T18:52:28.512117] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-09-15T18:52:28.512169] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-09-15T18:52:28.888700] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:52:28.951871] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-15T18:52:28.952467] [INFO ] [REMOTE ] HTFC: Full fetch complete (627 records). [2025-09-15T18:52:28.952533] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-09-15T18:52:29.141981] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 139 unique days, need 150 days [2025-09-15T18:52:29.142203] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:52:29.142250] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:52:29.142309] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-15T18:52:29.142387] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-15T18:52:29.142429] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-09-15T18:52:29.142487] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-09-15T18:52:29.142594] [INFO ] [MAIN ] Update Progress: 1062/2369 symbols completed. HTFC took 33.8s. Estimated remaining: 2h 18m 22s. Rate: 9.4 symbols/min [2025-09-15T18:52:29.262958] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-09-15T18:52:29.321233] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:52:29.357990] [DEBUG] [LOCAL ] HUM: Loaded 36925 existing records from primary storage. [2025-09-15T18:52:29.358144] [INFO ] [MAIN ] HUM: Loaded 36925 existing records. [2025-09-15T18:52:29.542072] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:52:29.542346] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-09-15T18:52:29.542396] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-09-15T18:52:29.543393] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-09-15T18:52:29.543458] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-09-15T18:52:29.919327] [INFO ] [REMOTE ] HUM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:52:30.057878] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-09-15T18:52:30.467262] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-15T18:52:30.857898] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-09-15T18:52:31.400269] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-15T18:52:31.657954] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-09-15T18:52:31.797823] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-15T18:52:32.457905] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-09-15T18:52:33.088715] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-15T18:52:33.257864] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-09-15T18:52:33.865217] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-15T18:52:34.057866] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-09-15T18:52:34.853154] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-15T18:52:34.859068] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-09-15T18:52:34.932991] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T18:52:35.657853] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-09-15T18:52:36.126095] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-15T18:52:36.457881] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-09-15T18:52:36.788176] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-15T18:52:36.792288] [INFO ] [REMOTE ] HUBB: Full fetch complete (41339 records). [2025-09-15T18:52:36.792393] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-09-15T18:52:37.165207] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-09-15T18:52:37.165295] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-09-15T18:52:37.165961] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-09-15T18:52:37.166007] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-09-15T18:52:37.166910] [DEBUG] [LOCAL ] HUBB: Trimmed 41339 records to 26654 (keeping 150 days of data) [2025-09-15T18:52:37.263166] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-09-15T18:52:37.342453] [DEBUG] [LOCAL ] HUBB: Primary data saved (26654 records). [2025-09-15T18:52:37.342590] [INFO ] [MAIN ] HUBB: Full history saved. [2025-09-15T18:52:37.342715] [INFO ] [MAIN ] Update Progress: 1063/2369 symbols completed. HUBB took 22.9s. Estimated remaining: 2h 18m 18s. Rate: 9.4 symbols/min [2025-09-15T18:52:37.512618] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:52:37.551625] [DEBUG] [LOCAL ] HUN: Loaded 40015 existing records from primary storage. [2025-09-15T18:52:37.551785] [INFO ] [MAIN ] HUN: Loaded 40015 existing records. [2025-09-15T18:52:37.728256] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:52:37.728480] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-09-15T18:52:37.728526] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-09-15T18:52:37.729394] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-09-15T18:52:37.729445] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-09-15T18:52:38.081666] [INFO ] [REMOTE ] HUN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:52:38.076821] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-09-15T18:52:38.112471] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T18:52:38.733432] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T18:52:38.857867] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-09-15T18:52:39.081901] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T18:52:39.657932] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-09-15T18:52:40.148865] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-15T18:52:40.457863] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-09-15T18:52:41.257887] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-09-15T18:52:41.575198] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-15T18:52:41.659828] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-15T18:52:42.057886] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-09-15T18:52:42.478883] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-15T18:52:42.857927] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-09-15T18:52:43.508680] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-15T18:52:43.657908] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-09-15T18:52:44.236547] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-15T18:52:44.457906] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-09-15T18:52:45.257874] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-09-15T18:52:45.430427] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T18:52:45.579471] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-15T18:52:45.583406] [INFO ] [REMOTE ] HTH: Full fetch complete (36514 records). [2025-09-15T18:52:45.583480] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-09-15T18:52:45.952191] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-09-15T18:52:45.952270] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-09-15T18:52:45.952926] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-09-15T18:52:45.952978] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-09-15T18:52:45.953813] [DEBUG] [LOCAL ] HTH: Trimmed 36514 records to 24977 (keeping 150 days of data) [2025-09-15T18:52:46.057908] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-09-15T18:52:46.108961] [DEBUG] [LOCAL ] HTH: Primary data saved (24977 records). [2025-09-15T18:52:46.109108] [INFO ] [MAIN ] HTH: Full history saved. [2025-09-15T18:52:46.109194] [INFO ] [MAIN ] Update Progress: 1064/2369 symbols completed. HTH took 32.3s. Estimated remaining: 2h 18m 15s. Rate: 9.4 symbols/min [2025-09-15T18:52:46.276371] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:52:46.309456] [DEBUG] [LOCAL ] HUYA: Loaded 32446 existing records from primary storage. [2025-09-15T18:52:46.309601] [INFO ] [MAIN ] HUYA: Loaded 32446 existing records. [2025-09-15T18:52:46.490861] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:52:46.491304] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-09-15T18:52:46.491373] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-09-15T18:52:46.492680] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-09-15T18:52:46.492736] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-09-15T18:52:46.804640] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T18:52:46.884433] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:52:46.861852] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-09-15T18:52:47.657877] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-09-15T18:52:47.807610] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-15T18:52:48.457861] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-09-15T18:52:48.543430] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-15T18:52:49.106288] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-15T18:52:49.257869] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-09-15T18:52:49.860794] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T18:52:50.057884] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-09-15T18:52:50.840824] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-15T18:52:50.857832] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-09-15T18:52:51.301175] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-15T18:52:51.657877] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-09-15T18:52:52.087118] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T18:52:52.457892] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-09-15T18:52:53.103345] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-15T18:52:53.257891] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-09-15T18:52:54.010859] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-15T18:52:54.015475] [INFO ] [REMOTE ] HUBS: Full fetch complete (43329 records). [2025-09-15T18:52:54.015585] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-09-15T18:52:54.070099] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-09-15T18:52:54.392395] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-09-15T18:52:54.392490] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-09-15T18:52:54.393255] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-09-15T18:52:54.393305] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-09-15T18:52:54.394387] [DEBUG] [LOCAL ] HUBS: Trimmed 43329 records to 28996 (keeping 150 days of data) [2025-09-15T18:52:54.580152] [DEBUG] [LOCAL ] HUBS: Primary data saved (28996 records). [2025-09-15T18:52:54.580349] [INFO ] [MAIN ] HUBS: Full history saved. [2025-09-15T18:52:54.580447] [INFO ] [MAIN ] Update Progress: 1065/2369 symbols completed. HUBS took 26.4s. Estimated remaining: 2h 18m 11s. Rate: 9.4 symbols/min [2025-09-15T18:52:54.755364] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:52:54.768104] [DEBUG] [LOCAL ] HVT: Loaded 11292 existing records from primary storage. [2025-09-15T18:52:54.768261] [INFO ] [MAIN ] HVT: Loaded 11292 existing records. [2025-09-15T18:52:54.862718] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-09-15T18:52:54.953536] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:52:54.953875] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-09-15T18:52:54.953931] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-09-15T18:52:54.954352] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-09-15T18:52:54.954403] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-09-15T18:52:55.292809] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-15T18:52:55.370869] [INFO ] [REMOTE ] HVT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:52:55.657910] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-09-15T18:52:55.878968] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-15T18:52:55.885393] [INFO ] [REMOTE ] HUM: Full fetch complete (53301 records). [2025-09-15T18:52:55.885531] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-09-15T18:52:56.290830] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-09-15T18:52:56.291001] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-09-15T18:52:56.291915] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-09-15T18:52:56.291996] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-09-15T18:52:56.293493] [DEBUG] [LOCAL ] HUM: Trimmed 53301 records to 36176 (keeping 150 days of data) [2025-09-15T18:52:56.420207] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T18:52:56.459519] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-09-15T18:52:56.573021] [DEBUG] [LOCAL ] HUM: Primary data saved (36176 records). [2025-09-15T18:52:56.573188] [INFO ] [MAIN ] HUM: Full history saved. [2025-09-15T18:52:56.573323] [INFO ] [MAIN ] Update Progress: 1066/2369 symbols completed. HUM took 27.4s. Estimated remaining: 2h 17m 59s. Rate: 9.4 symbols/min [2025-09-15T18:52:56.754058] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:52:56.793336] [DEBUG] [LOCAL ] HWM: Loaded 39910 existing records from primary storage. [2025-09-15T18:52:56.793489] [INFO ] [MAIN ] HWM: Loaded 39910 existing records. [2025-09-15T18:52:56.972807] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:52:56.973103] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-09-15T18:52:56.973149] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-09-15T18:52:56.974051] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-09-15T18:52:56.974105] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-09-15T18:52:57.264377] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-09-15T18:52:57.351775] [INFO ] [REMOTE ] HWM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:52:57.354262] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-15T18:52:57.361243] [INFO ] [REMOTE ] HUN: Full fetch complete (57829 records). [2025-09-15T18:52:57.361401] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-09-15T18:52:57.684974] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-15T18:52:57.787248] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-09-15T18:52:57.787367] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-09-15T18:52:57.788302] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-09-15T18:52:57.788357] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-09-15T18:52:57.789767] [DEBUG] [LOCAL ] HUN: Trimmed 57829 records to 39242 (keeping 150 days of data) [2025-09-15T18:52:58.059963] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-09-15T18:52:58.063541] [DEBUG] [LOCAL ] HUN: Primary data saved (39242 records). [2025-09-15T18:52:58.064911] [INFO ] [MAIN ] HUN: Full history saved. [2025-09-15T18:52:58.065491] [INFO ] [MAIN ] Update Progress: 1067/2369 symbols completed. HUN took 20.7s. Estimated remaining: 2h 17m 47s. Rate: 9.4 symbols/min [2025-09-15T18:52:58.243958] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:52:58.281493] [DEBUG] [LOCAL ] HXL: Loaded 34690 existing records from primary storage. [2025-09-15T18:52:58.281662] [INFO ] [MAIN ] HXL: Loaded 34690 existing records. [2025-09-15T18:52:58.465382] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:52:58.465633] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-09-15T18:52:58.465700] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-09-15T18:52:58.466495] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-09-15T18:52:58.466559] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-09-15T18:52:58.828790] [INFO ] [REMOTE ] HXL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:52:58.857873] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-09-15T18:52:58.910914] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T18:52:59.140485] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-15T18:52:59.657913] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-09-15T18:53:00.163363] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-15T18:53:00.457896] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-09-15T18:53:01.243555] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-15T18:53:01.258940] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-09-15T18:53:01.268945] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-15T18:53:02.057931] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-09-15T18:53:02.340245] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-15T18:53:02.857888] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-09-15T18:53:03.352098] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-15T18:53:03.657937] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-09-15T18:53:04.090974] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T18:53:04.457914] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-09-15T18:53:05.087983] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T18:53:05.257885] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-09-15T18:53:06.047822] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-15T18:53:06.058490] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-09-15T18:53:06.174402] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-15T18:53:06.857921] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-09-15T18:53:07.394041] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-15T18:53:07.500418] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-15T18:53:07.657815] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-09-15T18:53:08.457863] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-09-15T18:53:09.223491] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-15T18:53:09.257825] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-09-15T18:53:09.408791] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T18:53:10.057876] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-09-15T18:53:10.689113] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-15T18:53:10.857918] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-09-15T18:53:11.562368] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T18:53:11.657889] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-09-15T18:53:11.913566] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T18:53:12.457880] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-09-15T18:53:13.245468] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-15T18:53:13.257814] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-09-15T18:53:13.485818] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-15T18:53:13.917088] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-15T18:53:13.919248] [INFO ] [REMOTE ] HVT: Full fetch complete (17940 records). [2025-09-15T18:53:13.919331] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-09-15T18:53:14.063491] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-09-15T18:53:14.288135] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-09-15T18:53:14.288216] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-09-15T18:53:14.288587] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-09-15T18:53:14.288627] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-09-15T18:53:14.289734] [DEBUG] [LOCAL ] HVT: Trimmed 17940 records to 10975 (keeping 150 days of data) [2025-09-15T18:53:14.366018] [DEBUG] [LOCAL ] HVT: Primary data saved (10975 records). [2025-09-15T18:53:14.366165] [INFO ] [MAIN ] HVT: Full history saved. [2025-09-15T18:53:14.366281] [INFO ] [MAIN ] Update Progress: 1068/2369 symbols completed. HVT took 19.8s. Estimated remaining: 2h 17m 53s. Rate: 9.4 symbols/min [2025-09-15T18:53:14.535983] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:53:14.545766] [DEBUG] [LOCAL ] HY: Loaded 7350 existing records from primary storage. [2025-09-15T18:53:14.545873] [INFO ] [MAIN ] HY: Loaded 7350 existing records. [2025-09-15T18:53:14.720747] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:53:14.720985] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-09-15T18:53:14.721030] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-09-15T18:53:14.721380] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-09-15T18:53:14.721428] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-09-15T18:53:14.865355] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-09-15T18:53:15.079819] [INFO ] [REMOTE ] HY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:53:15.318460] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-15T18:53:15.657864] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-09-15T18:53:16.320831] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T18:53:16.327315] [INFO ] [REMOTE ] HXL: Full fetch complete (50076 records). [2025-09-15T18:53:16.327426] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-09-15T18:53:16.463010] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-09-15T18:53:16.723369] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-09-15T18:53:16.723528] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-09-15T18:53:16.724822] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-09-15T18:53:16.725037] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-09-15T18:53:16.727054] [DEBUG] [LOCAL ] HXL: Trimmed 50076 records to 33913 (keeping 150 days of data) [2025-09-15T18:53:16.855208] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-15T18:53:16.993990] [DEBUG] [LOCAL ] HXL: Primary data saved (33913 records). [2025-09-15T18:53:16.994177] [INFO ] [MAIN ] HXL: Full history saved. [2025-09-15T18:53:16.995103] [INFO ] [MAIN ] Update Progress: 1069/2369 symbols completed. HXL took 18.9s. Estimated remaining: 2h 17m 42s. Rate: 9.4 symbols/min [2025-09-15T18:53:17.168450] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:53:17.168676] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-09-15T18:53:17.168716] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-09-15T18:53:17.168860] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-09-15T18:53:17.168899] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-15T18:53:17.168939] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-15T18:53:17.168971] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-09-15T18:53:17.260240] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-09-15T18:53:17.342441] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-15T18:53:17.545736] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:53:18.057874] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-09-15T18:53:18.490625] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-15T18:53:18.858153] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-09-15T18:53:18.861864] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-15T18:53:19.662721] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-09-15T18:53:19.663717] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-15T18:53:20.457879] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-09-15T18:53:21.257921] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-09-15T18:53:21.291512] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-15T18:53:21.503858] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-15T18:53:21.544545] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-15T18:53:22.057899] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-09-15T18:53:22.857879] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-09-15T18:53:23.091302] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-09-15T18:53:23.657897] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-09-15T18:53:23.810533] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-15T18:53:23.959862] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-15T18:53:24.457905] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-09-15T18:53:24.936492] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-15T18:53:25.257872] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-09-15T18:53:25.817694] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-15T18:53:26.057886] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-09-15T18:53:26.382858] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-15T18:53:26.857876] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-09-15T18:53:27.657880] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-09-15T18:53:27.942191] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-15T18:53:28.457906] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-09-15T18:53:28.583530] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-15T18:53:28.589399] [INFO ] [REMOTE ] HWM: Full fetch complete (57688 records). [2025-09-15T18:53:28.589532] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-09-15T18:53:28.711281] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-09-15T18:53:28.987762] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-09-15T18:53:28.987874] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-09-15T18:53:28.988750] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-09-15T18:53:28.988824] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-09-15T18:53:28.990202] [DEBUG] [LOCAL ] HWM: Trimmed 57688 records to 39128 (keeping 150 days of data) [2025-09-15T18:53:29.262879] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-09-15T18:53:29.277543] [DEBUG] [LOCAL ] HWM: Primary data saved (39128 records). [2025-09-15T18:53:29.277834] [INFO ] [MAIN ] HWM: Full history saved. [2025-09-15T18:53:29.277983] [INFO ] [MAIN ] Update Progress: 1070/2369 symbols completed. HWM took 32.7s. Estimated remaining: 2h 17m 43s. Rate: 9.4 symbols/min [2025-09-15T18:53:29.497189] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:53:29.497438] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-09-15T18:53:29.497480] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-09-15T18:53:29.497622] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-09-15T18:53:29.497693] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-15T18:53:29.497739] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-15T18:53:29.497774] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-09-15T18:53:29.868213] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:53:29.876015] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-15T18:53:30.057876] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-09-15T18:53:30.829749] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-15T18:53:30.857854] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-09-15T18:53:31.641660] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-15T18:53:31.644555] [INFO ] [REMOTE ] HY: Full fetch complete (11428 records). [2025-09-15T18:53:31.644674] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-09-15T18:53:31.665999] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-09-15T18:53:32.062414] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-15T18:53:32.068687] [INFO ] [REMOTE ] HYAC: Full fetch complete (661 records). [2025-09-15T18:53:32.100581] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-09-15T18:53:32.102225] [FATAL] [VALIDATOR ] HYAC: Data is stale - most recent date (2025-09-11) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T18:53:32.101081] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-09-15T18:53:32.102409] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:53:32.102576] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-09-15T18:53:32.103368] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-09-15T18:53:32.102715] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:53:32.103486] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-09-15T18:53:32.103673] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-15T18:53:32.103792] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-15T18:53:32.104041] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-09-15T18:53:32.104488] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-09-15T18:53:32.104780] [INFO ] [MAIN ] Update Progress: 1071/2369 symbols completed. HYAC took 15.1s. Estimated remaining: 2h 17m 32s. Rate: 9.4 symbols/min [2025-09-15T18:53:32.110563] [DEBUG] [LOCAL ] HY: Trimmed 11428 records to 7126 (keeping 150 days of data) [2025-09-15T18:53:32.330673] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:53:32.343633] [DEBUG] [LOCAL ] HY: Primary data saved (7126 records). [2025-09-15T18:53:32.343909] [INFO ] [MAIN ] HY: Full history saved. [2025-09-15T18:53:32.344021] [INFO ] [MAIN ] Update Progress: 1072/2369 symbols completed. HY took 18.0s. Estimated remaining: 2h 17m 18s. Rate: 9.4 symbols/min [2025-09-15T18:53:32.445896] [DEBUG] [LOCAL ] HYI: Loaded 6514 existing records from primary storage. [2025-09-15T18:53:32.458739] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-09-15T18:53:32.479819] [INFO ] [MAIN ] HYI: Loaded 6514 existing records. [2025-09-15T18:53:32.574586] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:53:32.729029] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:53:32.735080] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-09-15T18:53:32.735151] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-09-15T18:53:32.735545] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-09-15T18:53:32.735610] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-09-15T18:53:32.849725] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-15T18:53:32.854345] [DEBUG] [LOCAL ] HYT: Loaded 24744 existing records from primary storage. [2025-09-15T18:53:32.855614] [INFO ] [MAIN ] HYT: Loaded 24744 existing records. [2025-09-15T18:53:33.258224] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-09-15T18:53:33.258143] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:53:33.300856] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-09-15T18:53:33.300096] [INFO ] [REMOTE ] HYI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:53:33.300965] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-09-15T18:53:33.301897] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-09-15T18:53:33.301958] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-09-15T18:53:33.651796] [INFO ] [REMOTE ] HYT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:53:34.057870] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-09-15T18:53:34.836581] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-15T18:53:34.841774] [INFO ] [REMOTE ] HUYA: Full fetch complete (48064 records). [2025-09-15T18:53:34.841912] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-09-15T18:53:34.863741] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-09-15T18:53:34.997429] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T18:53:35.257168] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-09-15T18:53:35.257299] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-09-15T18:53:35.258444] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-09-15T18:53:35.258499] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-09-15T18:53:35.260219] [DEBUG] [LOCAL ] HUYA: Trimmed 48064 records to 31968 (keeping 150 days of data) [2025-09-15T18:53:35.467097] [DEBUG] [LOCAL ] HUYA: Primary data saved (31968 records). [2025-09-15T18:53:35.467333] [INFO ] [MAIN ] HUYA: Full history saved. [2025-09-15T18:53:35.467469] [INFO ] [MAIN ] Update Progress: 1073/2369 symbols completed. HUYA took 49.4s. Estimated remaining: 2h 17m 8s. Rate: 9.5 symbols/min [2025-09-15T18:53:35.636637] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:53:35.640850] [DEBUG] [LOCAL ] HYTR: Loaded 2256 existing records from primary storage. [2025-09-15T18:53:35.640930] [INFO ] [MAIN ] HYTR: Loaded 2256 existing records. [2025-09-15T18:53:35.662970] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-09-15T18:53:35.819212] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:53:35.819477] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-09-15T18:53:35.819523] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-09-15T18:53:35.819752] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-09-15T18:53:35.819798] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-09-15T18:53:36.005240] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-15T18:53:36.184336] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:53:36.205497] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-15T18:53:36.457910] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-09-15T18:53:36.689079] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-09-15T18:53:37.257916] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-09-15T18:53:37.801822] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-15T18:53:38.057908] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-09-15T18:53:38.857889] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-09-15T18:53:39.167890] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-15T18:53:39.457847] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T18:53:39.657885] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-09-15T18:53:39.959173] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-15T18:53:40.457895] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-09-15T18:53:40.974558] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-15T18:53:41.257924] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-09-15T18:53:41.569527] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-15T18:53:42.057911] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-09-15T18:53:42.352201] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-15T18:53:42.857876] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-09-15T18:53:43.127456] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-09-15T18:53:43.657929] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-09-15T18:53:44.457961] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-09-15T18:53:44.716248] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-15T18:53:45.243269] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-15T18:53:45.257818] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-09-15T18:53:45.808702] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-15T18:53:46.057915] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-09-15T18:53:46.371321] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-15T18:53:46.857931] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-09-15T18:53:47.657938] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-09-15T18:53:47.721717] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T18:53:48.328883] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-15T18:53:48.457907] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-09-15T18:53:49.257871] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-09-15T18:53:49.343883] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-15T18:53:49.649989] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-15T18:53:49.650699] [INFO ] [REMOTE ] HYBX: Full fetch complete (488 records). [2025-09-15T18:53:49.650774] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-09-15T18:53:49.831572] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 134 unique days, need 150 days [2025-09-15T18:53:49.831803] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T18:53:49.831852] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T18:53:49.831902] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-15T18:53:49.831978] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-15T18:53:49.832020] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-09-15T18:53:49.832069] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-09-15T18:53:49.832148] [INFO ] [MAIN ] Update Progress: 1074/2369 symbols completed. HYBX took 20.6s. Estimated remaining: 2h 17m 11s. Rate: 9.4 symbols/min [2025-09-15T18:53:50.005705] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:53:50.026040] [DEBUG] [LOCAL ] HZO: Loaded 21209 existing records from primary storage. [2025-09-15T18:53:50.026174] [INFO ] [MAIN ] HZO: Loaded 21209 existing records. [2025-09-15T18:53:50.063045] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-09-15T18:53:50.208820] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:53:50.209090] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-09-15T18:53:50.209140] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-09-15T18:53:50.209712] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-09-15T18:53:50.209763] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-09-15T18:53:50.558594] [INFO ] [REMOTE ] HZO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:53:50.857882] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-09-15T18:53:51.011890] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T18:53:51.636015] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-15T18:53:51.657833] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-09-15T18:53:52.399551] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-15T18:53:52.457854] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-09-15T18:53:53.145579] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-15T18:53:53.146820] [INFO ] [REMOTE ] HYI: Full fetch complete (9739 records). [2025-09-15T18:53:53.146894] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-09-15T18:53:53.262957] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-09-15T18:53:53.506043] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-09-15T18:53:53.506125] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-09-15T18:53:53.506380] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-09-15T18:53:53.506419] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-09-15T18:53:53.506957] [DEBUG] [LOCAL ] HYI: Trimmed 9739 records to 6436 (keeping 150 days of data) [2025-09-15T18:53:53.548259] [DEBUG] [LOCAL ] HYI: Primary data saved (6436 records). [2025-09-15T18:53:53.548407] [INFO ] [MAIN ] HYI: Full history saved. [2025-09-15T18:53:53.548494] [INFO ] [MAIN ] Update Progress: 1075/2369 symbols completed. HYI took 21.4s. Estimated remaining: 2h 17m 2s. Rate: 9.4 symbols/min [2025-09-15T18:53:53.720955] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:53:53.727009] [DEBUG] [LOCAL ] IAE: Loaded 4197 existing records from primary storage. [2025-09-15T18:53:53.727114] [INFO ] [MAIN ] IAE: Loaded 4197 existing records. [2025-09-15T18:53:53.905904] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:53:53.906189] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-09-15T18:53:53.906237] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-09-15T18:53:53.906472] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-09-15T18:53:53.906518] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-09-15T18:53:54.065586] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-09-15T18:53:54.269171] [INFO ] [REMOTE ] IAE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:53:54.283427] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-15T18:53:54.523572] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-15T18:53:54.857879] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-09-15T18:53:55.354331] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-15T18:53:55.657867] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-09-15T18:53:56.101868] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-15T18:53:56.457872] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-09-15T18:53:56.858591] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-15T18:53:57.257942] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-09-15T18:53:57.762434] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-15T18:53:58.057914] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-09-15T18:53:58.644028] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-15T18:53:58.857928] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-09-15T18:53:59.657887] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-09-15T18:54:00.134575] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T18:54:00.274160] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T18:54:00.275131] [INFO ] [REMOTE ] HYTR: Full fetch complete (3469 records). [2025-09-15T18:54:00.275200] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-09-15T18:54:00.465754] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-09-15T18:54:00.631857] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-09-15T18:54:00.631938] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-09-15T18:54:00.632075] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-09-15T18:54:00.632114] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-09-15T18:54:00.632463] [DEBUG] [LOCAL ] HYTR: Trimmed 3469 records to 2215 (keeping 150 days of data) [2025-09-15T18:54:00.646684] [DEBUG] [LOCAL ] HYTR: Primary data saved (2215 records). [2025-09-15T18:54:00.646743] [INFO ] [MAIN ] HYTR: Full history saved. [2025-09-15T18:54:00.646813] [INFO ] [MAIN ] Update Progress: 1076/2369 symbols completed. HYTR took 25.2s. Estimated remaining: 2h 16m 56s. Rate: 9.4 symbols/min [2025-09-15T18:54:00.815904] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:54:00.855474] [DEBUG] [LOCAL ] IAG: Loaded 40237 existing records from primary storage. [2025-09-15T18:54:00.855616] [INFO ] [MAIN ] IAG: Loaded 40237 existing records. [2025-09-15T18:54:01.032843] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:54:01.033100] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-09-15T18:54:01.033145] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-09-15T18:54:01.034172] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-09-15T18:54:01.034237] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-09-15T18:54:01.263470] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-09-15T18:54:01.430728] [INFO ] [REMOTE ] IAG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:54:01.904482] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-15T18:54:02.057852] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-09-15T18:54:02.822736] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-15T18:54:02.857853] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-09-15T18:54:03.283747] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-15T18:54:03.657884] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-09-15T18:54:04.202246] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-15T18:54:04.207056] [INFO ] [REMOTE ] HYT: Full fetch complete (36040 records). [2025-09-15T18:54:04.207198] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-09-15T18:54:04.462941] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-09-15T18:54:04.586065] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-09-15T18:54:04.586163] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-09-15T18:54:04.586894] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-09-15T18:54:04.586951] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-09-15T18:54:04.588082] [DEBUG] [LOCAL ] HYT: Trimmed 36040 records to 24150 (keeping 150 days of data) [2025-09-15T18:54:04.742500] [DEBUG] [LOCAL ] HYT: Primary data saved (24150 records). [2025-09-15T18:54:04.742750] [INFO ] [MAIN ] HYT: Full history saved. [2025-09-15T18:54:04.742893] [INFO ] [MAIN ] Update Progress: 1077/2369 symbols completed. HYT took 32.4s. Estimated remaining: 2h 16m 47s. Rate: 9.4 symbols/min [2025-09-15T18:54:04.760616] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-15T18:54:05.065545] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-15T18:54:05.257909] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-09-15T18:54:05.665032] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-15T18:54:06.057887] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-09-15T18:54:06.857884] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-09-15T18:54:07.045279] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-15T18:54:07.657909] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-09-15T18:54:08.457897] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-09-15T18:54:08.621393] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-15T18:54:08.766902] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-15T18:54:08.889197] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-15T18:54:09.257888] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-09-15T18:54:10.057888] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-09-15T18:54:10.773486] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T18:54:10.857838] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-09-15T18:54:10.969755] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-15T18:54:10.972616] [INFO ] [REMOTE ] HZO: Full fetch complete (31512 records). [2025-09-15T18:54:10.972704] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-09-15T18:54:11.341330] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-09-15T18:54:11.341409] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-09-15T18:54:11.342064] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-09-15T18:54:11.342109] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-09-15T18:54:11.342886] [DEBUG] [LOCAL ] HZO: Trimmed 31512 records to 20526 (keeping 150 days of data) [2025-09-15T18:54:11.462520] [DEBUG] [LOCAL ] HZO: Primary data saved (20526 records). [2025-09-15T18:54:11.462677] [INFO ] [MAIN ] HZO: Full history saved. [2025-09-15T18:54:11.462761] [INFO ] [MAIN ] Update Progress: 1078/2369 symbols completed. HZO took 21.6s. Estimated remaining: 2h 16m 41s. Rate: 9.4 symbols/min [2025-09-15T18:54:11.657900] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-09-15T18:54:12.288284] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T18:54:12.352976] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-15T18:54:12.457894] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-09-15T18:54:13.257878] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-09-15T18:54:13.873487] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-15T18:54:13.875853] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-15T18:54:14.057881] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-09-15T18:54:14.662634] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-15T18:54:14.663935] [INFO ] [REMOTE ] IAE: Full fetch complete (6341 records). [2025-09-15T18:54:14.664007] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-09-15T18:54:14.858242] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-09-15T18:54:15.068580] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-09-15T18:54:15.068682] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-09-15T18:54:15.068902] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-09-15T18:54:15.068960] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-09-15T18:54:15.069408] [DEBUG] [LOCAL ] IAE: Trimmed 6341 records to 4215 (keeping 150 days of data) [2025-09-15T18:54:15.098222] [DEBUG] [LOCAL ] IAE: Primary data saved (4215 records). [2025-09-15T18:54:15.098349] [INFO ] [MAIN ] IAE: Full history saved. [2025-09-15T18:54:15.098439] [INFO ] [MAIN ] Update Progress: 1079/2369 symbols completed. IAE took 21.5s. Estimated remaining: 2h 16m 32s. Rate: 9.4 symbols/min [2025-09-15T18:54:16.884182] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-15T18:54:16.895257] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-09-15T18:54:18.327520] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-15T18:54:18.338974] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-09-15T18:54:19.975236] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-15T18:54:19.986570] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-09-15T18:54:21.793833] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-15T18:54:21.799735] [INFO ] [REMOTE ] IAG: Full fetch complete (58099 records). [2025-09-15T18:54:21.799857] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-09-15T18:54:22.198157] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-09-15T18:54:22.198247] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-09-15T18:54:22.199071] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-09-15T18:54:22.199119] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-09-15T18:54:22.200399] [DEBUG] [LOCAL ] IAG: Trimmed 58099 records to 39458 (keeping 150 days of data) [2025-09-15T18:54:22.432993] [DEBUG] [LOCAL ] IAG: Primary data saved (39458 records). [2025-09-15T18:54:22.433157] [INFO ] [MAIN ] IAG: Full history saved. [2025-09-15T18:54:22.433774] [INFO ] [MAIN ] Update Progress: 1080/2369 symbols completed. IAG took 21.8s. Estimated remaining: 2h 16m 26s. Rate: 9.4 symbols/min [2025-09-15T18:54:23.106404] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:54:23.063465] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:54:23.155010] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:54:23.157388] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:54:23.179888] [DEBUG] [LOCAL ] IBP: Loaded 21904 existing records from primary storage. [2025-09-15T18:54:23.188024] [INFO ] [MAIN ] IBP: Loaded 21904 existing records. [2025-09-15T18:54:23.303094] [DEBUG] [LOCAL ] IBTA: Loaded 26676 existing records from primary storage. [2025-09-15T18:54:23.316804] [INFO ] [MAIN ] IBTA: Loaded 26676 existing records. [2025-09-15T18:54:23.432886] [DEBUG] [LOCAL ] IBM: Loaded 40393 existing records from primary storage. [2025-09-15T18:54:23.497860] [DEBUG] [LOCAL ] IBN: Loaded 39792 existing records from primary storage. [2025-09-15T18:54:23.491802] [INFO ] [MAIN ] IBM: Loaded 40393 existing records. [2025-09-15T18:54:23.497147] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:54:23.513437] [INFO ] [MAIN ] IBN: Loaded 39792 existing records. [2025-09-15T18:54:23.576125] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-09-15T18:54:23.614532] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-09-15T18:54:23.655290] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-09-15T18:54:23.713540] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-09-15T18:54:23.843235] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:54:24.013183] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-09-15T18:54:24.013086] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:54:24.070082] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-09-15T18:54:24.069909] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:54:24.070442] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-09-15T18:54:24.050337] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-09-15T18:54:24.109920] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-09-15T18:54:24.119234] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-09-15T18:54:24.127094] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-09-15T18:54:24.127195] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-09-15T18:54:24.147146] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-09-15T18:54:24.155751] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-09-15T18:54:24.176824] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-09-15T18:54:24.196103] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-09-15T18:54:24.649338] [INFO ] [REMOTE ] IBP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:54:24.670579] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-09-15T18:54:25.305848] [INFO ] [REMOTE ] IBM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:54:25.377516] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-09-15T18:54:25.381830] [INFO ] [REMOTE ] IBN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:54:25.406289] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-09-15T18:54:25.435444] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:54:25.436581] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-09-15T18:54:26.032805] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-15T18:54:26.038716] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-09-15T18:54:26.614248] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-15T18:54:26.620743] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-09-15T18:54:26.859746] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T18:54:26.871303] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-09-15T18:54:26.923787] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-15T18:54:26.930669] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-09-15T18:54:27.266670] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-15T18:54:27.277896] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-09-15T18:54:27.727259] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-15T18:54:27.737943] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-09-15T18:54:27.786046] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-15T18:54:27.792476] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-09-15T18:54:28.256543] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-15T18:54:28.268497] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-09-15T18:54:28.907932] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-15T18:54:28.918223] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-09-15T18:54:28.937258] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-15T18:54:28.943984] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-09-15T18:54:29.364615] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-15T18:54:29.375740] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-09-15T18:54:29.585362] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-15T18:54:29.924019] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-15T18:54:30.057879] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-09-15T18:54:30.193618] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-15T18:54:30.857824] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-09-15T18:54:31.305403] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-15T18:54:31.657838] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-09-15T18:54:31.781250] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-15T18:54:32.024871] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-15T18:54:32.457883] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-09-15T18:54:32.555735] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-15T18:54:33.257880] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-09-15T18:54:33.836493] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-15T18:54:34.057920] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-09-15T18:54:34.318069] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T18:54:34.857878] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-09-15T18:54:35.332322] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-15T18:54:35.657871] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-09-15T18:54:36.151533] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T18:54:36.155072] [INFO ] [REMOTE ] IBP: Full fetch complete (32210 records). [2025-09-15T18:54:36.155154] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-09-15T18:54:36.463067] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-09-15T18:54:36.533175] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-09-15T18:54:36.533263] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-09-15T18:54:36.534180] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-09-15T18:54:36.534250] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-09-15T18:54:36.535737] [DEBUG] [LOCAL ] IBP: Trimmed 32210 records to 21527 (keeping 150 days of data) [2025-09-15T18:54:36.692285] [DEBUG] [LOCAL ] IBP: Primary data saved (21527 records). [2025-09-15T18:54:36.692438] [INFO ] [MAIN ] IBP: Full history saved. [2025-09-15T18:54:36.692555] [INFO ] [MAIN ] Update Progress: 1081/2369 symbols completed. IBP took 14.3s. Estimated remaining: 2h 16m 30s. Rate: 9.4 symbols/min [2025-09-15T18:54:36.923186] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:54:36.975769] [DEBUG] [LOCAL ] ICE: Loaded 39805 existing records from primary storage. [2025-09-15T18:54:36.975943] [INFO ] [MAIN ] ICE: Loaded 39805 existing records. [2025-09-15T18:54:37.212454] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:54:37.212938] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-09-15T18:54:37.213149] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-09-15T18:54:37.214404] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-09-15T18:54:37.214470] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-09-15T18:54:37.260151] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-09-15T18:54:37.699972] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-15T18:54:37.808145] [INFO ] [REMOTE ] ICE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:54:37.829806] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-15T18:54:38.057936] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-09-15T18:54:38.860274] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-09-15T18:54:38.867277] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T18:54:39.521900] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-15T18:54:39.657890] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-09-15T18:54:40.457837] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-09-15T18:54:40.910288] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-15T18:54:40.953362] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-15T18:54:41.257871] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-09-15T18:54:41.528071] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-15T18:54:42.057872] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-09-15T18:54:42.857840] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-09-15T18:54:43.408246] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-15T18:54:43.433728] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-15T18:54:43.438635] [INFO ] [REMOTE ] IBTA: Full fetch complete (40471 records). [2025-09-15T18:54:43.438769] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-09-15T18:54:43.664959] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-09-15T18:54:43.820569] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-09-15T18:54:43.820673] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-09-15T18:54:43.821330] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-09-15T18:54:43.821372] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-09-15T18:54:43.822287] [DEBUG] [LOCAL ] IBTA: Trimmed 40471 records to 25982 (keeping 150 days of data) [2025-09-15T18:54:43.975131] [DEBUG] [LOCAL ] IBTA: Primary data saved (25982 records). [2025-09-15T18:54:43.975268] [INFO ] [MAIN ] IBTA: Full history saved. [2025-09-15T18:54:43.975361] [INFO ] [MAIN ] Update Progress: 1082/2369 symbols completed. IBTA took 21.5s. Estimated remaining: 2h 16m 24s. Rate: 9.4 symbols/min [2025-09-15T18:54:44.148507] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:54:44.175878] [DEBUG] [LOCAL ] ICL: Loaded 28754 existing records from primary storage. [2025-09-15T18:54:44.176048] [INFO ] [MAIN ] ICL: Loaded 28754 existing records. [2025-09-15T18:54:44.353717] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:54:44.354022] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-09-15T18:54:44.354154] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-09-15T18:54:44.354834] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-09-15T18:54:44.354887] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-09-15T18:54:44.459495] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-09-15T18:54:44.737402] [INFO ] [REMOTE ] ICL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:54:44.757842] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-15T18:54:45.257911] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-09-15T18:54:46.027004] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-15T18:54:46.057982] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-09-15T18:54:46.059761] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T18:54:46.065568] [INFO ] [REMOTE ] IBN: Full fetch complete (57541 records). [2025-09-15T18:54:46.065687] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-09-15T18:54:46.446459] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-09-15T18:54:46.446601] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-09-15T18:54:46.447727] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-09-15T18:54:46.447834] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-09-15T18:54:46.449199] [DEBUG] [LOCAL ] IBN: Trimmed 57541 records to 38999 (keeping 150 days of data) [2025-09-15T18:54:46.534972] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T18:54:46.718350] [DEBUG] [LOCAL ] IBN: Primary data saved (38999 records). [2025-09-15T18:54:46.718495] [INFO ] [MAIN ] IBN: Full history saved. [2025-09-15T18:54:46.718579] [INFO ] [MAIN ] Update Progress: 1083/2369 symbols completed. IBN took 24.3s. Estimated remaining: 2h 16m 14s. Rate: 9.4 symbols/min [2025-09-15T18:54:46.858248] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-09-15T18:54:46.888283] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:54:46.912460] [DEBUG] [LOCAL ] IDA: Loaded 25071 existing records from primary storage. [2025-09-15T18:54:46.912590] [INFO ] [MAIN ] IDA: Loaded 25071 existing records. [2025-09-15T18:54:47.090696] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:54:47.090951] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-09-15T18:54:47.090996] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-09-15T18:54:47.091745] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-09-15T18:54:47.091795] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-09-15T18:54:47.449960] [INFO ] [REMOTE ] IDA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:54:47.657896] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-09-15T18:54:47.958951] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-15T18:54:48.001565] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-15T18:54:48.457883] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-09-15T18:54:48.601812] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T18:54:49.257990] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-09-15T18:54:49.779251] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-15T18:54:49.785619] [INFO ] [REMOTE ] IBM: Full fetch complete (58282 records). [2025-09-15T18:54:49.785784] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-09-15T18:54:50.059312] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-09-15T18:54:50.177569] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-09-15T18:54:50.177721] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-09-15T18:54:50.178705] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-09-15T18:54:50.178768] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-09-15T18:54:50.181044] [DEBUG] [LOCAL ] IBM: Trimmed 58282 records to 39615 (keeping 150 days of data) [2025-09-15T18:54:50.207226] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-15T18:54:50.474563] [DEBUG] [LOCAL ] IBM: Primary data saved (39615 records). [2025-09-15T18:54:50.474749] [INFO ] [MAIN ] IBM: Full history saved. [2025-09-15T18:54:50.476584] [INFO ] [MAIN ] Update Progress: 1084/2369 symbols completed. IBM took 28.0s. Estimated remaining: 2h 16m 4s. Rate: 9.4 symbols/min [2025-09-15T18:54:50.650059] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:54:50.659438] [DEBUG] [LOCAL ] IDE: Loaded 6576 existing records from primary storage. [2025-09-15T18:54:50.659612] [INFO ] [MAIN ] IDE: Loaded 6576 existing records. [2025-09-15T18:54:50.834984] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:54:50.835260] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-09-15T18:54:50.835307] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-09-15T18:54:50.835613] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-09-15T18:54:50.835685] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-09-15T18:54:50.865682] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-09-15T18:54:51.187714] [INFO ] [REMOTE ] IDE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:54:51.557760] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-15T18:54:51.657882] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-09-15T18:54:52.253060] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-15T18:54:52.457819] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-09-15T18:54:53.254971] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-15T18:54:53.265353] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-09-15T18:54:53.894368] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T18:54:53.951002] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-15T18:54:54.057885] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-09-15T18:54:54.857909] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-09-15T18:54:55.129473] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-15T18:54:55.657890] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-09-15T18:54:56.462954] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-09-15T18:54:56.476332] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-15T18:54:56.653487] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-15T18:54:56.927315] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-15T18:54:57.257914] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-09-15T18:54:58.057884] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-09-15T18:54:58.592934] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T18:54:58.857908] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-09-15T18:54:59.504994] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-15T18:54:59.510908] [INFO ] [REMOTE ] ICE: Full fetch complete (57647 records). [2025-09-15T18:54:59.511071] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-09-15T18:54:59.683892] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-09-15T18:54:59.894320] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-09-15T18:54:59.894423] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-09-15T18:54:59.895244] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-09-15T18:54:59.895296] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-09-15T18:54:59.896672] [DEBUG] [LOCAL ] ICE: Trimmed 57647 records to 39028 (keeping 150 days of data) [2025-09-15T18:55:00.174234] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T18:55:00.197283] [DEBUG] [LOCAL ] ICE: Primary data saved (39028 records). [2025-09-15T18:55:00.197460] [INFO ] [MAIN ] ICE: Full history saved. [2025-09-15T18:55:00.198192] [INFO ] [MAIN ] Update Progress: 1085/2369 symbols completed. ICE took 23.5s. Estimated remaining: 2h 16m 2s. Rate: 9.4 symbols/min [2025-09-15T18:55:00.379382] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:55:00.394488] [DEBUG] [LOCAL ] IDT: Loaded 13144 existing records from primary storage. [2025-09-15T18:55:00.394660] [INFO ] [MAIN ] IDT: Loaded 13144 existing records. [2025-09-15T18:55:00.463154] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-09-15T18:55:00.580805] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:55:00.581051] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-09-15T18:55:00.581096] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-09-15T18:55:00.581580] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-09-15T18:55:00.581636] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-09-15T18:55:00.940509] [INFO ] [REMOTE ] IDT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:55:01.147774] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-15T18:55:01.257886] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-09-15T18:55:01.317873] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T18:55:02.026222] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-15T18:55:02.057916] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-09-15T18:55:02.857877] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-09-15T18:55:03.405388] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T18:55:03.657934] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-09-15T18:55:04.001729] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-15T18:55:04.005914] [INFO ] [REMOTE ] ICL: Full fetch complete (42377 records). [2025-09-15T18:55:04.006008] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-09-15T18:55:04.378200] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-09-15T18:55:04.378277] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-09-15T18:55:04.378945] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-09-15T18:55:04.378990] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-09-15T18:55:04.379862] [DEBUG] [LOCAL ] ICL: Trimmed 42377 records to 28261 (keeping 150 days of data) [2025-09-15T18:55:04.467122] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-09-15T18:55:04.546428] [DEBUG] [LOCAL ] ICL: Primary data saved (28261 records). [2025-09-15T18:55:04.546563] [INFO ] [MAIN ] ICL: Full history saved. [2025-09-15T18:55:04.546666] [INFO ] [MAIN ] Update Progress: 1086/2369 symbols completed. ICL took 20.6s. Estimated remaining: 2h 15m 53s. Rate: 9.4 symbols/min [2025-09-15T18:55:04.718284] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:55:04.748209] [DEBUG] [LOCAL ] IEX: Loaded 28982 existing records from primary storage. [2025-09-15T18:55:04.748342] [INFO ] [MAIN ] IEX: Loaded 28982 existing records. [2025-09-15T18:55:04.927123] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:55:04.927513] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-09-15T18:55:04.927576] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-09-15T18:55:04.928358] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-09-15T18:55:04.928436] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-09-15T18:55:05.067844] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-15T18:55:05.263728] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-09-15T18:55:05.307576] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-15T18:55:05.337711] [INFO ] [REMOTE ] IEX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:55:06.057897] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-09-15T18:55:06.624585] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-15T18:55:06.857935] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-09-15T18:55:07.479066] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T18:55:07.657889] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-09-15T18:55:07.899250] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-15T18:55:08.457940] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-09-15T18:55:08.728388] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-15T18:55:08.731424] [INFO ] [REMOTE ] IDA: Full fetch complete (34460 records). [2025-09-15T18:55:08.731519] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-09-15T18:55:09.099522] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-09-15T18:55:09.099603] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-09-15T18:55:09.100228] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-09-15T18:55:09.100289] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-09-15T18:55:09.101177] [DEBUG] [LOCAL ] IDA: Trimmed 34460 records to 24568 (keeping 150 days of data) [2025-09-15T18:55:09.258851] [DEBUG] [LOCAL ] IDA: Primary data saved (24568 records). [2025-09-15T18:55:09.259242] [INFO ] [MAIN ] IDA: Full history saved. [2025-09-15T18:55:09.258961] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-09-15T18:55:09.260164] [INFO ] [MAIN ] Update Progress: 1087/2369 symbols completed. IDA took 22.5s. Estimated remaining: 2h 15m 45s. Rate: 9.4 symbols/min [2025-09-15T18:55:09.431060] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:55:09.467600] [DEBUG] [LOCAL ] IFF: Loaded 38270 existing records from primary storage. [2025-09-15T18:55:09.467756] [INFO ] [MAIN ] IFF: Loaded 38270 existing records. [2025-09-15T18:55:09.642636] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:55:09.642865] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-09-15T18:55:09.642910] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-09-15T18:55:09.643550] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-09-15T18:55:09.643595] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-09-15T18:55:10.047748] [INFO ] [REMOTE ] IFF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:55:10.055725] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-15T18:55:10.058254] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-09-15T18:55:10.083464] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-15T18:55:10.523433] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-15T18:55:10.857876] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-09-15T18:55:11.657958] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-09-15T18:55:11.801760] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-15T18:55:12.209731] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-15T18:55:12.457865] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-09-15T18:55:13.135170] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-15T18:55:13.136691] [INFO ] [REMOTE ] IDE: Full fetch complete (8992 records). [2025-09-15T18:55:13.136764] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-09-15T18:55:13.262929] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-09-15T18:55:13.516981] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-09-15T18:55:13.517073] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-09-15T18:55:13.517386] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-09-15T18:55:13.517435] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-09-15T18:55:13.518243] [DEBUG] [LOCAL ] IDE: Trimmed 8992 records to 6534 (keeping 150 days of data) [2025-09-15T18:55:13.562154] [DEBUG] [LOCAL ] IDE: Primary data saved (6534 records). [2025-09-15T18:55:13.562270] [INFO ] [MAIN ] IDE: Full history saved. [2025-09-15T18:55:13.562374] [INFO ] [MAIN ] Update Progress: 1088/2369 symbols completed. IDE took 23.1s. Estimated remaining: 2h 15m 36s. Rate: 9.4 symbols/min [2025-09-15T18:55:13.740126] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:55:13.762725] [DEBUG] [LOCAL ] IFN: Loaded 13786 existing records from primary storage. [2025-09-15T18:55:13.762865] [INFO ] [MAIN ] IFN: Loaded 13786 existing records. [2025-09-15T18:55:13.944562] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:55:13.944851] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-09-15T18:55:13.944900] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-09-15T18:55:13.945341] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-09-15T18:55:13.945394] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-09-15T18:55:14.063052] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-09-15T18:55:14.315657] [INFO ] [REMOTE ] IFN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:55:14.723225] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-15T18:55:14.857834] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-09-15T18:55:15.156534] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-15T18:55:15.657906] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-09-15T18:55:15.983484] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-15T18:55:16.457878] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-09-15T18:55:16.847423] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T18:55:17.257869] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-09-15T18:55:17.713706] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-15T18:55:18.013340] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-15T18:55:18.057849] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-09-15T18:55:18.857873] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-09-15T18:55:19.357129] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-15T18:55:19.657885] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-09-15T18:55:19.798931] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T18:55:20.457909] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-09-15T18:55:20.615544] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-15T18:55:21.196734] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-15T18:55:21.257873] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-09-15T18:55:22.047167] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-15T18:55:22.057817] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-09-15T18:55:22.857876] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-09-15T18:55:23.128268] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-15T18:55:23.564053] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-15T18:55:23.566862] [INFO ] [REMOTE ] IDT: Full fetch complete (18145 records). [2025-09-15T18:55:23.566935] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-09-15T18:55:23.666305] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-09-15T18:55:23.941698] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-09-15T18:55:23.941801] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-09-15T18:55:23.942260] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-09-15T18:55:23.942302] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-09-15T18:55:23.943194] [DEBUG] [LOCAL ] IDT: Trimmed 18145 records to 13084 (keeping 150 days of data) [2025-09-15T18:55:24.030949] [DEBUG] [LOCAL ] IDT: Primary data saved (13084 records). [2025-09-15T18:55:24.031110] [INFO ] [MAIN ] IDT: Full history saved. [2025-09-15T18:55:24.031236] [INFO ] [MAIN ] Update Progress: 1089/2369 symbols completed. IDT took 23.8s. Estimated remaining: 2h 15m 35s. Rate: 9.4 symbols/min [2025-09-15T18:55:24.209549] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:55:24.227600] [DEBUG] [LOCAL ] IFS: Loaded 16626 existing records from primary storage. [2025-09-15T18:55:24.227766] [INFO ] [MAIN ] IFS: Loaded 16626 existing records. [2025-09-15T18:55:24.410307] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:55:24.410587] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-09-15T18:55:24.410665] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-09-15T18:55:24.411047] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-09-15T18:55:24.411094] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-09-15T18:55:24.466866] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-09-15T18:55:24.778570] [INFO ] [REMOTE ] IFS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:55:24.884595] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T18:55:25.130190] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T18:55:25.257858] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-09-15T18:55:26.038477] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-15T18:55:26.057810] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-09-15T18:55:26.857898] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-09-15T18:55:26.877751] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-15T18:55:27.657869] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-09-15T18:55:28.435861] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T18:55:28.457821] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-09-15T18:55:28.768953] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-15T18:55:29.257888] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-09-15T18:55:29.844321] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-15T18:55:30.057931] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-09-15T18:55:30.721609] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T18:55:30.727060] [INFO ] [REMOTE ] IEX: Full fetch complete (41263 records). [2025-09-15T18:55:30.727258] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-09-15T18:55:30.860264] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-09-15T18:55:31.162348] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-09-15T18:55:31.162431] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-09-15T18:55:31.163115] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-09-15T18:55:31.163188] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-09-15T18:55:31.164228] [DEBUG] [LOCAL ] IEX: Trimmed 41263 records to 28450 (keeping 150 days of data) [2025-09-15T18:55:31.297522] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-15T18:55:31.379840] [DEBUG] [LOCAL ] IEX: Primary data saved (28450 records). [2025-09-15T18:55:31.379989] [INFO ] [MAIN ] IEX: Full history saved. [2025-09-15T18:55:31.380110] [INFO ] [MAIN ] Update Progress: 1090/2369 symbols completed. IEX took 26.8s. Estimated remaining: 2h 15m 29s. Rate: 9.4 symbols/min [2025-09-15T18:55:31.547319] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:55:31.555837] [DEBUG] [LOCAL ] IGA: Loaded 6969 existing records from primary storage. [2025-09-15T18:55:31.555928] [INFO ] [MAIN ] IGA: Loaded 6969 existing records. [2025-09-15T18:55:31.662991] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-09-15T18:55:31.732081] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:55:31.732312] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-09-15T18:55:31.732357] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-09-15T18:55:31.732768] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-09-15T18:55:31.732821] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-09-15T18:55:32.090264] [INFO ] [REMOTE ] IGA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:55:32.179253] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T18:55:32.457897] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-09-15T18:55:32.490307] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-15T18:55:33.257842] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-09-15T18:55:33.446972] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T18:55:34.057894] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-09-15T18:55:34.143295] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-15T18:55:34.857928] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-09-15T18:55:35.325561] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-15T18:55:35.565062] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-15T18:55:35.657863] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-09-15T18:55:36.457881] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-09-15T18:55:36.661733] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-15T18:55:37.257883] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-09-15T18:55:37.917506] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-15T18:55:38.057872] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-09-15T18:55:38.391151] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-15T18:55:38.857908] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-09-15T18:55:39.390919] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-15T18:55:39.579592] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-15T18:55:39.581916] [INFO ] [REMOTE ] IFN: Full fetch complete (20535 records). [2025-09-15T18:55:39.582000] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-09-15T18:55:39.662945] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-09-15T18:55:39.953345] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-09-15T18:55:39.953427] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-09-15T18:55:39.953880] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-09-15T18:55:39.953922] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-09-15T18:55:39.954566] [DEBUG] [LOCAL ] IFN: Trimmed 20535 records to 13576 (keeping 150 days of data) [2025-09-15T18:55:40.047408] [DEBUG] [LOCAL ] IFN: Primary data saved (13576 records). [2025-09-15T18:55:40.047548] [INFO ] [MAIN ] IFN: Full history saved. [2025-09-15T18:55:40.047629] [INFO ] [MAIN ] Update Progress: 1091/2369 symbols completed. IFN took 26.5s. Estimated remaining: 2h 15m 26s. Rate: 9.4 symbols/min [2025-09-15T18:55:40.215597] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:55:40.229523] [DEBUG] [LOCAL ] IGD: Loaded 14033 existing records from primary storage. [2025-09-15T18:55:40.229677] [INFO ] [MAIN ] IGD: Loaded 14033 existing records. [2025-09-15T18:55:40.404485] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:55:40.404711] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-09-15T18:55:40.404758] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-09-15T18:55:40.405210] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-09-15T18:55:40.405258] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-09-15T18:55:40.466049] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-09-15T18:55:40.722716] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-15T18:55:40.776993] [INFO ] [REMOTE ] IGD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:55:41.257924] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-09-15T18:55:42.052508] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-15T18:55:42.057809] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-09-15T18:55:42.160300] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-15T18:55:42.167340] [INFO ] [REMOTE ] IFF: Full fetch complete (55350 records). [2025-09-15T18:55:42.167461] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-09-15T18:55:42.502928] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-15T18:55:42.558395] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-09-15T18:55:42.558491] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-09-15T18:55:42.559365] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-09-15T18:55:42.559420] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-09-15T18:55:42.560717] [DEBUG] [LOCAL ] IFF: Trimmed 55350 records to 37546 (keeping 150 days of data) [2025-09-15T18:55:42.793713] [DEBUG] [LOCAL ] IFF: Primary data saved (37546 records). [2025-09-15T18:55:42.793856] [INFO ] [MAIN ] IFF: Full history saved. [2025-09-15T18:55:42.793978] [INFO ] [MAIN ] Update Progress: 1092/2369 symbols completed. IFF took 33.5s. Estimated remaining: 2h 15m 15s. Rate: 9.4 symbols/min [2025-09-15T18:55:42.863064] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-09-15T18:55:42.964617] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:55:42.969535] [DEBUG] [LOCAL ] IGI: Loaded 2744 existing records from primary storage. [2025-09-15T18:55:42.969657] [INFO ] [MAIN ] IGI: Loaded 2744 existing records. [2025-09-15T18:55:43.147471] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:55:43.147760] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-09-15T18:55:43.147810] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-09-15T18:55:43.148075] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-09-15T18:55:43.148124] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-09-15T18:55:43.524721] [INFO ] [REMOTE ] IGI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:55:43.525612] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T18:55:43.657848] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-09-15T18:55:44.259091] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-15T18:55:44.457844] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-09-15T18:55:45.257949] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-09-15T18:55:45.424294] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-15T18:55:45.970157] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-15T18:55:46.057929] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-09-15T18:55:46.789759] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-15T18:55:46.792555] [INFO ] [REMOTE ] IFS: Full fetch complete (25038 records). [2025-09-15T18:55:46.792627] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-09-15T18:55:46.863054] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-09-15T18:55:47.161370] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-09-15T18:55:47.161453] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-09-15T18:55:47.161991] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-09-15T18:55:47.162040] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-09-15T18:55:47.162824] [DEBUG] [LOCAL ] IFS: Trimmed 25038 records to 16343 (keeping 150 days of data) [2025-09-15T18:55:47.261431] [DEBUG] [LOCAL ] IFS: Primary data saved (16343 records). [2025-09-15T18:55:47.261570] [INFO ] [MAIN ] IFS: Full history saved. [2025-09-15T18:55:47.261678] [INFO ] [MAIN ] Update Progress: 1093/2369 symbols completed. IFS took 23.2s. Estimated remaining: 2h 15m 7s. Rate: 9.4 symbols/min [2025-09-15T18:55:47.444702] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:55:47.452300] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-15T18:55:47.474037] [DEBUG] [LOCAL ] IGR: Loaded 22791 existing records from primary storage. [2025-09-15T18:55:47.474165] [INFO ] [MAIN ] IGR: Loaded 22791 existing records. [2025-09-15T18:55:47.651455] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:55:47.651754] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-09-15T18:55:47.651802] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-09-15T18:55:47.652347] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-09-15T18:55:47.652410] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-09-15T18:55:47.663673] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-09-15T18:55:48.010761] [INFO ] [REMOTE ] IGR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:55:48.164112] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-15T18:55:48.457883] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-09-15T18:55:49.257895] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-09-15T18:55:49.604945] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-15T18:55:50.057950] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-09-15T18:55:50.603515] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-15T18:55:50.655073] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-15T18:55:50.656747] [INFO ] [REMOTE ] IGA: Full fetch complete (10343 records). [2025-09-15T18:55:50.656817] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-09-15T18:55:50.862944] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-09-15T18:55:51.008814] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-09-15T18:55:51.008919] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-09-15T18:55:51.009164] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-09-15T18:55:51.009204] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-09-15T18:55:51.009665] [DEBUG] [LOCAL ] IGA: Trimmed 10343 records to 6917 (keeping 150 days of data) [2025-09-15T18:55:51.051369] [DEBUG] [LOCAL ] IGA: Primary data saved (6917 records). [2025-09-15T18:55:51.051492] [INFO ] [MAIN ] IGA: Full history saved. [2025-09-15T18:55:51.051573] [INFO ] [MAIN ] Update Progress: 1094/2369 symbols completed. IGA took 19.7s. Estimated remaining: 2h 14m 57s. Rate: 9.4 symbols/min [2025-09-15T18:55:51.223594] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:55:51.227137] [DEBUG] [LOCAL ] IH: Loaded 2015 existing records from primary storage. [2025-09-15T18:55:51.227214] [INFO ] [MAIN ] IH: Loaded 2015 existing records. [2025-09-15T18:55:51.402045] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:55:51.402282] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-09-15T18:55:51.402336] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-09-15T18:55:51.402540] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-09-15T18:55:51.402584] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-09-15T18:55:51.663454] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-09-15T18:55:51.767391] [INFO ] [REMOTE ] IH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:55:51.780569] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-15T18:55:52.073663] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-15T18:55:52.457875] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-09-15T18:55:52.895851] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-15T18:55:53.257931] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-09-15T18:55:54.057834] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-09-15T18:55:54.205310] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-15T18:55:54.450704] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-15T18:55:54.857875] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-09-15T18:55:55.304884] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-15T18:55:55.657874] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-09-15T18:55:55.994730] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-15T18:55:56.457876] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-09-15T18:55:57.141281] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-15T18:55:57.257851] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-09-15T18:55:58.057879] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-09-15T18:55:58.305058] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-15T18:55:58.744725] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-15T18:55:58.857844] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-09-15T18:55:59.524512] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-15T18:55:59.657879] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-09-15T18:56:00.457883] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-09-15T18:56:00.593563] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-15T18:56:01.090052] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-15T18:56:01.091288] [INFO ] [REMOTE ] IGI: Full fetch complete (3976 records). [2025-09-15T18:56:01.091375] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-09-15T18:56:01.262973] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-09-15T18:56:01.508388] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-09-15T18:56:01.508509] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-09-15T18:56:01.508749] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-09-15T18:56:01.508804] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-09-15T18:56:01.509556] [DEBUG] [LOCAL ] IGI: Trimmed 3976 records to 2713 (keeping 150 days of data) [2025-09-15T18:56:01.528710] [DEBUG] [LOCAL ] IGI: Primary data saved (2713 records). [2025-09-15T18:56:01.528848] [INFO ] [MAIN ] IGI: Full history saved. [2025-09-15T18:56:01.528946] [INFO ] [MAIN ] Update Progress: 1095/2369 symbols completed. IGI took 18.7s. Estimated remaining: 2h 14m 56s. Rate: 9.4 symbols/min [2025-09-15T18:56:01.703042] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:56:01.709409] [DEBUG] [LOCAL ] IHD: Loaded 5208 existing records from primary storage. [2025-09-15T18:56:01.709505] [INFO ] [MAIN ] IHD: Loaded 5208 existing records. [2025-09-15T18:56:01.889257] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:56:01.889551] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-09-15T18:56:01.889599] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-09-15T18:56:01.889875] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-09-15T18:56:01.889922] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-09-15T18:56:02.060326] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-09-15T18:56:02.236214] [INFO ] [REMOTE ] IHD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:56:02.417607] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-15T18:56:02.632149] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-15T18:56:02.857931] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-09-15T18:56:03.657888] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-09-15T18:56:03.689957] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-15T18:56:03.950496] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-15T18:56:04.457887] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-09-15T18:56:05.257883] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-09-15T18:56:05.340880] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-15T18:56:06.057913] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-09-15T18:56:06.136952] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-15T18:56:06.139147] [INFO ] [REMOTE ] IGD: Full fetch complete (21230 records). [2025-09-15T18:56:06.139224] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-09-15T18:56:06.514015] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-09-15T18:56:06.517996] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-09-15T18:56:06.518791] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-09-15T18:56:06.518863] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-09-15T18:56:06.518177] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-15T18:56:06.521346] [DEBUG] [LOCAL ] IGD: Trimmed 21230 records to 13795 (keeping 150 days of data) [2025-09-15T18:56:06.610486] [DEBUG] [LOCAL ] IGD: Primary data saved (13795 records). [2025-09-15T18:56:06.610718] [INFO ] [MAIN ] IGD: Full history saved. [2025-09-15T18:56:06.610806] [INFO ] [MAIN ] Update Progress: 1096/2369 symbols completed. IGD took 26.6s. Estimated remaining: 2h 14m 48s. Rate: 9.4 symbols/min [2025-09-15T18:56:06.779442] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:56:06.797825] [DEBUG] [LOCAL ] IHG: Loaded 18114 existing records from primary storage. [2025-09-15T18:56:06.797947] [INFO ] [MAIN ] IHG: Loaded 18114 existing records. [2025-09-15T18:56:06.863065] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-09-15T18:56:06.976459] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:56:06.976805] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-09-15T18:56:06.976854] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-09-15T18:56:06.977463] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-09-15T18:56:06.977519] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-09-15T18:56:07.326284] [INFO ] [REMOTE ] IHG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:56:07.519946] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-15T18:56:07.657884] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-09-15T18:56:08.021370] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-15T18:56:08.457905] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-09-15T18:56:09.203810] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-15T18:56:09.257847] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-09-15T18:56:09.789172] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-15T18:56:10.057878] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-09-15T18:56:10.509343] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-15T18:56:10.857879] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-09-15T18:56:11.437833] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-15T18:56:11.438763] [INFO ] [REMOTE ] IH: Full fetch complete (4220 records). [2025-09-15T18:56:11.438877] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-09-15T18:56:11.663079] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-09-15T18:56:11.800902] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-09-15T18:56:11.800987] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-09-15T18:56:11.801131] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-09-15T18:56:11.801170] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-09-15T18:56:11.801560] [DEBUG] [LOCAL ] IH: Trimmed 4220 records to 2002 (keeping 150 days of data) [2025-09-15T18:56:11.813569] [DEBUG] [LOCAL ] IH: Primary data saved (2002 records). [2025-09-15T18:56:11.813635] [INFO ] [MAIN ] IH: Full history saved. [2025-09-15T18:56:11.813741] [INFO ] [MAIN ] Update Progress: 1097/2369 symbols completed. IH took 20.8s. Estimated remaining: 2h 14m 40s. Rate: 9.4 symbols/min [2025-09-15T18:56:11.985550] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:56:12.018282] [DEBUG] [LOCAL ] IHS: Loaded 29543 existing records from primary storage. [2025-09-15T18:56:12.018488] [INFO ] [MAIN ] IHS: Loaded 29543 existing records. [2025-09-15T18:56:12.201072] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:56:12.201363] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-09-15T18:56:12.201413] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-09-15T18:56:12.202164] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-09-15T18:56:12.202229] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-09-15T18:56:12.463077] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-09-15T18:56:12.557459] [INFO ] [REMOTE ] IHS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:56:13.079794] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-15T18:56:13.260749] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-09-15T18:56:13.263062] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-15T18:56:14.057931] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-09-15T18:56:14.141998] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-15T18:56:14.857871] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-09-15T18:56:14.976589] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-15T18:56:15.657846] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-09-15T18:56:16.047388] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-15T18:56:16.074508] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-15T18:56:16.457884] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-09-15T18:56:17.257885] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-09-15T18:56:17.797260] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T18:56:18.057897] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-09-15T18:56:18.394756] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-15T18:56:18.857889] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-09-15T18:56:19.439929] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-15T18:56:19.657885] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-09-15T18:56:20.248366] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-15T18:56:20.442342] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-15T18:56:20.457827] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-09-15T18:56:21.257889] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-09-15T18:56:21.721223] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-15T18:56:21.830299] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-15T18:56:22.057853] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-09-15T18:56:22.857898] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-09-15T18:56:23.305934] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-15T18:56:23.306691] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-15T18:56:23.657946] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-09-15T18:56:24.391158] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-15T18:56:24.393000] [INFO ] [REMOTE ] IHD: Full fetch complete (8120 records). [2025-09-15T18:56:24.393127] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-09-15T18:56:24.463004] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-09-15T18:56:24.764845] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-09-15T18:56:24.764934] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-09-15T18:56:24.765167] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-09-15T18:56:24.765216] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-09-15T18:56:24.765625] [DEBUG] [LOCAL ] IHD: Trimmed 8120 records to 5148 (keeping 150 days of data) [2025-09-15T18:56:24.796911] [DEBUG] [LOCAL ] IHD: Primary data saved (5148 records). [2025-09-15T18:56:24.797033] [INFO ] [MAIN ] IHD: Full history saved. [2025-09-15T18:56:24.797144] [INFO ] [MAIN ] Update Progress: 1098/2369 symbols completed. IHD took 23.3s. Estimated remaining: 2h 14m 41s. Rate: 9.4 symbols/min [2025-09-15T18:56:25.001023] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:56:25.007390] [DEBUG] [LOCAL ] IIF: Loaded 4212 existing records from primary storage. [2025-09-15T18:56:25.007507] [INFO ] [MAIN ] IIF: Loaded 4212 existing records. [2025-09-15T18:56:25.185442] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:56:25.185803] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-09-15T18:56:25.185871] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-09-15T18:56:25.186249] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-09-15T18:56:25.186323] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-09-15T18:56:25.262999] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-09-15T18:56:25.557842] [INFO ] [REMOTE ] IIF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:56:25.578398] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-15T18:56:26.057893] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-09-15T18:56:26.658416] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-15T18:56:26.857838] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-09-15T18:56:27.236847] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-15T18:56:27.240330] [INFO ] [REMOTE ] IGR: Full fetch complete (33353 records). [2025-09-15T18:56:27.240411] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-09-15T18:56:27.615452] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-09-15T18:56:27.615548] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-09-15T18:56:27.616207] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-09-15T18:56:27.616317] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-09-15T18:56:27.617346] [DEBUG] [LOCAL ] IGR: Trimmed 33353 records to 22380 (keeping 150 days of data) [2025-09-15T18:56:27.669639] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-09-15T18:56:27.760274] [DEBUG] [LOCAL ] IGR: Primary data saved (22380 records). [2025-09-15T18:56:27.760433] [INFO ] [MAIN ] IGR: Full history saved. [2025-09-15T18:56:27.760552] [INFO ] [MAIN ] Update Progress: 1099/2369 symbols completed. IGR took 40.5s. Estimated remaining: 2h 14m 31s. Rate: 9.4 symbols/min [2025-09-15T18:56:27.956154] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:56:27.968492] [DEBUG] [LOCAL ] IIIN: Loaded 12082 existing records from primary storage. [2025-09-15T18:56:27.968613] [INFO ] [MAIN ] IIIN: Loaded 12082 existing records. [2025-09-15T18:56:28.150155] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:56:28.150401] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-09-15T18:56:28.150449] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-09-15T18:56:28.150917] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-09-15T18:56:28.150970] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-09-15T18:56:28.463057] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-09-15T18:56:28.522622] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:56:28.545730] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T18:56:28.697992] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-15T18:56:29.257879] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-09-15T18:56:29.679965] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T18:56:30.057883] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-09-15T18:56:30.457070] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-15T18:56:30.857882] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-09-15T18:56:31.239907] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-15T18:56:31.602032] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-15T18:56:31.657855] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-09-15T18:56:32.457839] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-09-15T18:56:32.926452] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-15T18:56:33.257881] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-09-15T18:56:33.495325] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T18:56:33.498145] [INFO ] [REMOTE ] IHG: Full fetch complete (27427 records). [2025-09-15T18:56:33.498229] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-09-15T18:56:33.864276] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-09-15T18:56:33.864360] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-09-15T18:56:33.864954] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-09-15T18:56:33.865011] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-09-15T18:56:33.865757] [DEBUG] [LOCAL ] IHG: Trimmed 27427 records to 17602 (keeping 150 days of data) [2025-09-15T18:56:33.984836] [DEBUG] [LOCAL ] IHG: Primary data saved (17602 records). [2025-09-15T18:56:33.984967] [INFO ] [MAIN ] IHG: Full history saved. [2025-09-15T18:56:33.985056] [INFO ] [MAIN ] Update Progress: 1100/2369 symbols completed. IHG took 27.4s. Estimated remaining: 2h 14m 25s. Rate: 9.4 symbols/min [2025-09-15T18:56:34.063102] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-09-15T18:56:34.157351] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:56:34.169856] [DEBUG] [LOCAL ] IIM: Loaded 11433 existing records from primary storage. [2025-09-15T18:56:34.169973] [INFO ] [MAIN ] IIM: Loaded 11433 existing records. [2025-09-15T18:56:34.344609] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:56:34.344856] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-09-15T18:56:34.344910] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-09-15T18:56:34.345311] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-09-15T18:56:34.345356] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-09-15T18:56:34.640017] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-15T18:56:34.693746] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-15T18:56:34.736277] [INFO ] [REMOTE ] IIM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:56:34.857863] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-09-15T18:56:35.657873] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-09-15T18:56:35.700921] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-15T18:56:36.418027] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-15T18:56:36.457820] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-09-15T18:56:36.823877] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-15T18:56:37.257890] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-09-15T18:56:38.057880] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-09-15T18:56:38.264495] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-15T18:56:38.857914] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-09-15T18:56:38.952080] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-15T18:56:39.478774] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-15T18:56:39.657929] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-09-15T18:56:40.457908] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-09-15T18:56:40.911098] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-15T18:56:40.915695] [INFO ] [REMOTE ] IHS: Full fetch complete (41335 records). [2025-09-15T18:56:40.915856] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-09-15T18:56:41.050614] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-15T18:56:41.272280] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-09-15T18:56:41.321687] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-09-15T18:56:41.321787] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-09-15T18:56:41.322550] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-09-15T18:56:41.322591] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-09-15T18:56:41.323624] [DEBUG] [LOCAL ] IHS: Trimmed 41335 records to 29102 (keeping 150 days of data) [2025-09-15T18:56:41.496310] [DEBUG] [LOCAL ] IHS: Primary data saved (29102 records). [2025-09-15T18:56:41.496447] [INFO ] [MAIN ] IHS: Full history saved. [2025-09-15T18:56:41.496541] [INFO ] [MAIN ] Update Progress: 1101/2369 symbols completed. IHS took 29.7s. Estimated remaining: 2h 14m 20s. Rate: 9.4 symbols/min [2025-09-15T18:56:41.669738] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:56:41.689843] [DEBUG] [LOCAL ] IIPR: Loaded 20957 existing records from primary storage. [2025-09-15T18:56:41.689998] [INFO ] [MAIN ] IIPR: Loaded 20957 existing records. [2025-09-15T18:56:41.871403] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:56:41.871697] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-09-15T18:56:41.871746] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-09-15T18:56:41.872321] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-09-15T18:56:41.872368] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-09-15T18:56:42.059168] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-09-15T18:56:42.060379] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-15T18:56:42.254544] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:56:42.857899] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-09-15T18:56:43.085313] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-15T18:56:43.510506] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-15T18:56:43.657928] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-09-15T18:56:44.262013] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-15T18:56:44.457945] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-09-15T18:56:45.150333] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-15T18:56:45.257892] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-09-15T18:56:46.057871] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-09-15T18:56:46.520907] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-15T18:56:46.832936] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-15T18:56:46.857823] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-09-15T18:56:47.657886] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-09-15T18:56:47.734828] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-15T18:56:48.457878] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-09-15T18:56:48.556629] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-15T18:56:49.231723] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T18:56:49.234262] [INFO ] [REMOTE ] IIM: Full fetch complete (18388 records). [2025-09-15T18:56:49.234338] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-09-15T18:56:49.263130] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-09-15T18:56:49.597740] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-09-15T18:56:49.597823] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-09-15T18:56:49.598246] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-09-15T18:56:49.598288] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-09-15T18:56:49.598918] [DEBUG] [LOCAL ] IIM: Trimmed 18388 records to 11317 (keeping 150 days of data) [2025-09-15T18:56:49.670522] [DEBUG] [LOCAL ] IIM: Primary data saved (11317 records). [2025-09-15T18:56:49.670682] [INFO ] [MAIN ] IIM: Full history saved. [2025-09-15T18:56:49.670768] [INFO ] [MAIN ] Update Progress: 1102/2369 symbols completed. IIM took 15.7s. Estimated remaining: 2h 14m 15s. Rate: 9.4 symbols/min [2025-09-15T18:56:49.837468] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:56:49.872078] [DEBUG] [LOCAL ] IMAX: Loaded 32221 existing records from primary storage. [2025-09-15T18:56:49.872224] [INFO ] [MAIN ] IMAX: Loaded 32221 existing records. [2025-09-15T18:56:50.046219] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:56:50.046477] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-09-15T18:56:50.046526] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-09-15T18:56:50.047279] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-09-15T18:56:50.047330] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-09-15T18:56:50.067667] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-09-15T18:56:50.405474] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:56:50.681203] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-15T18:56:50.857894] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-09-15T18:56:51.137206] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-15T18:56:51.657913] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-09-15T18:56:52.017720] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T18:56:52.030346] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-15T18:56:52.031557] [INFO ] [REMOTE ] IIF: Full fetch complete (6530 records). [2025-09-15T18:56:52.031659] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-09-15T18:56:52.399036] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-09-15T18:56:52.399148] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-09-15T18:56:52.399361] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-09-15T18:56:52.399400] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-09-15T18:56:52.399809] [DEBUG] [LOCAL ] IIF: Trimmed 6530 records to 4027 (keeping 150 days of data) [2025-09-15T18:56:52.423848] [DEBUG] [LOCAL ] IIF: Primary data saved (4027 records). [2025-09-15T18:56:52.423955] [INFO ] [MAIN ] IIF: Full history saved. [2025-09-15T18:56:52.424048] [INFO ] [MAIN ] Update Progress: 1103/2369 symbols completed. IIF took 27.6s. Estimated remaining: 2h 14m 5s. Rate: 9.4 symbols/min [2025-09-15T18:56:52.463819] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-09-15T18:56:52.599640] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:56:52.635560] [DEBUG] [LOCAL ] INFA: Loaded 37626 existing records from primary storage. [2025-09-15T18:56:52.635754] [INFO ] [MAIN ] INFA: Loaded 37626 existing records. [2025-09-15T18:56:52.815869] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:56:52.816139] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-09-15T18:56:52.816188] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-09-15T18:56:52.816987] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-09-15T18:56:52.817040] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-09-15T18:56:53.183682] [INFO ] [REMOTE ] INFA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:56:53.257857] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-09-15T18:56:53.699122] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-15T18:56:54.057918] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-09-15T18:56:54.758478] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-15T18:56:54.857856] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-09-15T18:56:55.214625] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-15T18:56:55.657927] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-09-15T18:56:55.677810] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-15T18:56:56.457874] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-09-15T18:56:56.999478] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T18:56:57.173152] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-15T18:56:57.257870] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-09-15T18:56:58.057885] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-09-15T18:56:58.416248] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-15T18:56:58.857863] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-09-15T18:56:58.926915] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-15T18:56:58.928686] [INFO ] [REMOTE ] IIIN: Full fetch complete (18462 records). [2025-09-15T18:56:58.928756] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-09-15T18:56:59.289814] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-09-15T18:56:59.289894] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-09-15T18:56:59.290339] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-09-15T18:56:59.290379] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-09-15T18:56:59.290967] [DEBUG] [LOCAL ] IIIN: Trimmed 18462 records to 11671 (keeping 150 days of data) [2025-09-15T18:56:59.367251] [DEBUG] [LOCAL ] IIIN: Primary data saved (11671 records). [2025-09-15T18:56:59.367408] [INFO ] [MAIN ] IIIN: Full history saved. [2025-09-15T18:56:59.367508] [INFO ] [MAIN ] Update Progress: 1104/2369 symbols completed. IIIN took 31.6s. Estimated remaining: 2h 13m 59s. Rate: 9.4 symbols/min [2025-09-15T18:56:59.540707] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:56:59.582549] [DEBUG] [LOCAL ] INFY: Loaded 40348 existing records from primary storage. [2025-09-15T18:56:59.582732] [INFO ] [MAIN ] INFY: Loaded 40348 existing records. [2025-09-15T18:56:59.662980] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-09-15T18:56:59.762773] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:56:59.763018] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-09-15T18:56:59.763064] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-09-15T18:56:59.763788] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-09-15T18:56:59.763845] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-09-15T18:57:00.120374] [INFO ] [REMOTE ] INFY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:57:00.331219] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T18:57:00.457847] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-09-15T18:57:00.603986] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T18:57:01.257895] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-09-15T18:57:01.575480] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-15T18:57:02.057915] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-09-15T18:57:02.577011] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-15T18:57:02.857909] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-09-15T18:57:03.267222] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-15T18:57:03.657905] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-09-15T18:57:04.239140] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-15T18:57:04.457873] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-09-15T18:57:05.136937] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-15T18:57:05.257917] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-09-15T18:57:05.936972] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-15T18:57:06.057858] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-09-15T18:57:06.857908] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-09-15T18:57:07.203615] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-15T18:57:07.249749] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-15T18:57:07.657869] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-09-15T18:57:08.390096] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-15T18:57:08.457915] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-09-15T18:57:09.119780] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T18:57:09.257867] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-09-15T18:57:09.420521] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-15T18:57:09.423673] [INFO ] [REMOTE ] IIPR: Full fetch complete (32098 records). [2025-09-15T18:57:09.423771] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-09-15T18:57:09.791420] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-09-15T18:57:09.791516] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-09-15T18:57:09.792110] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-09-15T18:57:09.792161] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-09-15T18:57:09.792961] [DEBUG] [LOCAL ] IIPR: Trimmed 32098 records to 20582 (keeping 150 days of data) [2025-09-15T18:57:09.923448] [DEBUG] [LOCAL ] IIPR: Primary data saved (20582 records). [2025-09-15T18:57:09.923582] [INFO ] [MAIN ] IIPR: Full history saved. [2025-09-15T18:57:09.923679] [INFO ] [MAIN ] Update Progress: 1105/2369 symbols completed. IIPR took 28.4s. Estimated remaining: 2h 13m 58s. Rate: 9.4 symbols/min [2025-09-15T18:57:10.063191] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-09-15T18:57:10.100454] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:57:10.144569] [DEBUG] [LOCAL ] ING: Loaded 38033 existing records from primary storage. [2025-09-15T18:57:10.145423] [INFO ] [MAIN ] ING: Loaded 38033 existing records. [2025-09-15T18:57:10.336575] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:57:10.336936] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-09-15T18:57:10.336989] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-09-15T18:57:10.337910] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-09-15T18:57:10.337973] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-09-15T18:57:10.708945] [INFO ] [REMOTE ] ING: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:57:10.723230] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T18:57:10.728820] [INFO ] [REMOTE ] IMAX: Full fetch complete (46194 records). [2025-09-15T18:57:10.728941] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-09-15T18:57:10.873188] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-09-15T18:57:11.119181] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-09-15T18:57:11.119264] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-09-15T18:57:11.120114] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-09-15T18:57:11.120168] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-09-15T18:57:11.121761] [DEBUG] [LOCAL ] IMAX: Trimmed 46194 records to 31543 (keeping 150 days of data) [2025-09-15T18:57:11.319568] [DEBUG] [LOCAL ] IMAX: Primary data saved (31543 records). [2025-09-15T18:57:11.319753] [INFO ] [MAIN ] IMAX: Full history saved. [2025-09-15T18:57:11.319865] [INFO ] [MAIN ] Update Progress: 1106/2369 symbols completed. IMAX took 21.6s. Estimated remaining: 2h 13m 46s. Rate: 9.4 symbols/min [2025-09-15T18:57:11.500827] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:57:11.531681] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T18:57:11.558896] [DEBUG] [LOCAL ] INGM: Loaded 20645 existing records from primary storage. [2025-09-15T18:57:11.559062] [INFO ] [MAIN ] INGM: Loaded 20645 existing records. [2025-09-15T18:57:11.662344] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-09-15T18:57:11.750087] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:57:11.750353] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-09-15T18:57:11.750402] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-09-15T18:57:11.751133] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-09-15T18:57:11.751190] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-09-15T18:57:12.113191] [INFO ] [REMOTE ] INGM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:57:12.457903] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-09-15T18:57:12.553520] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T18:57:13.257886] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-09-15T18:57:13.343979] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-15T18:57:13.652002] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-15T18:57:14.057938] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-09-15T18:57:14.672605] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-15T18:57:14.857885] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-09-15T18:57:15.574517] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-15T18:57:15.657902] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-09-15T18:57:16.238735] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-15T18:57:16.457884] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-09-15T18:57:17.216849] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-15T18:57:17.257833] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-09-15T18:57:17.313632] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T18:57:18.057869] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-09-15T18:57:18.833433] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T18:57:18.857833] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-09-15T18:57:18.907440] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-15T18:57:19.657883] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-09-15T18:57:20.457875] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-09-15T18:57:20.627487] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-15T18:57:20.635329] [INFO ] [REMOTE ] INFY: Full fetch complete (58272 records). [2025-09-15T18:57:20.635451] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-09-15T18:57:21.020248] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-09-15T18:57:21.020377] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-09-15T18:57:21.021224] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-09-15T18:57:21.021334] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-09-15T18:57:21.033140] [DEBUG] [LOCAL ] INFY: Trimmed 58272 records to 39568 (keeping 150 days of data) [2025-09-15T18:57:21.051630] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-15T18:57:21.268948] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-09-15T18:57:21.303761] [DEBUG] [LOCAL ] INFY: Primary data saved (39568 records). [2025-09-15T18:57:21.303891] [INFO ] [MAIN ] INFY: Full history saved. [2025-09-15T18:57:21.304453] [INFO ] [MAIN ] Update Progress: 1107/2369 symbols completed. INFY took 21.9s. Estimated remaining: 2h 13m 43s. Rate: 9.4 symbols/min [2025-09-15T18:57:21.475960] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:57:21.502497] [DEBUG] [LOCAL ] INGR: Loaded 24281 existing records from primary storage. [2025-09-15T18:57:21.502670] [INFO ] [MAIN ] INGR: Loaded 24281 existing records. [2025-09-15T18:57:21.717627] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:57:21.718108] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-09-15T18:57:21.718168] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-09-15T18:57:21.719093] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-09-15T18:57:21.719155] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-09-15T18:57:21.868248] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-15T18:57:22.062898] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-09-15T18:57:22.132290] [INFO ] [REMOTE ] INGR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:57:22.498423] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T18:57:22.857887] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-09-15T18:57:23.335628] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-15T18:57:23.657879] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-09-15T18:57:24.101571] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T18:57:24.457933] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-09-15T18:57:24.476519] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T18:57:25.257876] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-09-15T18:57:25.752558] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T18:57:26.057892] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-09-15T18:57:26.226663] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-15T18:57:26.857873] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-09-15T18:57:27.657856] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-09-15T18:57:27.740291] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T18:57:28.457866] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-09-15T18:57:28.596206] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-15T18:57:29.230184] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T18:57:29.235598] [INFO ] [REMOTE ] INFA: Full fetch complete (54700 records). [2025-09-15T18:57:29.235730] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-09-15T18:57:29.267438] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-09-15T18:57:29.624046] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-09-15T18:57:29.624162] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-09-15T18:57:29.625062] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-09-15T18:57:29.625113] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-09-15T18:57:29.626372] [DEBUG] [LOCAL ] INFA: Trimmed 54700 records to 36912 (keeping 150 days of data) [2025-09-15T18:57:29.856585] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T18:57:29.881292] [DEBUG] [LOCAL ] INFA: Primary data saved (36912 records). [2025-09-15T18:57:29.881416] [INFO ] [MAIN ] INFA: Full history saved. [2025-09-15T18:57:29.881492] [INFO ] [MAIN ] Update Progress: 1108/2369 symbols completed. INFA took 37.5s. Estimated remaining: 2h 13m 40s. Rate: 9.4 symbols/min [2025-09-15T18:57:30.056106] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:57:30.057868] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-09-15T18:57:30.087690] [DEBUG] [LOCAL ] INN: Loaded 31920 existing records from primary storage. [2025-09-15T18:57:30.087830] [INFO ] [MAIN ] INN: Loaded 31920 existing records. [2025-09-15T18:57:30.267196] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:57:30.267486] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-09-15T18:57:30.267543] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-09-15T18:57:30.268271] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-09-15T18:57:30.268323] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-09-15T18:57:30.663027] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T18:57:30.682158] [INFO ] [REMOTE ] INN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:57:30.857871] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-09-15T18:57:31.389022] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T18:57:31.657875] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-09-15T18:57:31.877580] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-15T18:57:32.457864] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-09-15T18:57:32.489016] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-15T18:57:33.257943] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-09-15T18:57:33.826924] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-15T18:57:34.057853] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-09-15T18:57:34.352971] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-15T18:57:34.356225] [INFO ] [REMOTE ] INGM: Full fetch complete (31575 records). [2025-09-15T18:57:34.356317] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-09-15T18:57:34.747468] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-09-15T18:57:34.747556] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-09-15T18:57:34.748211] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-09-15T18:57:34.748257] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-09-15T18:57:34.749049] [DEBUG] [LOCAL ] INGM: Trimmed 31575 records to 20005 (keeping 150 days of data) [2025-09-15T18:57:34.863845] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-09-15T18:57:34.896487] [DEBUG] [LOCAL ] INGM: Primary data saved (20005 records). [2025-09-15T18:57:34.896888] [INFO ] [MAIN ] INGM: Full history saved. [2025-09-15T18:57:34.897031] [INFO ] [MAIN ] Update Progress: 1109/2369 symbols completed. INGM took 23.6s. Estimated remaining: 2h 13m 32s. Rate: 9.4 symbols/min [2025-09-15T18:57:35.121614] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:57:35.151629] [DEBUG] [LOCAL ] INR: Loaded 19412 existing records from primary storage. [2025-09-15T18:57:35.151900] [INFO ] [MAIN ] INR: Loaded 19412 existing records. [2025-09-15T18:57:35.415290] [WARN ] [MAIN ] INR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:57:35.416010] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-09-15T18:57:35.416091] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-15T18:57:35.429820] [DEBUG] [LOCAL ] INR: Deleted primary data file. [2025-09-15T18:57:35.449388] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-09-15T18:57:35.455710] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-15T18:57:35.671213] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-09-15T18:57:35.974032] [INFO ] [REMOTE ] INR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:57:36.428252] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-15T18:57:36.434119] [INFO ] [REMOTE ] ING: Full fetch complete (55236 records). [2025-09-15T18:57:36.434270] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-09-15T18:57:36.467534] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-09-15T18:57:36.825026] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-09-15T18:57:36.825111] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-09-15T18:57:36.825919] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-09-15T18:57:36.825980] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-09-15T18:57:36.827210] [DEBUG] [LOCAL ] ING: Trimmed 55236 records to 37270 (keeping 150 days of data) [2025-09-15T18:57:37.067750] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T18:57:37.104875] [DEBUG] [LOCAL ] ING: Primary data saved (37270 records). [2025-09-15T18:57:37.105054] [INFO ] [MAIN ] ING: Full history saved. [2025-09-15T18:57:37.106214] [INFO ] [MAIN ] Update Progress: 1110/2369 symbols completed. ING took 27.2s. Estimated remaining: 2h 13m 21s. Rate: 9.4 symbols/min [2025-09-15T18:57:37.273538] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-09-15T18:57:37.277042] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:57:37.311837] [DEBUG] [LOCAL ] INSP: Loaded 28161 existing records from primary storage. [2025-09-15T18:57:37.311992] [INFO ] [MAIN ] INSP: Loaded 28161 existing records. [2025-09-15T18:57:37.491056] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:57:37.491364] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-09-15T18:57:37.491414] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-09-15T18:57:37.492193] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-09-15T18:57:37.492263] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-09-15T18:57:37.855434] [INFO ] [REMOTE ] INSP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:57:37.877608] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T18:57:38.057917] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-09-15T18:57:38.305080] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-15T18:57:38.857914] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-09-15T18:57:39.364435] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T18:57:39.658127] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-09-15T18:57:39.987825] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-15T18:57:40.457873] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-09-15T18:57:41.175180] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-15T18:57:41.257861] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-09-15T18:57:41.393224] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-15T18:57:42.057933] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-09-15T18:57:42.348898] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-15T18:57:42.857940] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-09-15T18:57:43.280145] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-15T18:57:43.657906] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-09-15T18:57:43.751910] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-15T18:57:44.457906] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-09-15T18:57:44.655348] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-15T18:57:44.659596] [INFO ] [REMOTE ] INGR: Full fetch complete (36768 records). [2025-09-15T18:57:44.659734] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-09-15T18:57:45.034754] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-09-15T18:57:45.034839] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-09-15T18:57:45.035480] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-09-15T18:57:45.035520] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-09-15T18:57:45.036360] [DEBUG] [LOCAL ] INGR: Trimmed 36768 records to 23872 (keeping 150 days of data) [2025-09-15T18:57:45.182693] [DEBUG] [LOCAL ] INGR: Primary data saved (23872 records). [2025-09-15T18:57:45.182827] [INFO ] [MAIN ] INGR: Full history saved. [2025-09-15T18:57:45.182928] [INFO ] [MAIN ] Update Progress: 1111/2369 symbols completed. INGR took 23.9s. Estimated remaining: 2h 13m 16s. Rate: 9.4 symbols/min [2025-09-15T18:57:45.263110] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-09-15T18:57:45.353110] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:57:45.382217] [DEBUG] [LOCAL ] INSW: Loaded 29866 existing records from primary storage. [2025-09-15T18:57:45.382353] [INFO ] [MAIN ] INSW: Loaded 29866 existing records. [2025-09-15T18:57:45.560007] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:57:45.560226] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-09-15T18:57:45.560316] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-09-15T18:57:45.561141] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-09-15T18:57:45.561193] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-09-15T18:57:45.921672] [INFO ] [REMOTE ] INSW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:57:45.946101] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T18:57:46.057887] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-09-15T18:57:46.511152] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-15T18:57:46.857947] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-09-15T18:57:47.155668] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-15T18:57:47.657878] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-09-15T18:57:48.245043] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-15T18:57:48.361247] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-15T18:57:48.457871] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-09-15T18:57:49.257889] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-09-15T18:57:49.505821] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-15T18:57:50.057872] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-09-15T18:57:50.519421] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-15T18:57:50.857941] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-09-15T18:57:51.109218] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-15T18:57:51.657956] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-09-15T18:57:52.230408] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-15T18:57:52.457865] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-09-15T18:57:52.590964] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-15T18:57:53.257889] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-09-15T18:57:53.600466] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-15T18:57:54.057821] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-09-15T18:57:54.458827] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-15T18:57:54.465143] [INFO ] [REMOTE ] INN: Full fetch complete (45030 records). [2025-09-15T18:57:54.465338] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-09-15T18:57:54.849064] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-09-15T18:57:54.849144] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-09-15T18:57:54.849855] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-09-15T18:57:54.849899] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-09-15T18:57:54.850867] [DEBUG] [LOCAL ] INN: Trimmed 45030 records to 31262 (keeping 150 days of data) [2025-09-15T18:57:54.902228] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-09-15T18:57:55.039955] [DEBUG] [LOCAL ] INN: Primary data saved (31262 records). [2025-09-15T18:57:55.040092] [INFO ] [MAIN ] INN: Full history saved. [2025-09-15T18:57:55.040174] [INFO ] [MAIN ] Update Progress: 1112/2369 symbols completed. INN took 25.2s. Estimated remaining: 2h 13m 14s. Rate: 9.4 symbols/min [2025-09-15T18:57:55.217376] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:57:55.280873] [DEBUG] [LOCAL ] INVH: Loaded 39992 existing records from primary storage. [2025-09-15T18:57:55.282572] [INFO ] [MAIN ] INVH: Loaded 39992 existing records. [2025-09-15T18:57:55.282340] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T18:57:55.473990] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:57:55.474355] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-09-15T18:57:55.474415] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-09-15T18:57:55.475338] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-09-15T18:57:55.475389] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-09-15T18:57:55.663584] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-09-15T18:57:55.846526] [INFO ] [REMOTE ] INVH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:57:56.231793] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-15T18:57:56.457901] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-09-15T18:57:56.903423] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-15T18:57:56.906863] [INFO ] [REMOTE ] INR: Full fetch complete (29767 records). [2025-09-15T18:57:56.906945] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-09-15T18:57:57.272321] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-09-15T18:57:57.287964] [DEBUG] [VALIDATOR ] INR: All expected trading days are present. [2025-09-15T18:57:57.288093] [DEBUG] [VALIDATOR ] INR: Primary data validation passed. [2025-09-15T18:57:57.288984] [INFO ] [MAIN ] INR: Fetched primary data is valid. [2025-09-15T18:57:57.289038] [DEBUG] [LOCAL ] INR: Saving primary data. [2025-09-15T18:57:57.290404] [DEBUG] [LOCAL ] INR: Trimmed 29767 records to 19051 (keeping 150 days of data) [2025-09-15T18:57:57.414580] [DEBUG] [LOCAL ] INR: Primary data saved (19051 records). [2025-09-15T18:57:57.414827] [INFO ] [MAIN ] INR: Full history saved. [2025-09-15T18:57:57.414954] [INFO ] [MAIN ] Update Progress: 1113/2369 symbols completed. INR took 22.5s. Estimated remaining: 2h 13m 3s. Rate: 9.4 symbols/min [2025-09-15T18:57:57.593821] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:57:57.617843] [DEBUG] [LOCAL ] INVX: Loaded 21811 existing records from primary storage. [2025-09-15T18:57:57.618104] [INFO ] [MAIN ] INVX: Loaded 21811 existing records. [2025-09-15T18:57:57.802427] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:57:57.803033] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-09-15T18:57:57.803105] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-09-15T18:57:57.803862] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-09-15T18:57:57.803928] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-09-15T18:57:57.950612] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-15T18:57:58.066994] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-09-15T18:57:58.225385] [INFO ] [REMOTE ] INVX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:57:58.810254] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-15T18:57:58.857816] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-09-15T18:57:59.243793] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-15T18:57:59.657845] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-09-15T18:58:00.140943] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T18:58:00.457909] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-09-15T18:58:01.257908] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-09-15T18:58:01.304238] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T18:58:02.005249] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T18:58:02.057887] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-09-15T18:58:02.478632] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-15T18:58:02.483841] [INFO ] [REMOTE ] INSP: Full fetch complete (39673 records). [2025-09-15T18:58:02.483936] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-09-15T18:58:02.857819] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-09-15T18:58:02.858206] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-09-15T18:58:02.858029] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-09-15T18:58:02.858994] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-09-15T18:58:02.859051] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-09-15T18:58:02.860761] [DEBUG] [LOCAL ] INSP: Trimmed 39673 records to 27714 (keeping 150 days of data) [2025-09-15T18:58:03.032420] [DEBUG] [LOCAL ] INSP: Primary data saved (27714 records). [2025-09-15T18:58:03.032593] [INFO ] [MAIN ] INSP: Full history saved. [2025-09-15T18:58:03.032735] [INFO ] [MAIN ] Update Progress: 1114/2369 symbols completed. INSP took 25.9s. Estimated remaining: 2h 12m 56s. Rate: 9.4 symbols/min [2025-09-15T18:58:03.203323] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:58:03.242760] [DEBUG] [LOCAL ] IONQ: Loaded 40528 existing records from primary storage. [2025-09-15T18:58:03.242927] [INFO ] [MAIN ] IONQ: Loaded 40528 existing records. [2025-09-15T18:58:03.421729] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:58:03.422022] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-09-15T18:58:03.422075] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-09-15T18:58:03.422891] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-09-15T18:58:03.422942] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-09-15T18:58:03.668768] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-09-15T18:58:03.777486] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:58:03.814173] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T18:58:04.230239] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T18:58:04.457887] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-09-15T18:58:05.137703] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-15T18:58:05.257882] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-09-15T18:58:06.060281] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-09-15T18:58:06.063279] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-15T18:58:06.857948] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-09-15T18:58:07.555440] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-15T18:58:07.612818] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-15T18:58:07.617168] [INFO ] [REMOTE ] INSW: Full fetch complete (44660 records). [2025-09-15T18:58:07.617257] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-09-15T18:58:07.662952] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-09-15T18:58:08.002983] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-09-15T18:58:08.003145] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-09-15T18:58:08.003847] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-09-15T18:58:08.004008] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-09-15T18:58:08.005110] [DEBUG] [LOCAL ] INSW: Trimmed 44660 records to 29210 (keeping 150 days of data) [2025-09-15T18:58:08.189902] [DEBUG] [LOCAL ] INSW: Primary data saved (29210 records). [2025-09-15T18:58:08.190046] [INFO ] [MAIN ] INSW: Full history saved. [2025-09-15T18:58:08.190132] [INFO ] [MAIN ] Update Progress: 1115/2369 symbols completed. INSW took 23.0s. Estimated remaining: 2h 12m 48s. Rate: 9.4 symbols/min [2025-09-15T18:58:08.359740] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:58:08.398935] [DEBUG] [LOCAL ] IOT: Loaded 40234 existing records from primary storage. [2025-09-15T18:58:08.399075] [INFO ] [MAIN ] IOT: Loaded 40234 existing records. [2025-09-15T18:58:08.467715] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-09-15T18:58:08.583537] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:58:08.584159] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-09-15T18:58:08.584319] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-09-15T18:58:08.595002] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-09-15T18:58:08.612883] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-09-15T18:58:08.626079] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-15T18:58:08.743423] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-15T18:58:08.997732] [INFO ] [REMOTE ] IOT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:58:09.257846] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-09-15T18:58:10.057936] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-09-15T18:58:10.701998] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T18:58:10.857833] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-09-15T18:58:10.951898] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-09-15T18:58:11.251831] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T18:58:11.657874] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-09-15T18:58:12.021142] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-15T18:58:12.457964] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-09-15T18:58:13.257906] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-09-15T18:58:13.573593] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-15T18:58:13.871205] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T18:58:13.877023] [INFO ] [REMOTE ] INVH: Full fetch complete (57706 records). [2025-09-15T18:58:13.877122] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-09-15T18:58:14.069321] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-09-15T18:58:14.266608] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-09-15T18:58:14.266703] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-09-15T18:58:14.267484] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-09-15T18:58:14.267525] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-09-15T18:58:14.268617] [DEBUG] [LOCAL ] INVH: Trimmed 57706 records to 39223 (keeping 150 days of data) [2025-09-15T18:58:14.509116] [DEBUG] [LOCAL ] INVH: Primary data saved (39223 records). [2025-09-15T18:58:14.509280] [INFO ] [MAIN ] INVH: Full history saved. [2025-09-15T18:58:14.509397] [INFO ] [MAIN ] Update Progress: 1116/2369 symbols completed. INVH took 19.5s. Estimated remaining: 2h 12m 42s. Rate: 9.4 symbols/min [2025-09-15T18:58:14.678330] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:58:14.714798] [DEBUG] [LOCAL ] IP: Loaded 40086 existing records from primary storage. [2025-09-15T18:58:14.714941] [INFO ] [MAIN ] IP: Loaded 40086 existing records. [2025-09-15T18:58:14.862988] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-09-15T18:58:14.900265] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:58:14.900479] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-09-15T18:58:14.900544] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-09-15T18:58:14.901615] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-09-15T18:58:14.901706] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-09-15T18:58:15.251576] [INFO ] [REMOTE ] IP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:58:15.479824] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-15T18:58:15.517165] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-15T18:58:15.657830] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-09-15T18:58:16.275549] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-15T18:58:16.457837] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-09-15T18:58:16.832103] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-15T18:58:17.257866] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-09-15T18:58:18.057853] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-09-15T18:58:18.156373] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-15T18:58:18.335704] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-15T18:58:18.857912] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-09-15T18:58:19.657838] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-09-15T18:58:19.712625] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-15T18:58:20.457843] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-09-15T18:58:20.561010] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-15T18:58:21.257877] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-09-15T18:58:21.430937] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-15T18:58:22.057862] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-09-15T18:58:22.110491] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T18:58:22.167997] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-15T18:58:22.857871] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-09-15T18:58:23.516492] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-15T18:58:23.657849] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-09-15T18:58:23.905700] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-15T18:58:23.908853] [INFO ] [REMOTE ] INVX: Full fetch complete (31911 records). [2025-09-15T18:58:23.908950] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-09-15T18:58:24.283398] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-09-15T18:58:24.283491] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-09-15T18:58:24.284214] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-09-15T18:58:24.284271] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-09-15T18:58:24.285230] [DEBUG] [LOCAL ] INVX: Trimmed 31911 records to 21242 (keeping 150 days of data) [2025-09-15T18:58:24.417199] [DEBUG] [LOCAL ] INVX: Primary data saved (21242 records). [2025-09-15T18:58:24.417330] [INFO ] [MAIN ] INVX: Full history saved. [2025-09-15T18:58:24.417443] [INFO ] [MAIN ] Update Progress: 1117/2369 symbols completed. INVX took 27.0s. Estimated remaining: 2h 12m 39s. Rate: 9.4 symbols/min [2025-09-15T18:58:24.457831] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-09-15T18:58:25.138337] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-15T18:58:25.257873] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-09-15T18:58:26.057888] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-09-15T18:58:26.338957] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-15T18:58:26.857867] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-09-15T18:58:27.110883] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-15T18:58:27.657855] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-09-15T18:58:27.709853] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-15T18:58:27.715722] [INFO ] [REMOTE ] IOT: Full fetch complete (58130 records). [2025-09-15T18:58:27.715831] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-09-15T18:58:28.121200] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-09-15T18:58:28.121430] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-09-15T18:58:28.123076] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-09-15T18:58:28.123327] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-09-15T18:58:28.125694] [DEBUG] [LOCAL ] IOT: Trimmed 58130 records to 39479 (keeping 150 days of data) [2025-09-15T18:58:28.390373] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-15T18:58:28.441710] [DEBUG] [LOCAL ] IOT: Primary data saved (39479 records). [2025-09-15T18:58:28.441894] [INFO ] [MAIN ] IOT: Full history saved. [2025-09-15T18:58:28.442564] [INFO ] [MAIN ] Update Progress: 1118/2369 symbols completed. IOT took 20.3s. Estimated remaining: 2h 12m 30s. Rate: 9.4 symbols/min [2025-09-15T18:58:28.457936] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-09-15T18:58:30.008778] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T18:58:30.020341] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-09-15T18:58:30.059524] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-15T18:58:30.072365] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-09-15T18:58:31.549942] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-15T18:58:31.561336] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-09-15T18:58:32.744104] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-09-15T18:58:32.755571] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-09-15T18:58:33.030699] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-15T18:58:33.042602] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-09-15T18:58:34.752446] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-15T18:58:34.763801] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-09-15T18:58:35.242094] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-09-15T18:58:35.248105] [INFO ] [REMOTE ] IONQ: Full fetch complete (58468 records). [2025-09-15T18:58:35.248218] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-09-15T18:58:35.635459] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-09-15T18:58:35.635578] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-09-15T18:58:35.636405] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-09-15T18:58:35.636457] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-09-15T18:58:35.637614] [DEBUG] [LOCAL ] IONQ: Trimmed 58468 records to 39748 (keeping 150 days of data) [2025-09-15T18:58:35.880057] [DEBUG] [LOCAL ] IONQ: Primary data saved (39748 records). [2025-09-15T18:58:35.880203] [INFO ] [MAIN ] IONQ: Full history saved. [2025-09-15T18:58:35.880939] [INFO ] [MAIN ] Update Progress: 1119/2369 symbols completed. IONQ took 32.8s. Estimated remaining: 2h 12m 25s. Rate: 9.4 symbols/min [2025-09-15T18:58:36.282536] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-15T18:58:36.288398] [INFO ] [REMOTE ] IP: Full fetch complete (58004 records). [2025-09-15T18:58:36.288507] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-09-15T18:58:36.664312] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-09-15T18:58:36.664392] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-09-15T18:58:36.665196] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-09-15T18:58:36.665244] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-09-15T18:58:36.666391] [DEBUG] [LOCAL ] IP: Trimmed 58004 records to 39314 (keeping 150 days of data) [2025-09-15T18:58:36.910781] [DEBUG] [LOCAL ] IP: Primary data saved (39314 records). [2025-09-15T18:58:36.910932] [INFO ] [MAIN ] IP: Full history saved. [2025-09-15T18:58:36.911016] [INFO ] [MAIN ] Update Progress: 1120/2369 symbols completed. IP took 22.4s. Estimated remaining: 2h 12m 13s. Rate: 9.4 symbols/min [2025-09-15T18:58:37.550369] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:58:37.649992] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:58:37.645220] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:58:37.646563] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:58:37.673255] [DEBUG] [LOCAL ] IPI: Loaded 15746 existing records from primary storage. [2025-09-15T18:58:37.673540] [INFO ] [MAIN ] IPI: Loaded 15746 existing records. [2025-09-15T18:58:37.733083] [DEBUG] [LOCAL ] IQI: Loaded 13766 existing records from primary storage. [2025-09-15T18:58:37.750204] [INFO ] [MAIN ] IQI: Loaded 13766 existing records. [2025-09-15T18:58:38.003094] [DEBUG] [LOCAL ] IPG: Loaded 40092 existing records from primary storage. [2025-09-15T18:58:38.002020] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:58:38.009622] [INFO ] [MAIN ] IPG: Loaded 40092 existing records. [2025-09-15T18:58:38.029345] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-09-15T18:58:38.044632] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-09-15T18:58:38.092814] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-09-15T18:58:38.122441] [DEBUG] [LOCAL ] IQV: Loaded 37989 existing records from primary storage. [2025-09-15T18:58:38.165886] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-09-15T18:58:38.181406] [INFO ] [MAIN ] IQV: Loaded 37989 existing records. [2025-09-15T18:58:38.234885] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:58:38.393118] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-09-15T18:58:38.468418] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:58:38.492433] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-09-15T18:58:38.468260] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-09-15T18:58:38.493022] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-09-15T18:58:38.503536] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-09-15T18:58:38.524466] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-09-15T18:58:38.557200] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-09-15T18:58:38.562425] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-09-15T18:58:38.769007] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:58:38.905292] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-09-15T18:58:38.941381] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-09-15T18:58:39.013687] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-09-15T18:58:39.125262] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-09-15T18:58:39.283451] [INFO ] [REMOTE ] IPI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:58:39.402592] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-09-15T18:58:39.691107] [INFO ] [REMOTE ] IPG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:58:39.762290] [INFO ] [REMOTE ] IQI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:58:39.762577] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-09-15T18:58:39.786906] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-09-15T18:58:39.952137] [INFO ] [REMOTE ] IQV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:58:39.952503] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-09-15T18:58:40.142561] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-15T18:58:40.146591] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-09-15T18:58:40.544821] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-15T18:58:40.550048] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-09-15T18:58:40.897406] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-15T18:58:40.902576] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-09-15T18:58:40.990259] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-15T18:58:41.000389] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-09-15T18:58:41.402618] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T18:58:41.422506] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-09-15T18:58:41.423928] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-15T18:58:41.427941] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-09-15T18:58:42.009580] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-15T18:58:42.057832] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-09-15T18:58:42.107897] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-15T18:58:42.357394] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T18:58:42.857885] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-09-15T18:58:42.973159] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T18:58:43.210490] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-15T18:58:43.657910] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-09-15T18:58:44.168870] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-15T18:58:44.457905] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-09-15T18:58:45.054438] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T18:58:45.257877] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-09-15T18:58:46.057849] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-09-15T18:58:46.151287] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-15T18:58:46.255376] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-15T18:58:46.664954] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-15T18:58:46.857866] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-09-15T18:58:47.657881] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-09-15T18:58:47.773022] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-15T18:58:48.457939] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-09-15T18:58:48.926447] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-15T18:58:49.257916] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-09-15T18:58:49.653029] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-15T18:58:50.057893] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-09-15T18:58:50.198693] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-15T18:58:50.857888] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-09-15T18:58:51.487255] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T18:58:51.657878] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-09-15T18:58:51.675612] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-15T18:58:52.457927] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-09-15T18:58:52.633525] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-15T18:58:53.257864] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-09-15T18:58:53.434866] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T18:58:53.437889] [INFO ] [REMOTE ] IPI: Full fetch complete (22864 records). [2025-09-15T18:58:53.437972] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-09-15T18:58:53.812808] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-09-15T18:58:53.812908] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-09-15T18:58:53.813418] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-09-15T18:58:53.813467] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-09-15T18:58:53.814143] [DEBUG] [LOCAL ] IPI: Trimmed 22864 records to 15432 (keeping 150 days of data) [2025-09-15T18:58:53.907006] [DEBUG] [LOCAL ] IPI: Primary data saved (15432 records). [2025-09-15T18:58:53.907157] [INFO ] [MAIN ] IPI: Full history saved. [2025-09-15T18:58:53.907247] [INFO ] [MAIN ] Update Progress: 1121/2369 symbols completed. IPI took 17.0s. Estimated remaining: 2h 12m 18s. Rate: 9.4 symbols/min [2025-09-15T18:58:54.073575] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-09-15T18:58:54.075974] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:58:54.117587] [DEBUG] [LOCAL ] IR: Loaded 39643 existing records from primary storage. [2025-09-15T18:58:54.117755] [INFO ] [MAIN ] IR: Loaded 39643 existing records. [2025-09-15T18:58:54.298612] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:58:54.298927] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-09-15T18:58:54.298975] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-09-15T18:58:54.299880] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-09-15T18:58:54.299939] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-09-15T18:58:54.666060] [INFO ] [REMOTE ] IR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:58:54.733343] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T18:58:54.857897] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-09-15T18:58:55.657899] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-09-15T18:58:55.867010] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-15T18:58:56.100516] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-15T18:58:56.457875] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-09-15T18:58:56.887100] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-15T18:58:57.257890] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-09-15T18:58:57.692068] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T18:58:57.697262] [INFO ] [REMOTE ] IQV: Full fetch complete (54907 records). [2025-09-15T18:58:57.697371] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-09-15T18:58:58.076324] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-09-15T18:58:58.095753] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-09-15T18:58:58.095819] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-09-15T18:58:58.096667] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-09-15T18:58:58.096715] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-09-15T18:58:58.099252] [DEBUG] [LOCAL ] IQV: Trimmed 54907 records to 37209 (keeping 150 days of data) [2025-09-15T18:58:58.339095] [DEBUG] [LOCAL ] IQV: Primary data saved (37209 records). [2025-09-15T18:58:58.339256] [INFO ] [MAIN ] IQV: Full history saved. [2025-09-15T18:58:58.339383] [INFO ] [MAIN ] Update Progress: 1122/2369 symbols completed. IQV took 21.4s. Estimated remaining: 2h 12m 10s. Rate: 9.4 symbols/min [2025-09-15T18:58:58.512141] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:58:58.547016] [DEBUG] [LOCAL ] IRM: Loaded 36689 existing records from primary storage. [2025-09-15T18:58:58.547156] [INFO ] [MAIN ] IRM: Loaded 36689 existing records. [2025-09-15T18:58:58.722043] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:58:58.722296] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-09-15T18:58:58.722342] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-09-15T18:58:58.723114] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-09-15T18:58:58.723166] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-09-15T18:58:58.867624] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-09-15T18:58:59.081784] [INFO ] [REMOTE ] IRM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:58:59.114472] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-15T18:58:59.657838] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-09-15T18:58:59.831794] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-15T18:58:59.962182] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-15T18:59:00.457936] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-09-15T18:59:01.107858] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T18:59:01.257871] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-09-15T18:59:02.057875] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-09-15T18:59:02.228653] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-15T18:59:02.727739] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T18:59:02.734096] [INFO ] [REMOTE ] IPG: Full fetch complete (58005 records). [2025-09-15T18:59:02.734237] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-09-15T18:59:02.873241] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-09-15T18:59:03.064236] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-15T18:59:03.113153] [INFO ] [REMOTE ] IQI: Full fetch complete (20129 records). [2025-09-15T18:59:03.131544] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-09-15T18:59:03.131423] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-09-15T18:59:03.131618] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-09-15T18:59:03.132568] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-09-15T18:59:03.132681] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-09-15T18:59:03.243097] [DEBUG] [LOCAL ] IPG: Trimmed 58005 records to 39313 (keeping 150 days of data) [2025-09-15T18:59:03.665717] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-09-15T18:59:03.751124] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-09-15T18:59:03.751534] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-09-15T18:59:03.760562] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-09-15T18:59:03.759992] [DEBUG] [LOCAL ] IPG: Primary data saved (39313 records). [2025-09-15T18:59:03.760743] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-09-15T18:59:03.760932] [INFO ] [MAIN ] IPG: Full history saved. [2025-09-15T18:59:03.762250] [INFO ] [MAIN ] Update Progress: 1123/2369 symbols completed. IPG took 26.8s. Estimated remaining: 2h 12m 3s. Rate: 9.4 symbols/min [2025-09-15T18:59:03.828129] [DEBUG] [LOCAL ] IQI: Trimmed 20129 records to 13437 (keeping 150 days of data) [2025-09-15T18:59:04.002808] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:59:04.047497] [DEBUG] [LOCAL ] IRS: Loaded 16383 existing records from primary storage. [2025-09-15T18:59:04.048706] [INFO ] [MAIN ] IRS: Loaded 16383 existing records. [2025-09-15T18:59:04.132742] [DEBUG] [LOCAL ] IQI: Primary data saved (13437 records). [2025-09-15T18:59:04.151402] [INFO ] [MAIN ] IQI: Full history saved. [2025-09-15T18:59:04.153719] [INFO ] [MAIN ] Update Progress: 1124/2369 symbols completed. IQI took 27.2s. Estimated remaining: 2h 11m 50s. Rate: 9.4 symbols/min [2025-09-15T18:59:04.351754] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:59:04.367358] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-09-15T18:59:04.372547] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-09-15T18:59:04.402497] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-09-15T18:59:04.425268] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-09-15T18:59:04.426687] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:59:04.811774] [INFO ] [REMOTE ] IRS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:59:04.812210] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-09-15T18:59:04.813112] [DEBUG] [LOCAL ] IRT: Loaded 37875 existing records from primary storage. [2025-09-15T18:59:04.813321] [INFO ] [MAIN ] IRT: Loaded 37875 existing records. [2025-09-15T18:59:05.003192] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:59:05.003570] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-09-15T18:59:05.003727] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-09-15T18:59:05.014504] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-09-15T18:59:05.032129] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-09-15T18:59:05.056664] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-15T18:59:05.264678] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-09-15T18:59:05.408119] [INFO ] [REMOTE ] IRT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:59:05.439517] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-15T18:59:05.695262] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-15T18:59:06.057895] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-09-15T18:59:06.759988] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-15T18:59:06.813057] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T18:59:06.857853] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-09-15T18:59:07.657926] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-09-15T18:59:08.457898] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-09-15T18:59:08.620110] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-15T18:59:08.988349] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-15T18:59:09.225217] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-15T18:59:09.257816] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-09-15T18:59:10.057878] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-09-15T18:59:10.293361] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-15T18:59:10.857928] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-09-15T18:59:11.605304] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-15T18:59:11.657815] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-09-15T18:59:11.685450] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-15T18:59:12.457899] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-09-15T18:59:13.257889] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-09-15T18:59:13.344958] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T18:59:13.934042] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T18:59:14.057877] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-09-15T18:59:14.859349] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-09-15T18:59:14.862220] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-15T18:59:15.611964] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-15T18:59:15.659762] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-09-15T18:59:15.665865] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T18:59:16.457889] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-09-15T18:59:16.707283] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-15T18:59:17.257886] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-09-15T18:59:17.861175] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-15T18:59:17.867872] [INFO ] [REMOTE ] IR: Full fetch complete (57332 records). [2025-09-15T18:59:17.868036] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-09-15T18:59:18.063170] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-09-15T18:59:18.264263] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-09-15T18:59:18.264396] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-09-15T18:59:18.265287] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-09-15T18:59:18.265360] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-09-15T18:59:18.277103] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T18:59:18.277232] [DEBUG] [LOCAL ] IR: Trimmed 57332 records to 38888 (keeping 150 days of data) [2025-09-15T18:59:18.282058] [INFO ] [REMOTE ] IRS: Full fetch complete (22813 records). [2025-09-15T18:59:18.282158] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-09-15T18:59:18.753444] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-09-15T18:59:18.754046] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-09-15T18:59:18.755127] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-09-15T18:59:18.755449] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-09-15T18:59:18.758397] [DEBUG] [LOCAL ] IRS: Trimmed 22813 records to 16167 (keeping 150 days of data) [2025-09-15T18:59:18.860073] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-09-15T18:59:18.871705] [DEBUG] [LOCAL ] IRS: Primary data saved (16167 records). [2025-09-15T18:59:18.872138] [INFO ] [MAIN ] IRS: Full history saved. [2025-09-15T18:59:18.872470] [INFO ] [MAIN ] Update Progress: 1125/2369 symbols completed. IRS took 15.1s. Estimated remaining: 2h 11m 52s. Rate: 9.4 symbols/min [2025-09-15T18:59:19.114690] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:59:19.158923] [DEBUG] [LOCAL ] ISD: Loaded 11353 existing records from primary storage. [2025-09-15T18:59:19.161313] [INFO ] [MAIN ] ISD: Loaded 11353 existing records. [2025-09-15T18:59:19.349589] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:59:19.352790] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-09-15T18:59:19.353888] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-09-15T18:59:19.355485] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-09-15T18:59:19.356070] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-09-15T18:59:19.466227] [DEBUG] [LOCAL ] IR: Primary data saved (38888 records). [2025-09-15T18:59:19.476512] [INFO ] [MAIN ] IR: Full history saved. [2025-09-15T18:59:19.477473] [INFO ] [MAIN ] Update Progress: 1126/2369 symbols completed. IR took 25.6s. Estimated remaining: 2h 11m 40s. Rate: 9.4 symbols/min [2025-09-15T18:59:19.853868] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:59:19.926693] [INFO ] [REMOTE ] ISD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:59:19.927027] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-09-15T18:59:19.959796] [DEBUG] [LOCAL ] IT: Loaded 31043 existing records from primary storage. [2025-09-15T18:59:19.960022] [INFO ] [MAIN ] IT: Loaded 31043 existing records. [2025-09-15T18:59:20.093931] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-15T18:59:20.174302] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:59:20.174559] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-09-15T18:59:20.174670] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-09-15T18:59:20.175383] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-09-15T18:59:20.175436] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-09-15T18:59:20.462536] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-09-15T18:59:20.523190] [INFO ] [REMOTE ] IT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:59:20.556994] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-15T18:59:20.867240] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T18:59:21.257940] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-09-15T18:59:22.012036] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T18:59:22.057911] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-09-15T18:59:22.335554] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-15T18:59:22.857868] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-09-15T18:59:23.657921] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-09-15T18:59:24.322510] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-15T18:59:24.457863] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-09-15T18:59:25.257878] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-09-15T18:59:25.414603] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-09-15T18:59:25.479361] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-15T18:59:26.057887] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-09-15T18:59:26.160198] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T18:59:26.272741] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-15T18:59:26.857924] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-09-15T18:59:27.221670] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-15T18:59:27.657874] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-09-15T18:59:27.872781] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-15T18:59:28.457951] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-09-15T18:59:29.257945] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-09-15T18:59:29.382683] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-15T18:59:29.388301] [INFO ] [REMOTE ] IRM: Full fetch complete (54103 records). [2025-09-15T18:59:29.388448] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-09-15T18:59:29.783452] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-09-15T18:59:29.783657] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-09-15T18:59:29.787055] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-09-15T18:59:29.794240] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-09-15T18:59:29.808111] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T18:59:29.816596] [DEBUG] [LOCAL ] IRM: Trimmed 54103 records to 36011 (keeping 150 days of data) [2025-09-15T18:59:30.053510] [DEBUG] [LOCAL ] IRM: Primary data saved (36011 records). [2025-09-15T18:59:30.053672] [INFO ] [MAIN ] IRM: Full history saved. [2025-09-15T18:59:30.053771] [INFO ] [MAIN ] Update Progress: 1127/2369 symbols completed. IRM took 31.7s. Estimated remaining: 2h 11m 38s. Rate: 9.4 symbols/min [2025-09-15T18:59:30.065282] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-09-15T18:59:30.231986] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:59:30.255537] [DEBUG] [LOCAL ] ITGR: Loaded 22907 existing records from primary storage. [2025-09-15T18:59:30.255690] [INFO ] [MAIN ] ITGR: Loaded 22907 existing records. [2025-09-15T18:59:30.436941] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:59:30.437191] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-09-15T18:59:30.437243] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-09-15T18:59:30.437957] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-09-15T18:59:30.438008] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-09-15T18:59:30.805814] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:59:30.836849] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T18:59:30.857876] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-09-15T18:59:30.869275] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-15T18:59:31.657878] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-09-15T18:59:32.006957] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-15T18:59:32.457870] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-09-15T18:59:33.174106] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-15T18:59:33.179587] [INFO ] [REMOTE ] IRT: Full fetch complete (54776 records). [2025-09-15T18:59:33.179731] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-09-15T18:59:33.262955] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-09-15T18:59:33.571526] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-09-15T18:59:33.571787] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-09-15T18:59:33.572680] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-09-15T18:59:33.572779] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-09-15T18:59:33.580889] [DEBUG] [LOCAL ] IRT: Trimmed 54776 records to 37200 (keeping 150 days of data) [2025-09-15T18:59:33.595105] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-15T18:59:33.833850] [DEBUG] [LOCAL ] IRT: Primary data saved (37200 records). [2025-09-15T18:59:33.834009] [INFO ] [MAIN ] IRT: Full history saved. [2025-09-15T18:59:33.834099] [INFO ] [MAIN ] Update Progress: 1128/2369 symbols completed. IRT took 29.7s. Estimated remaining: 2h 11m 29s. Rate: 9.4 symbols/min [2025-09-15T18:59:34.010165] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:59:34.039731] [DEBUG] [LOCAL ] ITT: Loaded 24053 existing records from primary storage. [2025-09-15T18:59:34.039991] [INFO ] [MAIN ] ITT: Loaded 24053 existing records. [2025-09-15T18:59:34.063029] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-09-15T18:59:34.231283] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:59:34.231860] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-09-15T18:59:34.231981] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-09-15T18:59:34.238013] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-09-15T18:59:34.242986] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-09-15T18:59:34.278227] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T18:59:34.601901] [INFO ] [REMOTE ] ITT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:59:34.857864] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-09-15T18:59:35.255261] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T18:59:35.536488] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-15T18:59:35.657833] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-09-15T18:59:36.457877] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-09-15T18:59:37.146048] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-15T18:59:37.257833] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-09-15T18:59:38.058617] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-09-15T18:59:38.063617] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T18:59:38.106565] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-15T18:59:38.857863] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-09-15T18:59:39.657951] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-09-15T18:59:40.215035] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-15T18:59:40.457883] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-09-15T18:59:40.578780] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-15T18:59:40.580929] [INFO ] [REMOTE ] ISD: Full fetch complete (17301 records). [2025-09-15T18:59:40.581014] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-09-15T18:59:40.945837] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-09-15T18:59:40.945983] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-09-15T18:59:40.946376] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-09-15T18:59:40.946447] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-09-15T18:59:40.947328] [DEBUG] [LOCAL ] ISD: Trimmed 17301 records to 11068 (keeping 150 days of data) [2025-09-15T18:59:41.016516] [DEBUG] [LOCAL ] ISD: Primary data saved (11068 records). [2025-09-15T18:59:41.016826] [INFO ] [MAIN ] ISD: Full history saved. [2025-09-15T18:59:41.016972] [INFO ] [MAIN ] Update Progress: 1129/2369 symbols completed. ISD took 22.1s. Estimated remaining: 2h 11m 23s. Rate: 9.4 symbols/min [2025-09-15T18:59:41.190406] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:59:41.218888] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-15T18:59:41.263841] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-09-15T18:59:41.266987] [DEBUG] [LOCAL ] ITUB: Loaded 40153 existing records from primary storage. [2025-09-15T18:59:41.267213] [INFO ] [MAIN ] ITUB: Loaded 40153 existing records. [2025-09-15T18:59:41.457517] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:59:41.457994] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-09-15T18:59:41.458086] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-09-15T18:59:41.459128] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-09-15T18:59:41.459186] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-09-15T18:59:41.685041] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-15T18:59:41.875931] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:59:42.057840] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-09-15T18:59:42.857895] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-09-15T18:59:42.919334] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-15T18:59:42.925256] [INFO ] [REMOTE ] IT: Full fetch complete (43759 records). [2025-09-15T18:59:42.925389] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-09-15T18:59:43.323225] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-09-15T18:59:43.323338] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-09-15T18:59:43.324585] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-09-15T18:59:43.324660] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-09-15T18:59:43.326360] [DEBUG] [LOCAL ] IT: Trimmed 43759 records to 30721 (keeping 150 days of data) [2025-09-15T18:59:43.541009] [DEBUG] [LOCAL ] IT: Primary data saved (30721 records). [2025-09-15T18:59:43.541160] [INFO ] [MAIN ] IT: Full history saved. [2025-09-15T18:59:43.541255] [INFO ] [MAIN ] Update Progress: 1130/2369 symbols completed. IT took 24.1s. Estimated remaining: 2h 11m 13s. Rate: 9.4 symbols/min [2025-09-15T18:59:43.658297] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-09-15T18:59:43.715839] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:59:43.747169] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T18:59:43.790624] [DEBUG] [LOCAL ] ITW: Loaded 34479 existing records from primary storage. [2025-09-15T18:59:43.790800] [INFO ] [MAIN ] ITW: Loaded 34479 existing records. [2025-09-15T18:59:43.967497] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:59:43.967904] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-09-15T18:59:43.967977] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-09-15T18:59:43.968937] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-09-15T18:59:43.969008] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-09-15T18:59:44.171456] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T18:59:44.368734] [INFO ] [REMOTE ] ITW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:59:44.459776] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-09-15T18:59:44.464547] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-15T18:59:45.257932] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-09-15T18:59:46.058004] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-09-15T18:59:46.132989] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-15T18:59:46.857888] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-09-15T18:59:46.972860] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-15T18:59:47.377511] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T18:59:47.657960] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-09-15T18:59:47.804509] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T18:59:48.457951] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-09-15T18:59:49.044734] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-15T18:59:49.257937] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-09-15T18:59:50.057868] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-09-15T18:59:50.156199] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T18:59:50.308794] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-15T18:59:50.857911] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-09-15T18:59:51.657916] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-09-15T18:59:51.878116] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-15T18:59:52.323003] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T18:59:52.457927] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-09-15T18:59:53.128615] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T18:59:53.257828] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-09-15T18:59:53.338226] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-15T18:59:54.057881] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-09-15T18:59:54.531662] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-15T18:59:54.857945] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-09-15T18:59:55.293029] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-15T18:59:55.296527] [INFO ] [REMOTE ] ITGR: Full fetch complete (33910 records). [2025-09-15T18:59:55.296607] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-09-15T18:59:55.664588] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-09-15T18:59:55.664008] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-09-15T18:59:55.665401] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-09-15T18:59:55.666043] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-09-15T18:59:55.666087] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-09-15T18:59:55.666908] [DEBUG] [LOCAL ] ITGR: Trimmed 33910 records to 22027 (keeping 150 days of data) [2025-09-15T18:59:55.802919] [DEBUG] [LOCAL ] ITGR: Primary data saved (22027 records). [2025-09-15T18:59:55.803107] [INFO ] [MAIN ] ITGR: Full history saved. [2025-09-15T18:59:55.803218] [INFO ] [MAIN ] Update Progress: 1131/2369 symbols completed. ITGR took 25.7s. Estimated remaining: 2h 11m 13s. Rate: 9.4 symbols/min [2025-09-15T18:59:55.979566] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T18:59:56.000023] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-15T18:59:56.038985] [DEBUG] [LOCAL ] IVR: Loaded 35633 existing records from primary storage. [2025-09-15T18:59:56.039148] [INFO ] [MAIN ] IVR: Loaded 35633 existing records. [2025-09-15T18:59:56.227060] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T18:59:56.227479] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-09-15T18:59:56.227531] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-09-15T18:59:56.228263] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-09-15T18:59:56.228319] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-09-15T18:59:56.463133] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-09-15T18:59:56.602758] [INFO ] [REMOTE ] IVR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T18:59:57.262971] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-09-15T18:59:57.279596] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-15T18:59:57.774522] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-15T18:59:58.057917] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-09-15T18:59:58.478590] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-15T18:59:58.857881] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-09-15T18:59:59.380390] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-15T18:59:59.657911] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-09-15T19:00:00.421107] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T19:00:00.457879] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-09-15T19:00:01.257956] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-09-15T19:00:01.344867] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-15T19:00:01.728872] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-15T19:00:02.057968] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-09-15T19:00:02.857939] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-09-15T19:00:02.872709] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-15T19:00:02.877925] [INFO ] [REMOTE ] ITT: Full fetch complete (36467 records). [2025-09-15T19:00:02.878447] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-09-15T19:00:03.274060] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-09-15T19:00:03.274178] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-09-15T19:00:03.274933] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-09-15T19:00:03.274996] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-09-15T19:00:03.276222] [DEBUG] [LOCAL ] ITT: Trimmed 36467 records to 23217 (keeping 150 days of data) [2025-09-15T19:00:03.438583] [DEBUG] [LOCAL ] ITT: Primary data saved (23217 records). [2025-09-15T19:00:03.438895] [INFO ] [MAIN ] ITT: Full history saved. [2025-09-15T19:00:03.439078] [INFO ] [MAIN ] Update Progress: 1132/2369 symbols completed. ITT took 29.6s. Estimated remaining: 2h 11m 8s. Rate: 9.4 symbols/min [2025-09-15T19:00:03.623207] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:00:03.648608] [DEBUG] [LOCAL ] IVT: Loaded 22821 existing records from primary storage. [2025-09-15T19:00:03.648829] [INFO ] [MAIN ] IVT: Loaded 22821 existing records. [2025-09-15T19:00:03.681236] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-09-15T19:00:03.855400] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:00:03.856575] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-09-15T19:00:03.856671] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-09-15T19:00:03.857788] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-09-15T19:00:03.857854] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-09-15T19:00:04.229862] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-15T19:00:04.313456] [INFO ] [REMOTE ] IVT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:00:04.457926] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-09-15T19:00:04.878859] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-15T19:00:05.206539] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-15T19:00:05.257907] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-09-15T19:00:05.611951] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-15T19:00:06.057942] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-09-15T19:00:06.857930] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-09-15T19:00:07.040782] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-15T19:00:07.047688] [INFO ] [REMOTE ] ITUB: Full fetch complete (57965 records). [2025-09-15T19:00:07.047908] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-09-15T19:00:07.523113] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-09-15T19:00:07.525561] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T19:00:07.525863] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-09-15T19:00:07.534547] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-09-15T19:00:07.534701] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-09-15T19:00:07.537191] [DEBUG] [LOCAL ] ITUB: Trimmed 57965 records to 39382 (keeping 150 days of data) [2025-09-15T19:00:07.658129] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-09-15T19:00:07.809753] [DEBUG] [LOCAL ] ITUB: Primary data saved (39382 records). [2025-09-15T19:00:07.809991] [INFO ] [MAIN ] ITUB: Full history saved. [2025-09-15T19:00:07.811478] [INFO ] [MAIN ] Update Progress: 1133/2369 symbols completed. ITUB took 26.8s. Estimated remaining: 2h 10m 59s. Rate: 9.4 symbols/min [2025-09-15T19:00:07.988206] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:00:08.040061] [DEBUG] [LOCAL ] IVZ: Loaded 39955 existing records from primary storage. [2025-09-15T19:00:08.040284] [INFO ] [MAIN ] IVZ: Loaded 39955 existing records. [2025-09-15T19:00:08.220033] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:00:08.220365] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-09-15T19:00:08.220416] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-09-15T19:00:08.221420] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-09-15T19:00:08.221502] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-09-15T19:00:08.465599] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-09-15T19:00:08.606825] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:00:08.622903] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-15T19:00:08.628587] [INFO ] [REMOTE ] ITW: Full fetch complete (50589 records). [2025-09-15T19:00:08.628853] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-09-15T19:00:09.030541] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-09-15T19:00:09.030812] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-09-15T19:00:09.032234] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-09-15T19:00:09.032353] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-09-15T19:00:09.034618] [DEBUG] [LOCAL ] ITW: Trimmed 50589 records to 33742 (keeping 150 days of data) [2025-09-15T19:00:09.061531] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T19:00:09.269060] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-09-15T19:00:09.299216] [DEBUG] [LOCAL ] ITW: Primary data saved (33742 records). [2025-09-15T19:00:09.299446] [INFO ] [MAIN ] ITW: Full history saved. [2025-09-15T19:00:09.300125] [INFO ] [MAIN ] Update Progress: 1134/2369 symbols completed. ITW took 25.8s. Estimated remaining: 2h 10m 48s. Rate: 9.4 symbols/min [2025-09-15T19:00:09.488370] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:00:09.511742] [DEBUG] [LOCAL ] IX: Loaded 16716 existing records from primary storage. [2025-09-15T19:00:09.511951] [INFO ] [MAIN ] IX: Loaded 16716 existing records. [2025-09-15T19:00:09.696956] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:00:09.697297] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-09-15T19:00:09.697344] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-09-15T19:00:09.697880] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-09-15T19:00:09.697941] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-09-15T19:00:10.067319] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-09-15T19:00:10.074092] [INFO ] [REMOTE ] IX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:00:10.135281] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-15T19:00:10.474405] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T19:00:10.857934] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-09-15T19:00:11.328848] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-15T19:00:11.657965] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-09-15T19:00:12.358484] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-15T19:00:12.457954] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-09-15T19:00:13.257928] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-09-15T19:00:13.912769] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T19:00:14.055287] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-09-15T19:00:14.064269] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-09-15T19:00:14.524272] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-15T19:00:14.857943] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-09-15T19:00:15.198373] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-15T19:00:15.657963] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-09-15T19:00:15.991945] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-15T19:00:16.457929] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-09-15T19:00:16.795034] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-15T19:00:17.257985] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-09-15T19:00:18.057959] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-09-15T19:00:18.628254] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T19:00:18.857922] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-09-15T19:00:19.177721] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-15T19:00:19.181587] [INFO ] [REMOTE ] IVT: Full fetch complete (33847 records). [2025-09-15T19:00:19.181760] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-09-15T19:00:19.606624] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-09-15T19:00:19.606794] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-09-15T19:00:19.608327] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-09-15T19:00:19.608452] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-09-15T19:00:19.610459] [DEBUG] [LOCAL ] IVT: Trimmed 33847 records to 22298 (keeping 150 days of data) [2025-09-15T19:00:19.680752] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-09-15T19:00:19.751068] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (3.29 seconds). [2025-09-15T19:00:19.810805] [DEBUG] [LOCAL ] IVT: Primary data saved (22298 records). [2025-09-15T19:00:19.810972] [INFO ] [MAIN ] IVT: Full history saved. [2025-09-15T19:00:19.811092] [INFO ] [MAIN ] Update Progress: 1135/2369 symbols completed. IVT took 16.4s. Estimated remaining: 2h 10m 46s. Rate: 9.4 symbols/min [2025-09-15T19:00:19.986533] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:00:20.021714] [DEBUG] [LOCAL ] J: Loaded 29890 existing records from primary storage. [2025-09-15T19:00:20.021911] [INFO ] [MAIN ] J: Loaded 29890 existing records. [2025-09-15T19:00:20.208861] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:00:20.209236] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-09-15T19:00:20.209291] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-09-15T19:00:20.210128] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-09-15T19:00:20.210179] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-09-15T19:00:20.463302] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-09-15T19:00:20.577721] [INFO ] [REMOTE ] J: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:00:20.612199] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-15T19:00:21.257975] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-09-15T19:00:21.333998] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-15T19:00:22.058003] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-09-15T19:00:22.198075] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-15T19:00:22.585132] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-15T19:00:22.857984] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-09-15T19:00:23.604304] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T19:00:23.632554] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-15T19:00:23.657886] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-09-15T19:00:24.457925] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-09-15T19:00:24.528396] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-15T19:00:25.257945] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-09-15T19:00:25.886384] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-15T19:00:26.057915] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-09-15T19:00:26.126781] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-15T19:00:26.132338] [INFO ] [REMOTE ] IVR: Full fetch complete (51799 records). [2025-09-15T19:00:26.132494] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-09-15T19:00:26.531688] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-09-15T19:00:26.531840] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-09-15T19:00:26.532869] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-09-15T19:00:26.532917] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-09-15T19:00:26.534246] [DEBUG] [LOCAL ] IVR: Trimmed 51799 records to 34880 (keeping 150 days of data) [2025-09-15T19:00:26.738844] [DEBUG] [LOCAL ] IVR: Primary data saved (34880 records). [2025-09-15T19:00:26.739003] [INFO ] [MAIN ] IVR: Full history saved. [2025-09-15T19:00:26.739092] [INFO ] [MAIN ] Update Progress: 1136/2369 symbols completed. IVR took 30.9s. Estimated remaining: 2h 10m 40s. Rate: 9.4 symbols/min [2025-09-15T19:00:26.863064] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-09-15T19:00:26.918754] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:00:26.950889] [DEBUG] [LOCAL ] JBGS: Loaded 31869 existing records from primary storage. [2025-09-15T19:00:26.951043] [INFO ] [MAIN ] JBGS: Loaded 31869 existing records. [2025-09-15T19:00:27.129353] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:00:27.129611] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-09-15T19:00:27.129676] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-09-15T19:00:27.130557] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-09-15T19:00:27.130607] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-09-15T19:00:27.484985] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:00:27.549723] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-15T19:00:27.657868] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-09-15T19:00:27.679089] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-15T19:00:27.681295] [INFO ] [REMOTE ] IX: Full fetch complete (23743 records). [2025-09-15T19:00:27.681392] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-09-15T19:00:28.048523] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-09-15T19:00:28.048605] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-09-15T19:00:28.049102] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-09-15T19:00:28.049145] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-09-15T19:00:28.049795] [DEBUG] [LOCAL ] IX: Trimmed 23743 records to 16193 (keeping 150 days of data) [2025-09-15T19:00:28.145181] [DEBUG] [LOCAL ] IX: Primary data saved (16193 records). [2025-09-15T19:00:28.145329] [INFO ] [MAIN ] IX: Full history saved. [2025-09-15T19:00:28.145432] [INFO ] [MAIN ] Update Progress: 1137/2369 symbols completed. IX took 18.8s. Estimated remaining: 2h 10m 28s. Rate: 9.4 symbols/min [2025-09-15T19:00:28.317412] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:00:28.348465] [DEBUG] [LOCAL ] JBI: Loaded 32393 existing records from primary storage. [2025-09-15T19:00:28.348616] [INFO ] [MAIN ] JBI: Loaded 32393 existing records. [2025-09-15T19:00:28.463048] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-09-15T19:00:28.524213] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:00:28.524504] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-09-15T19:00:28.524551] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-09-15T19:00:28.525209] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-09-15T19:00:28.525265] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-09-15T19:00:28.877867] [INFO ] [REMOTE ] JBI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:00:28.910153] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-15T19:00:29.257876] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-09-15T19:00:30.057888] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-09-15T19:00:30.407215] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-15T19:00:30.718613] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T19:00:30.857875] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-09-15T19:00:31.095405] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-15T19:00:31.657890] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-09-15T19:00:31.865922] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-15T19:00:32.457869] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-09-15T19:00:33.223303] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T19:00:33.257850] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-09-15T19:00:33.765096] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-15T19:00:34.057867] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-09-15T19:00:34.681041] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-15T19:00:34.857863] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-09-15T19:00:35.657885] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-09-15T19:00:35.871528] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-15T19:00:35.931966] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-15T19:00:36.457921] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-09-15T19:00:36.854365] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-15T19:00:37.257872] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-09-15T19:00:37.863882] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T19:00:38.057923] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-09-15T19:00:38.437752] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-15T19:00:38.857933] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-09-15T19:00:39.266306] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-15T19:00:39.657902] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-09-15T19:00:39.993572] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-15T19:00:40.457914] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-09-15T19:00:40.835579] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-15T19:00:41.257917] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-09-15T19:00:41.622348] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-15T19:00:42.057878] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-09-15T19:00:42.398205] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-15T19:00:42.406064] [INFO ] [REMOTE ] IVZ: Full fetch complete (57719 records). [2025-09-15T19:00:42.406307] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-09-15T19:00:42.790855] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-09-15T19:00:42.790954] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-09-15T19:00:42.791855] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-09-15T19:00:42.791907] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-09-15T19:00:42.793293] [DEBUG] [LOCAL ] IVZ: Trimmed 57719 records to 39170 (keeping 150 days of data) [2025-09-15T19:00:42.859829] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-09-15T19:00:43.043562] [DEBUG] [LOCAL ] IVZ: Primary data saved (39170 records). [2025-09-15T19:00:43.043746] [INFO ] [MAIN ] IVZ: Full history saved. [2025-09-15T19:00:43.044552] [INFO ] [MAIN ] Update Progress: 1138/2369 symbols completed. IVZ took 35.2s. Estimated remaining: 2h 10m 31s. Rate: 9.4 symbols/min [2025-09-15T19:00:43.231193] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:00:43.270914] [DEBUG] [LOCAL ] JBL: Loaded 35773 existing records from primary storage. [2025-09-15T19:00:43.271079] [INFO ] [MAIN ] JBL: Loaded 35773 existing records. [2025-09-15T19:00:43.462529] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:00:43.462863] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-09-15T19:00:43.462913] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-09-15T19:00:43.463725] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-09-15T19:00:43.463784] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-09-15T19:00:43.673127] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-09-15T19:00:43.822493] [INFO ] [REMOTE ] JBL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:00:43.849356] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-15T19:00:44.078398] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-15T19:00:44.457891] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-09-15T19:00:44.736378] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T19:00:44.742352] [INFO ] [REMOTE ] JBGS: Full fetch complete (45830 records). [2025-09-15T19:00:44.742470] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-09-15T19:00:45.118693] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-09-15T19:00:45.118776] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-09-15T19:00:45.119493] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-09-15T19:00:45.119541] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-09-15T19:00:45.120761] [DEBUG] [LOCAL ] JBGS: Trimmed 45830 records to 31240 (keeping 150 days of data) [2025-09-15T19:00:45.276553] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-09-15T19:00:45.318394] [DEBUG] [LOCAL ] JBGS: Primary data saved (31240 records). [2025-09-15T19:00:45.318500] [INFO ] [MAIN ] JBGS: Full history saved. [2025-09-15T19:00:45.318593] [INFO ] [MAIN ] Update Progress: 1139/2369 symbols completed. JBGS took 18.6s. Estimated remaining: 2h 10m 21s. Rate: 9.4 symbols/min [2025-09-15T19:00:45.486033] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:00:45.505339] [DEBUG] [LOCAL ] JBND: Loaded 19070 existing records from primary storage. [2025-09-15T19:00:45.505461] [INFO ] [MAIN ] JBND: Loaded 19070 existing records. [2025-09-15T19:00:45.692157] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:00:45.692424] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-09-15T19:00:45.692471] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-09-15T19:00:45.693050] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-09-15T19:00:45.693104] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-09-15T19:00:46.044927] [INFO ] [REMOTE ] JBND: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:00:46.057856] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-09-15T19:00:46.058803] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T19:00:46.065762] [INFO ] [REMOTE ] J: Full fetch complete (44410 records). [2025-09-15T19:00:46.065856] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-09-15T19:00:46.445331] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-09-15T19:00:46.445422] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-09-15T19:00:46.446271] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-09-15T19:00:46.446399] [DEBUG] [LOCAL ] J: Saving primary data. [2025-09-15T19:00:46.447999] [DEBUG] [LOCAL ] J: Trimmed 44410 records to 29311 (keeping 150 days of data) [2025-09-15T19:00:46.573499] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-15T19:00:46.683185] [DEBUG] [LOCAL ] J: Primary data saved (29311 records). [2025-09-15T19:00:46.683341] [INFO ] [MAIN ] J: Full history saved. [2025-09-15T19:00:46.683449] [INFO ] [MAIN ] Update Progress: 1140/2369 symbols completed. J took 26.9s. Estimated remaining: 2h 10m 9s. Rate: 9.4 symbols/min [2025-09-15T19:00:46.892613] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-09-15T19:00:46.895171] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:00:46.895991] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-09-15T19:00:46.896035] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-09-15T19:00:46.896151] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-09-15T19:00:46.896190] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-15T19:00:46.896230] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-15T19:00:46.896262] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-09-15T19:00:47.266489] [INFO ] [REMOTE ] JBS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:00:47.269570] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T19:00:47.657941] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-09-15T19:00:48.457931] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-09-15T19:00:48.595915] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T19:00:48.697044] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-15T19:00:49.213334] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-15T19:00:49.257825] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-09-15T19:00:50.057880] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-02. [2025-09-15T19:00:50.248312] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-15T19:00:50.248897] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:00:50.255038] [WARN ] [REMOTE ] JBS: No data returned for month 2025-02 [2025-09-15T19:00:50.857881] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-09-15T19:00:51.657938] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-09-15T19:00:51.910810] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-15T19:00:52.457871] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-09-15T19:00:52.618211] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T19:00:53.257921] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-09-15T19:00:54.010530] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T19:00:54.057824] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-09-15T19:00:54.292501] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-15T19:00:54.297752] [INFO ] [REMOTE ] JBI: Full fetch complete (48116 records). [2025-09-15T19:00:54.297909] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-09-15T19:00:54.674774] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-09-15T19:00:54.674851] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-09-15T19:00:54.675592] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-09-15T19:00:54.675635] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-09-15T19:00:54.676982] [DEBUG] [LOCAL ] JBI: Trimmed 48116 records to 31610 (keeping 150 days of data) [2025-09-15T19:00:54.859718] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-09-15T19:00:54.871976] [DEBUG] [LOCAL ] JBI: Primary data saved (31610 records). [2025-09-15T19:00:54.872411] [INFO ] [MAIN ] JBI: Full history saved. [2025-09-15T19:00:54.872518] [INFO ] [MAIN ] Update Progress: 1141/2369 symbols completed. JBI took 26.7s. Estimated remaining: 2h 10m 4s. Rate: 9.4 symbols/min [2025-09-15T19:00:55.041845] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:00:55.065966] [DEBUG] [LOCAL ] JBTM: Loaded 24291 existing records from primary storage. [2025-09-15T19:00:55.066101] [INFO ] [MAIN ] JBTM: Loaded 24291 existing records. [2025-09-15T19:00:55.243819] [WARN ] [MAIN ] JBTM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:00:55.244068] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-09-15T19:00:55.244113] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-15T19:00:55.245181] [DEBUG] [LOCAL ] JBTM: Deleted primary data file. [2025-09-15T19:00:55.245239] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-09-15T19:00:55.601131] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:00:55.634073] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T19:00:55.658230] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-09-15T19:00:55.660464] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-15T19:00:56.457871] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-09-15T19:00:56.839013] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-15T19:00:57.257917] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-03. [2025-09-15T19:00:57.493708] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:00:57.494026] [WARN ] [REMOTE ] JBS: No data returned for month 2025-03 [2025-09-15T19:00:57.540485] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-15T19:00:58.057876] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-04. [2025-09-15T19:00:58.295981] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:00:58.296349] [WARN ] [REMOTE ] JBS: No data returned for month 2025-04 [2025-09-15T19:00:58.857876] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-05. [2025-09-15T19:00:59.075562] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:00:59.075896] [WARN ] [REMOTE ] JBS: No data returned for month 2025-05 [2025-09-15T19:00:59.657868] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-06. [2025-09-15T19:01:00.457879] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-09-15T19:01:00.799774] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-15T19:01:01.257982] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-09-15T19:01:01.459826] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-15T19:01:02.057903] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-07. [2025-09-15T19:01:02.768310] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-15T19:01:02.857894] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-09-15T19:01:03.657855] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-09-15T19:01:03.763690] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-15T19:01:03.806930] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-15T19:01:03.811220] [INFO ] [REMOTE ] JBND: Full fetch complete (26343 records). [2025-09-15T19:01:03.811346] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-09-15T19:01:04.176702] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-09-15T19:01:04.176802] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-09-15T19:01:04.177322] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-09-15T19:01:04.177365] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-09-15T19:01:04.178048] [DEBUG] [LOCAL ] JBND: Trimmed 26343 records to 18819 (keeping 150 days of data) [2025-09-15T19:01:04.303625] [DEBUG] [LOCAL ] JBND: Primary data saved (18819 records). [2025-09-15T19:01:04.303791] [INFO ] [MAIN ] JBND: Full history saved. [2025-09-15T19:01:04.303891] [INFO ] [MAIN ] Update Progress: 1142/2369 symbols completed. JBND took 19.0s. Estimated remaining: 2h 10m 1s. Rate: 9.4 symbols/min [2025-09-15T19:01:04.471474] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-09-15T19:01:04.474690] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:01:04.482766] [DEBUG] [LOCAL ] JCE: Loaded 4706 existing records from primary storage. [2025-09-15T19:01:04.482872] [INFO ] [MAIN ] JCE: Loaded 4706 existing records. [2025-09-15T19:01:04.660034] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:01:04.660263] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-09-15T19:01:04.660322] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-09-15T19:01:04.660612] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-09-15T19:01:04.660686] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-09-15T19:01:05.024919] [INFO ] [REMOTE ] JCE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:01:05.042422] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-15T19:01:05.257911] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-08. [2025-09-15T19:01:06.057872] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-09-15T19:01:06.371152] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-15T19:01:06.679344] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-15T19:01:06.857869] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-09-15T19:01:07.148214] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-15T19:01:07.407612] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-15T19:01:07.657929] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-09-15T19:01:08.457912] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-09. [2025-09-15T19:01:09.261447] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-09-15T19:01:09.267132] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T19:01:10.057908] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-09-15T19:01:10.247205] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-15T19:01:10.255999] [INFO ] [REMOTE ] JBS: Full fetch complete (24063 records). [2025-09-15T19:01:10.256183] [DEBUG] [VALIDATOR ] JBS: Validating primary data. [2025-09-15T19:01:10.449136] [WARN ] [VALIDATOR ] JBS: Validation failed - insufficient historical data. Have 63 unique days, need 150 days [2025-09-15T19:01:10.449557] [FATAL] [MAIN ] JBS: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:01:10.449613] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:01:10.449681] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-15T19:01:10.449751] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-15T19:01:10.449808] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-09-15T19:01:10.449889] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-09-15T19:01:10.449988] [INFO ] [MAIN ] Update Progress: 1143/2369 symbols completed. JBS took 23.8s. Estimated remaining: 2h 9m 55s. Rate: 9.4 symbols/min [2025-09-15T19:01:10.638557] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:01:10.681459] [DEBUG] [LOCAL ] JCI: Loaded 40310 existing records from primary storage. [2025-09-15T19:01:10.681608] [INFO ] [MAIN ] JCI: Loaded 40310 existing records. [2025-09-15T19:01:10.862273] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-09-15T19:01:10.866835] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:01:10.868191] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-09-15T19:01:10.868329] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-09-15T19:01:10.869342] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-09-15T19:01:10.869396] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-09-15T19:01:11.134207] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-15T19:01:11.255465] [INFO ] [REMOTE ] JCI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:01:11.409812] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T19:01:11.415345] [INFO ] [REMOTE ] JBL: Full fetch complete (52442 records). [2025-09-15T19:01:11.415460] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-09-15T19:01:11.525977] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-15T19:01:11.663093] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-09-15T19:01:11.825074] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-09-15T19:01:11.825172] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-09-15T19:01:11.826093] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-09-15T19:01:11.826162] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-09-15T19:01:11.827444] [DEBUG] [LOCAL ] JBL: Trimmed 52442 records to 35106 (keeping 150 days of data) [2025-09-15T19:01:12.077973] [DEBUG] [LOCAL ] JBL: Primary data saved (35106 records). [2025-09-15T19:01:12.078136] [INFO ] [MAIN ] JBL: Full history saved. [2025-09-15T19:01:12.078245] [INFO ] [MAIN ] Update Progress: 1144/2369 symbols completed. JBL took 29.0s. Estimated remaining: 2h 9m 43s. Rate: 9.4 symbols/min [2025-09-15T19:01:12.241553] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-15T19:01:12.273837] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:01:12.317538] [DEBUG] [LOCAL ] JEF: Loaded 37153 existing records from primary storage. [2025-09-15T19:01:12.317826] [INFO ] [MAIN ] JEF: Loaded 37153 existing records. [2025-09-15T19:01:12.463008] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-09-15T19:01:12.512213] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:01:12.513195] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-09-15T19:01:12.513262] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-09-15T19:01:12.514310] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-09-15T19:01:12.514367] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-09-15T19:01:12.864914] [INFO ] [REMOTE ] JEF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:01:13.059842] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-15T19:01:13.257869] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-09-15T19:01:13.788796] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-15T19:01:14.057899] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-09-15T19:01:14.857904] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-09-15T19:01:15.650430] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-15T19:01:15.665054] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-09-15T19:01:15.683188] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-15T19:01:16.457876] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-09-15T19:01:17.190612] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-15T19:01:17.257868] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-09-15T19:01:18.057926] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-09-15T19:01:18.146165] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-15T19:01:18.635006] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-15T19:01:18.857926] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-09-15T19:01:19.059534] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-15T19:01:19.657862] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-09-15T19:01:19.680879] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-15T19:01:19.682731] [INFO ] [REMOTE ] JCE: Full fetch complete (6614 records). [2025-09-15T19:01:19.682806] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-09-15T19:01:20.032626] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-09-15T19:01:20.032719] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-09-15T19:01:20.032887] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-09-15T19:01:20.032924] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-09-15T19:01:20.033308] [DEBUG] [LOCAL ] JCE: Trimmed 6614 records to 4686 (keeping 150 days of data) [2025-09-15T19:01:20.062347] [DEBUG] [LOCAL ] JCE: Primary data saved (4686 records). [2025-09-15T19:01:20.062417] [INFO ] [MAIN ] JCE: Full history saved. [2025-09-15T19:01:20.062486] [INFO ] [MAIN ] Update Progress: 1145/2369 symbols completed. JCE took 15.8s. Estimated remaining: 2h 9m 39s. Rate: 9.4 symbols/min [2025-09-15T19:01:20.229435] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:01:20.261839] [DEBUG] [LOCAL ] JELD: Loaded 34820 existing records from primary storage. [2025-09-15T19:01:20.261980] [INFO ] [MAIN ] JELD: Loaded 34820 existing records. [2025-09-15T19:01:20.439285] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:01:20.439534] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-09-15T19:01:20.439583] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-09-15T19:01:20.440361] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-09-15T19:01:20.440414] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-09-15T19:01:20.462957] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-09-15T19:01:20.793562] [INFO ] [REMOTE ] JELD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:01:21.257866] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-09-15T19:01:21.637388] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-15T19:01:22.057840] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-09-15T19:01:22.103130] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T19:01:22.470831] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T19:01:22.857886] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-09-15T19:01:23.657830] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-09-15T19:01:23.798077] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-15T19:01:23.949211] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-15T19:01:24.457876] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-09-15T19:01:25.016555] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-15T19:01:25.257897] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-09-15T19:01:25.415482] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-15T19:01:26.057883] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-09-15T19:01:26.799386] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-15T19:01:26.857858] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-09-15T19:01:27.421670] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-15T19:01:27.657877] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-09-15T19:01:28.169005] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T19:01:28.457942] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-09-15T19:01:29.257926] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-09-15T19:01:29.436884] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-15T19:01:29.673669] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-15T19:01:30.057871] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-09-15T19:01:30.848160] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-15T19:01:30.858399] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-09-15T19:01:31.465988] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-15T19:01:31.470033] [INFO ] [REMOTE ] JBTM: Full fetch complete (35089 records). [2025-09-15T19:01:31.470182] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-09-15T19:01:31.664453] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-09-15T19:01:31.870708] [DEBUG] [VALIDATOR ] JBTM: All expected trading days are present. [2025-09-15T19:01:31.870804] [DEBUG] [VALIDATOR ] JBTM: Primary data validation passed. [2025-09-15T19:01:31.871508] [INFO ] [MAIN ] JBTM: Fetched primary data is valid. [2025-09-15T19:01:31.871552] [DEBUG] [LOCAL ] JBTM: Saving primary data. [2025-09-15T19:01:31.872595] [DEBUG] [LOCAL ] JBTM: Trimmed 35089 records to 23791 (keeping 150 days of data) [2025-09-15T19:01:32.024618] [DEBUG] [LOCAL ] JBTM: Primary data saved (23791 records). [2025-09-15T19:01:32.024898] [INFO ] [MAIN ] JBTM: Full history saved. [2025-09-15T19:01:32.024995] [INFO ] [MAIN ] Update Progress: 1146/2369 symbols completed. JBTM took 37.2s. Estimated remaining: 2h 9m 38s. Rate: 9.4 symbols/min [2025-09-15T19:01:32.209072] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:01:32.216522] [DEBUG] [LOCAL ] JEQ: Loaded 5984 existing records from primary storage. [2025-09-15T19:01:32.216610] [INFO ] [MAIN ] JEQ: Loaded 5984 existing records. [2025-09-15T19:01:32.400545] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:01:32.400827] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-09-15T19:01:32.400918] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-09-15T19:01:32.401257] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-09-15T19:01:32.401309] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-09-15T19:01:32.469231] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-09-15T19:01:32.779331] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:01:32.813274] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-15T19:01:33.258359] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-09-15T19:01:33.258273] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-15T19:01:33.749127] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T19:01:34.057928] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-09-15T19:01:34.533585] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-15T19:01:34.845499] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-15T19:01:34.857809] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-09-15T19:01:35.657930] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-09-15T19:01:36.191529] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-15T19:01:36.197799] [INFO ] [REMOTE ] JCI: Full fetch complete (58228 records). [2025-09-15T19:01:36.197912] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-09-15T19:01:36.463056] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-09-15T19:01:36.579605] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-09-15T19:01:36.579760] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-09-15T19:01:36.580558] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-09-15T19:01:36.580609] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-09-15T19:01:36.588908] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-15T19:01:36.592437] [DEBUG] [LOCAL ] JCI: Trimmed 58228 records to 39530 (keeping 150 days of data) [2025-09-15T19:01:36.841327] [DEBUG] [LOCAL ] JCI: Primary data saved (39530 records). [2025-09-15T19:01:36.841471] [INFO ] [MAIN ] JCI: Full history saved. [2025-09-15T19:01:36.842105] [INFO ] [MAIN ] Update Progress: 1147/2369 symbols completed. JCI took 26.4s. Estimated remaining: 2h 9m 30s. Rate: 9.4 symbols/min [2025-09-15T19:01:37.011595] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:01:37.033758] [DEBUG] [LOCAL ] JFR: Loaded 21807 existing records from primary storage. [2025-09-15T19:01:37.033895] [INFO ] [MAIN ] JFR: Loaded 21807 existing records. [2025-09-15T19:01:37.207992] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:01:37.208251] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-09-15T19:01:37.208302] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-09-15T19:01:37.208923] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-09-15T19:01:37.208975] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-09-15T19:01:37.270819] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-09-15T19:01:37.560004] [INFO ] [REMOTE ] JFR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:01:38.026884] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-15T19:01:38.057853] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-09-15T19:01:38.205621] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-15T19:01:38.211191] [INFO ] [REMOTE ] JEF: Full fetch complete (54479 records). [2025-09-15T19:01:38.211292] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-09-15T19:01:38.596346] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-09-15T19:01:38.596458] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-09-15T19:01:38.597320] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-09-15T19:01:38.597371] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-09-15T19:01:38.598516] [DEBUG] [LOCAL ] JEF: Trimmed 54479 records to 36411 (keeping 150 days of data) [2025-09-15T19:01:38.808253] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-15T19:01:38.833943] [DEBUG] [LOCAL ] JEF: Primary data saved (36411 records). [2025-09-15T19:01:38.834056] [INFO ] [MAIN ] JEF: Full history saved. [2025-09-15T19:01:38.835221] [INFO ] [MAIN ] Update Progress: 1148/2369 symbols completed. JEF took 26.8s. Estimated remaining: 2h 9m 19s. Rate: 9.4 symbols/min [2025-09-15T19:01:38.864128] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-09-15T19:01:39.005611] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:01:39.015635] [DEBUG] [LOCAL ] JGH: Loaded 8181 existing records from primary storage. [2025-09-15T19:01:39.015775] [INFO ] [MAIN ] JGH: Loaded 8181 existing records. [2025-09-15T19:01:39.192710] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:01:39.192983] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-09-15T19:01:39.193029] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-09-15T19:01:39.193342] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-09-15T19:01:39.193397] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-09-15T19:01:39.541110] [INFO ] [REMOTE ] JGH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:01:39.657823] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-09-15T19:01:40.316372] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-15T19:01:40.457931] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-09-15T19:01:40.595490] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-15T19:01:40.867277] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-15T19:01:41.257922] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-09-15T19:01:42.057899] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-09-15T19:01:42.322253] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-15T19:01:42.500068] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-15T19:01:42.857922] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-09-15T19:01:43.657913] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-09-15T19:01:44.291685] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-15T19:01:44.324827] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T19:01:44.457884] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-09-15T19:01:45.257879] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-09-15T19:01:45.827673] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-15T19:01:45.874235] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-15T19:01:46.057888] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-09-15T19:01:46.857877] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-09-15T19:01:47.514677] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-15T19:01:47.517355] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T19:01:47.518782] [INFO ] [REMOTE ] JEQ: Full fetch complete (9329 records). [2025-09-15T19:01:47.529687] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-09-15T19:01:47.663040] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-09-15T19:01:47.917780] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-09-15T19:01:47.917873] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-09-15T19:01:47.918140] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-09-15T19:01:47.918214] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-09-15T19:01:47.918738] [DEBUG] [LOCAL ] JEQ: Trimmed 9329 records to 5801 (keeping 150 days of data) [2025-09-15T19:01:47.951934] [DEBUG] [LOCAL ] JEQ: Primary data saved (5801 records). [2025-09-15T19:01:47.952072] [INFO ] [MAIN ] JEQ: Full history saved. [2025-09-15T19:01:47.952161] [INFO ] [MAIN ] Update Progress: 1149/2369 symbols completed. JEQ took 15.9s. Estimated remaining: 2h 9m 16s. Rate: 9.4 symbols/min [2025-09-15T19:01:48.126302] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:01:48.162479] [DEBUG] [LOCAL ] JHG: Loaded 35896 existing records from primary storage. [2025-09-15T19:01:48.162631] [INFO ] [MAIN ] JHG: Loaded 35896 existing records. [2025-09-15T19:01:48.342863] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:01:48.343141] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-09-15T19:01:48.343186] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-09-15T19:01:48.344025] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-09-15T19:01:48.344077] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-09-15T19:01:48.463058] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-09-15T19:01:48.708563] [INFO ] [REMOTE ] JHG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:01:49.263392] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-09-15T19:01:49.267746] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T19:01:49.274164] [INFO ] [REMOTE ] JELD: Full fetch complete (49998 records). [2025-09-15T19:01:49.274368] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-09-15T19:01:49.717085] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-09-15T19:01:49.717197] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-09-15T19:01:49.718233] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-09-15T19:01:49.718284] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-09-15T19:01:49.719919] [DEBUG] [LOCAL ] JELD: Trimmed 49998 records to 34097 (keeping 150 days of data) [2025-09-15T19:01:49.939441] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-15T19:01:49.963238] [DEBUG] [LOCAL ] JELD: Primary data saved (34097 records). [2025-09-15T19:01:49.963459] [INFO ] [MAIN ] JELD: Full history saved. [2025-09-15T19:01:49.963597] [INFO ] [MAIN ] Update Progress: 1150/2369 symbols completed. JELD took 29.9s. Estimated remaining: 2h 9m 5s. Rate: 9.4 symbols/min [2025-09-15T19:01:50.064889] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-09-15T19:01:50.161094] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:01:50.171501] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-15T19:01:50.180232] [DEBUG] [LOCAL ] JHI: Loaded 2528 existing records from primary storage. [2025-09-15T19:01:50.180453] [INFO ] [MAIN ] JHI: Loaded 2528 existing records. [2025-09-15T19:01:50.367820] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:01:50.368296] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-09-15T19:01:50.368352] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-09-15T19:01:50.369138] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-09-15T19:01:50.369197] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-09-15T19:01:50.739596] [INFO ] [REMOTE ] JHI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:01:50.857949] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-09-15T19:01:51.628745] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-15T19:01:51.660778] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-09-15T19:01:51.666658] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T19:01:52.457902] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-09-15T19:01:52.702793] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-15T19:01:52.970710] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-15T19:01:53.257991] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-09-15T19:01:54.057888] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-09-15T19:01:54.088358] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-15T19:01:54.857875] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-09-15T19:01:55.591363] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-15T19:01:55.657827] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-09-15T19:01:56.090370] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-15T19:01:56.457902] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-09-15T19:01:57.213080] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-15T19:01:57.257820] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-09-15T19:01:57.685957] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T19:01:58.057877] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-09-15T19:01:58.644329] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-15T19:01:58.857880] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-09-15T19:01:58.959030] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-15T19:01:59.195224] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-15T19:01:59.657892] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-09-15T19:02:00.036575] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-15T19:02:00.457892] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-09-15T19:02:01.257910] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-09-15T19:02:01.835900] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-15T19:02:01.859779] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-15T19:02:02.057868] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-09-15T19:02:02.857877] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-09-15T19:02:03.467142] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T19:02:03.657874] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-09-15T19:02:03.724112] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-15T19:02:04.457900] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-09-15T19:02:04.909304] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-15T19:02:05.173477] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-15T19:02:05.257884] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-09-15T19:02:06.057921] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-09-15T19:02:06.450145] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-15T19:02:06.475575] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-15T19:02:06.857903] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-09-15T19:02:07.442883] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-15T19:02:07.445077] [INFO ] [REMOTE ] JGH: Full fetch complete (11411 records). [2025-09-15T19:02:07.445157] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-09-15T19:02:07.663081] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-09-15T19:02:07.818508] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-09-15T19:02:07.818592] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-09-15T19:02:07.818884] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-09-15T19:02:07.818951] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-09-15T19:02:07.819423] [DEBUG] [LOCAL ] JGH: Trimmed 11411 records to 8029 (keeping 150 days of data) [2025-09-15T19:02:07.871265] [DEBUG] [LOCAL ] JGH: Primary data saved (8029 records). [2025-09-15T19:02:07.871414] [INFO ] [MAIN ] JGH: Full history saved. [2025-09-15T19:02:07.871504] [INFO ] [MAIN ] Update Progress: 1151/2369 symbols completed. JGH took 29.0s. Estimated remaining: 2h 9m 11s. Rate: 9.4 symbols/min [2025-09-15T19:02:08.043007] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:02:08.047140] [DEBUG] [LOCAL ] JHS: Loaded 2243 existing records from primary storage. [2025-09-15T19:02:08.047228] [INFO ] [MAIN ] JHS: Loaded 2243 existing records. [2025-09-15T19:02:08.236852] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:02:08.237124] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-09-15T19:02:08.237192] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-09-15T19:02:08.237474] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-09-15T19:02:08.237524] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-09-15T19:02:08.464381] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-09-15T19:02:08.602841] [INFO ] [REMOTE ] JHS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:02:08.868096] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-15T19:02:08.869696] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-15T19:02:08.874876] [INFO ] [REMOTE ] JFR: Full fetch complete (34664 records). [2025-09-15T19:02:08.874985] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-09-15T19:02:09.245578] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-09-15T19:02:09.245712] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-09-15T19:02:09.246447] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-09-15T19:02:09.246493] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-09-15T19:02:09.247691] [DEBUG] [LOCAL ] JFR: Trimmed 34664 records to 21424 (keeping 150 days of data) [2025-09-15T19:02:09.298350] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-09-15T19:02:09.381768] [DEBUG] [LOCAL ] JFR: Primary data saved (21424 records). [2025-09-15T19:02:09.381912] [INFO ] [MAIN ] JFR: Full history saved. [2025-09-15T19:02:09.382026] [INFO ] [MAIN ] Update Progress: 1152/2369 symbols completed. JFR took 32.5s. Estimated remaining: 2h 8m 59s. Rate: 9.4 symbols/min [2025-09-15T19:02:09.550047] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:02:09.589265] [DEBUG] [LOCAL ] JHX: Loaded 39971 existing records from primary storage. [2025-09-15T19:02:09.589409] [INFO ] [MAIN ] JHX: Loaded 39971 existing records. [2025-09-15T19:02:09.771907] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:02:09.772185] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-09-15T19:02:09.772232] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-09-15T19:02:09.773131] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-09-15T19:02:09.773182] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-09-15T19:02:09.875749] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-15T19:02:10.063041] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-09-15T19:02:10.133289] [INFO ] [REMOTE ] JHX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:02:10.727900] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-15T19:02:10.729546] [INFO ] [REMOTE ] JHI: Full fetch complete (4008 records). [2025-09-15T19:02:10.729625] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-09-15T19:02:10.872576] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-09-15T19:02:11.093699] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-09-15T19:02:11.093790] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-09-15T19:02:11.093932] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-09-15T19:02:11.093982] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-09-15T19:02:11.094477] [DEBUG] [LOCAL ] JHI: Trimmed 4008 records to 2473 (keeping 150 days of data) [2025-09-15T19:02:11.112693] [DEBUG] [LOCAL ] JHI: Primary data saved (2473 records). [2025-09-15T19:02:11.112846] [INFO ] [MAIN ] JHI: Full history saved. [2025-09-15T19:02:11.112960] [INFO ] [MAIN ] Update Progress: 1153/2369 symbols completed. JHI took 21.1s. Estimated remaining: 2h 8m 48s. Rate: 9.4 symbols/min [2025-09-15T19:02:11.284854] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:02:11.297181] [DEBUG] [LOCAL ] JILL: Loaded 11746 existing records from primary storage. [2025-09-15T19:02:11.297298] [INFO ] [MAIN ] JILL: Loaded 11746 existing records. [2025-09-15T19:02:11.485849] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:02:11.486310] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-09-15T19:02:11.486386] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-09-15T19:02:11.496946] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-09-15T19:02:11.496878] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-15T19:02:11.499836] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-09-15T19:02:11.680093] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-09-15T19:02:11.865625] [INFO ] [REMOTE ] JILL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:02:12.457917] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-09-15T19:02:12.783982] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-15T19:02:13.257881] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-09-15T19:02:13.602384] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-15T19:02:13.607677] [INFO ] [REMOTE ] JHG: Full fetch complete (52122 records). [2025-09-15T19:02:13.607797] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-09-15T19:02:13.878205] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-15T19:02:13.993149] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-09-15T19:02:13.993231] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-09-15T19:02:13.994007] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-09-15T19:02:13.994052] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-09-15T19:02:13.995274] [DEBUG] [LOCAL ] JHG: Trimmed 52122 records to 35163 (keeping 150 days of data) [2025-09-15T19:02:14.061343] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-09-15T19:02:14.220366] [DEBUG] [LOCAL ] JHG: Primary data saved (35163 records). [2025-09-15T19:02:14.220519] [INFO ] [MAIN ] JHG: Full history saved. [2025-09-15T19:02:14.221223] [INFO ] [MAIN ] Update Progress: 1154/2369 symbols completed. JHG took 26.3s. Estimated remaining: 2h 8m 38s. Rate: 9.4 symbols/min [2025-09-15T19:02:14.389960] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:02:14.421785] [DEBUG] [LOCAL ] JKS: Loaded 28986 existing records from primary storage. [2025-09-15T19:02:14.421934] [INFO ] [MAIN ] JKS: Loaded 28986 existing records. [2025-09-15T19:02:14.526324] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-15T19:02:14.612712] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:02:14.613078] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-09-15T19:02:14.613133] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-09-15T19:02:14.613811] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-09-15T19:02:14.613860] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-09-15T19:02:14.863131] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-09-15T19:02:14.968455] [INFO ] [REMOTE ] JKS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:02:15.312156] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-15T19:02:15.657901] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-09-15T19:02:16.111157] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-15T19:02:16.457919] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-09-15T19:02:17.257904] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-09-15T19:02:17.699549] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T19:02:17.793368] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-15T19:02:18.057877] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-09-15T19:02:18.857873] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-09-15T19:02:19.523381] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T19:02:19.568464] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-15T19:02:19.657854] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-09-15T19:02:20.356091] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-15T19:02:20.457876] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-09-15T19:02:21.006866] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-15T19:02:21.257951] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-09-15T19:02:22.057969] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-09-15T19:02:22.258052] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-15T19:02:22.442051] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-15T19:02:22.857880] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-09-15T19:02:23.643378] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-15T19:02:23.657826] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-09-15T19:02:24.457919] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-09-15T19:02:24.654021] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-15T19:02:25.257884] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-09-15T19:02:25.790528] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-15T19:02:26.057865] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-09-15T19:02:26.383090] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-15T19:02:26.857918] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-09-15T19:02:27.223486] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-15T19:02:27.657924] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-09-15T19:02:28.457888] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-09-15T19:02:28.513674] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T19:02:28.740109] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-15T19:02:29.050109] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-15T19:02:29.051533] [INFO ] [REMOTE ] JHS: Full fetch complete (3283 records). [2025-09-15T19:02:29.051840] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-09-15T19:02:29.268088] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-09-15T19:02:29.424465] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-09-15T19:02:29.424566] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-09-15T19:02:29.424708] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-09-15T19:02:29.424753] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-09-15T19:02:29.425161] [DEBUG] [LOCAL ] JHS: Trimmed 3283 records to 2257 (keeping 150 days of data) [2025-09-15T19:02:29.440075] [DEBUG] [LOCAL ] JHS: Primary data saved (2257 records). [2025-09-15T19:02:29.440193] [INFO ] [MAIN ] JHS: Full history saved. [2025-09-15T19:02:29.440293] [INFO ] [MAIN ] Update Progress: 1155/2369 symbols completed. JHS took 21.6s. Estimated remaining: 2h 8m 41s. Rate: 9.4 symbols/min [2025-09-15T19:02:29.618791] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:02:29.644915] [DEBUG] [LOCAL ] JLL: Loaded 24398 existing records from primary storage. [2025-09-15T19:02:29.645076] [INFO ] [MAIN ] JLL: Loaded 24398 existing records. [2025-09-15T19:02:29.828493] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:02:29.828781] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-09-15T19:02:29.828829] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-09-15T19:02:29.829522] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-09-15T19:02:29.829575] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-09-15T19:02:30.062969] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-09-15T19:02:30.199929] [INFO ] [REMOTE ] JLL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:02:30.745819] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T19:02:30.857879] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-09-15T19:02:31.657853] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-09-15T19:02:31.756782] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T19:02:31.913594] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T19:02:32.457873] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-09-15T19:02:32.968527] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-15T19:02:33.127081] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-15T19:02:33.257871] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-09-15T19:02:34.057883] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-09-15T19:02:34.219041] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-15T19:02:34.857888] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-09-15T19:02:35.443121] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-15T19:02:35.657916] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-09-15T19:02:36.233735] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-15T19:02:36.238556] [INFO ] [REMOTE ] JKS: Full fetch complete (43933 records). [2025-09-15T19:02:36.238716] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-09-15T19:02:36.462942] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-09-15T19:02:36.617379] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-09-15T19:02:36.617468] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-09-15T19:02:36.618211] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-09-15T19:02:36.618268] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-09-15T19:02:36.619388] [DEBUG] [LOCAL ] JKS: Trimmed 43933 records to 28310 (keeping 150 days of data) [2025-09-15T19:02:36.792554] [DEBUG] [LOCAL ] JKS: Primary data saved (28310 records). [2025-09-15T19:02:36.792714] [INFO ] [MAIN ] JKS: Full history saved. [2025-09-15T19:02:36.792816] [INFO ] [MAIN ] Update Progress: 1156/2369 symbols completed. JKS took 22.6s. Estimated remaining: 2h 8m 36s. Rate: 9.4 symbols/min [2025-09-15T19:02:36.971888] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:02:36.977219] [DEBUG] [LOCAL ] JLS: Loaded 2934 existing records from primary storage. [2025-09-15T19:02:36.977335] [INFO ] [MAIN ] JLS: Loaded 2934 existing records. [2025-09-15T19:02:37.157162] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:02:37.157425] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-09-15T19:02:37.157479] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-09-15T19:02:37.157771] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-09-15T19:02:37.157831] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-09-15T19:02:37.258446] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-09-15T19:02:37.527086] [INFO ] [REMOTE ] JLS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:02:37.528226] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-15T19:02:37.531211] [INFO ] [REMOTE ] JILL: Full fetch complete (17754 records). [2025-09-15T19:02:37.531287] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-09-15T19:02:37.849851] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-15T19:02:37.940392] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-09-15T19:02:37.940492] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-09-15T19:02:37.940948] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-09-15T19:02:37.941018] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-09-15T19:02:37.941684] [DEBUG] [LOCAL ] JILL: Trimmed 17754 records to 11480 (keeping 150 days of data) [2025-09-15T19:02:38.018427] [DEBUG] [LOCAL ] JILL: Primary data saved (11480 records). [2025-09-15T19:02:38.018635] [INFO ] [MAIN ] JILL: Full history saved. [2025-09-15T19:02:38.018809] [INFO ] [MAIN ] Update Progress: 1157/2369 symbols completed. JILL took 26.9s. Estimated remaining: 2h 8m 24s. Rate: 9.4 symbols/min [2025-09-15T19:02:38.057860] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-09-15T19:02:38.506925] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-15T19:02:38.857924] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-09-15T19:02:39.218009] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-15T19:02:39.657872] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-09-15T19:02:39.806788] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-15T19:02:39.813177] [INFO ] [REMOTE ] JHX: Full fetch complete (49417 records). [2025-09-15T19:02:39.813314] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-09-15T19:02:40.208740] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-15T19:02:40.208564] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-09-15T19:02:40.210232] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-09-15T19:02:40.211056] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-09-15T19:02:40.211105] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-09-15T19:02:40.213220] [DEBUG] [LOCAL ] JHX: Trimmed 49417 records to 39218 (keeping 150 days of data) [2025-09-15T19:02:40.454770] [DEBUG] [LOCAL ] JHX: Primary data saved (39218 records). [2025-09-15T19:02:40.454922] [INFO ] [MAIN ] JHX: Full history saved. [2025-09-15T19:02:40.456026] [INFO ] [MAIN ] Update Progress: 1158/2369 symbols completed. JHX took 31.1s. Estimated remaining: 2h 8m 14s. Rate: 9.4 symbols/min [2025-09-15T19:02:40.457864] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-09-15T19:02:41.257944] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-09-15T19:02:41.438150] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-15T19:02:41.834406] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-15T19:02:42.057869] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-09-15T19:02:42.646420] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-15T19:02:42.857950] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-09-15T19:02:43.657979] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-09-15T19:02:44.191096] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-15T19:02:44.219632] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-15T19:02:44.457880] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-09-15T19:02:44.934409] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-15T19:02:45.257930] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-09-15T19:02:45.609763] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-15T19:02:46.057900] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-09-15T19:02:46.623672] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-15T19:02:46.624781] [INFO ] [REMOTE ] JLS: Full fetch complete (4403 records). [2025-09-15T19:02:46.624874] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-09-15T19:02:46.866528] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-09-15T19:02:47.004430] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-09-15T19:02:47.004591] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-09-15T19:02:47.004781] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-09-15T19:02:47.004825] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-09-15T19:02:47.005205] [DEBUG] [LOCAL ] JLS: Trimmed 4403 records to 2854 (keeping 150 days of data) [2025-09-15T19:02:47.023739] [DEBUG] [LOCAL ] JLS: Primary data saved (2854 records). [2025-09-15T19:02:47.023824] [INFO ] [MAIN ] JLS: Full history saved. [2025-09-15T19:02:47.023914] [INFO ] [MAIN ] Update Progress: 1159/2369 symbols completed. JLS took 10.2s. Estimated remaining: 2h 8m 8s. Rate: 9.4 symbols/min [2025-09-15T19:02:47.956043] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-15T19:02:47.963287] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-09-15T19:02:48.973228] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T19:02:48.980887] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-09-15T19:02:50.323223] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-15T19:02:50.332997] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-09-15T19:02:51.519170] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-15T19:02:51.522932] [INFO ] [REMOTE ] JLL: Full fetch complete (35308 records). [2025-09-15T19:02:51.523039] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-09-15T19:02:51.897340] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-09-15T19:02:51.897453] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-09-15T19:02:51.898243] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-09-15T19:02:51.898295] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-09-15T19:02:51.899563] [DEBUG] [LOCAL ] JLL: Trimmed 35308 records to 23872 (keeping 150 days of data) [2025-09-15T19:02:52.082317] [DEBUG] [LOCAL ] JLL: Primary data saved (23872 records). [2025-09-15T19:02:52.082552] [INFO ] [MAIN ] JLL: Full history saved. [2025-09-15T19:02:52.082711] [INFO ] [MAIN ] Update Progress: 1160/2369 symbols completed. JLL took 22.6s. Estimated remaining: 2h 8m 0s. Rate: 9.4 symbols/min [2025-09-15T19:02:52.685783] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:02:52.703532] [DEBUG] [LOCAL ] JMIA: No existing data file found in primary storage. [2025-09-15T19:02:52.725466] [WARN ] [MAIN ] JMIA: No existing data found, performing full refresh instead. [2025-09-15T19:02:52.787278] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:02:52.807562] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-09-15T19:02:52.845067] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-09-15T19:02:52.866065] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:02:52.879346] [DEBUG] [LOCAL ] JMIA: No primary data file found to delete. [2025-09-15T19:02:52.866154] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-09-15T19:02:52.879498] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-09-15T19:02:52.882030] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-09-15T19:02:52.882087] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-09-15T19:02:52.939697] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-15T19:02:52.940858] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:02:52.956805] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-15T19:02:52.989971] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-09-15T19:02:53.357113] [DEBUG] [LOCAL ] JNJ: Loaded 40493 existing records from primary storage. [2025-09-15T19:02:53.471299] [INFO ] [MAIN ] JNJ: Loaded 40493 existing records. [2025-09-15T19:02:53.622093] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:02:53.678764] [DEBUG] [LOCAL ] JOBY: Loaded 40550 existing records from primary storage. [2025-09-15T19:02:53.716118] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-09-15T19:02:53.715711] [INFO ] [MAIN ] JOBY: Loaded 40550 existing records. [2025-09-15T19:02:53.878173] [INFO ] [REMOTE ] JMM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:02:53.944855] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-09-15T19:02:54.065665] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:02:54.095534] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-09-15T19:02:54.129169] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-09-15T19:02:54.134301] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:02:54.134488] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-09-15T19:02:54.134533] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-09-15T19:02:54.135382] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-09-15T19:02:54.135430] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-09-15T19:02:54.135472] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-09-15T19:02:54.141123] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-09-15T19:02:54.407978] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-15T19:02:54.488111] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-09-15T19:02:54.843167] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:02:54.858767] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-09-15T19:02:54.861813] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:02:54.862810] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-09-15T19:02:54.915118] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-15T19:02:54.916038] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-09-15T19:02:55.486959] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-15T19:02:55.488237] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-09-15T19:02:55.534097] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-15T19:02:55.657914] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-09-15T19:02:55.852787] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-15T19:02:56.457876] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-09-15T19:02:56.770003] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-15T19:02:56.895232] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-15T19:02:56.919694] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-15T19:02:57.257839] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-09-15T19:02:57.288973] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-15T19:02:58.057884] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-09-15T19:02:58.533161] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-15T19:02:58.857901] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-09-15T19:02:59.641794] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-15T19:02:59.657808] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-09-15T19:03:00.457886] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-09-15T19:03:00.788514] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-15T19:03:01.088000] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-15T19:03:01.257870] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-09-15T19:03:01.861327] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-15T19:03:02.057851] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-09-15T19:03:02.857918] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-09-15T19:03:03.657888] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-09-15T19:03:04.293539] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (3.04 seconds). [2025-09-15T19:03:04.457883] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-09-15T19:03:05.032421] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-15T19:03:05.033255] [INFO ] [REMOTE ] JMM: Full fetch complete (1966 records). [2025-09-15T19:03:05.033374] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-09-15T19:03:05.221829] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-15T19:03:05.222060] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:03:05.222124] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:03:05.222164] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-15T19:03:05.222486] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-15T19:03:05.222555] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-09-15T19:03:05.222756] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-09-15T19:03:05.222931] [INFO ] [MAIN ] Update Progress: 1161/2369 symbols completed. JMM took 13.1s. Estimated remaining: 2h 8m 1s. Rate: 9.4 symbols/min [2025-09-15T19:03:05.413162] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:03:05.455059] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (3.40 seconds). [2025-09-15T19:03:05.515825] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-09-15T19:03:05.513936] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-09-15T19:03:05.539915] [DEBUG] [LOCAL ] JOE: Loaded 17984 existing records from primary storage. [2025-09-15T19:03:05.540135] [INFO ] [MAIN ] JOE: Loaded 17984 existing records. [2025-09-15T19:03:05.738450] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:03:05.738889] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-09-15T19:03:05.738944] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-09-15T19:03:05.740074] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-09-15T19:03:05.740162] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-09-15T19:03:06.062988] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-09-15T19:03:06.125284] [INFO ] [REMOTE ] JOE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:03:06.654411] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-15T19:03:06.857926] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-09-15T19:03:07.639675] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T19:03:07.657821] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-09-15T19:03:08.099914] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.59 seconds). [2025-09-15T19:03:08.302443] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T19:03:08.457879] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-09-15T19:03:08.835033] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-15T19:03:09.257896] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-09-15T19:03:09.593010] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-15T19:03:10.057944] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-09-15T19:03:10.857883] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-09-15T19:03:11.019234] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-15T19:03:11.657876] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-09-15T19:03:12.168024] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T19:03:12.259056] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-15T19:03:12.457911] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-09-15T19:03:13.257899] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-09-15T19:03:13.596263] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-15T19:03:14.057949] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-09-15T19:03:14.467272] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-15T19:03:14.632993] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-15T19:03:14.857968] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-09-15T19:03:15.662963] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-09-15T19:03:15.680592] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-15T19:03:16.457926] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-09-15T19:03:16.983904] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-15T19:03:16.989845] [INFO ] [REMOTE ] JOBY: Full fetch complete (58475 records). [2025-09-15T19:03:16.989960] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-09-15T19:03:17.261760] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-09-15T19:03:17.395431] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-09-15T19:03:17.395592] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-09-15T19:03:17.396530] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-09-15T19:03:17.396607] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-09-15T19:03:17.430266] [DEBUG] [LOCAL ] JOBY: Trimmed 58475 records to 39771 (keeping 150 days of data) [2025-09-15T19:03:17.432923] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-15T19:03:17.696156] [DEBUG] [LOCAL ] JOBY: Primary data saved (39771 records). [2025-09-15T19:03:17.696329] [INFO ] [MAIN ] JOBY: Full history saved. [2025-09-15T19:03:17.696460] [INFO ] [MAIN ] Update Progress: 1162/2369 symbols completed. JOBY took 25.6s. Estimated remaining: 2h 8m 1s. Rate: 9.4 symbols/min [2025-09-15T19:03:17.877497] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:03:17.885217] [DEBUG] [LOCAL ] JOF: Loaded 5158 existing records from primary storage. [2025-09-15T19:03:17.885366] [INFO ] [MAIN ] JOF: Loaded 5158 existing records. [2025-09-15T19:03:18.059384] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-09-15T19:03:18.084080] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:03:18.084966] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-09-15T19:03:18.085016] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-09-15T19:03:18.085293] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-09-15T19:03:18.085340] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-09-15T19:03:18.453435] [INFO ] [REMOTE ] JOF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:03:18.624225] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-15T19:03:18.630507] [INFO ] [REMOTE ] JNJ: Full fetch complete (58433 records). [2025-09-15T19:03:18.630659] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-09-15T19:03:18.869007] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-09-15T19:03:19.016976] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-09-15T19:03:19.017062] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-09-15T19:03:19.017904] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-09-15T19:03:19.017949] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-09-15T19:03:19.019212] [DEBUG] [LOCAL ] JNJ: Trimmed 58433 records to 39713 (keeping 150 days of data) [2025-09-15T19:03:19.145834] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-15T19:03:19.303624] [DEBUG] [LOCAL ] JNJ: Primary data saved (39713 records). [2025-09-15T19:03:19.303797] [INFO ] [MAIN ] JNJ: Full history saved. [2025-09-15T19:03:19.303884] [INFO ] [MAIN ] Update Progress: 1163/2369 symbols completed. JNJ took 27.2s. Estimated remaining: 2h 7m 49s. Rate: 9.4 symbols/min [2025-09-15T19:03:19.476112] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-15T19:03:19.477475] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:03:19.504698] [DEBUG] [LOCAL ] JPC: Loaded 27300 existing records from primary storage. [2025-09-15T19:03:19.504836] [INFO ] [MAIN ] JPC: Loaded 27300 existing records. [2025-09-15T19:03:19.664503] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-09-15T19:03:19.686526] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:03:19.686738] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-09-15T19:03:19.686786] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-09-15T19:03:19.687485] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-09-15T19:03:19.687535] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-09-15T19:03:20.043056] [INFO ] [REMOTE ] JPC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:03:20.462968] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-09-15T19:03:20.473569] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-15T19:03:20.479787] [INFO ] [REMOTE ] JMIA: Full fetch complete (54791 records). [2025-09-15T19:03:20.479989] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-09-15T19:03:20.815529] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-15T19:03:20.894107] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-09-15T19:03:20.894261] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-09-15T19:03:20.895731] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-09-15T19:03:20.895799] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-09-15T19:03:20.897471] [DEBUG] [LOCAL ] JMIA: Trimmed 54791 records to 37586 (keeping 150 days of data) [2025-09-15T19:03:21.015991] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-15T19:03:21.141955] [DEBUG] [LOCAL ] JMIA: Primary data saved (37586 records). [2025-09-15T19:03:21.142114] [INFO ] [MAIN ] JMIA: Full history saved. [2025-09-15T19:03:21.142193] [INFO ] [MAIN ] Update Progress: 1164/2369 symbols completed. JMIA took 29.1s. Estimated remaining: 2h 7m 38s. Rate: 9.4 symbols/min [2025-09-15T19:03:21.263011] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-09-15T19:03:21.315674] [INFO ] [MAIN ] JPI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:03:21.321907] [DEBUG] [LOCAL ] JPI: Loaded 4000 existing records from primary storage. [2025-09-15T19:03:21.322025] [INFO ] [MAIN ] JPI: Loaded 4000 existing records. [2025-09-15T19:03:21.497497] [WARN ] [MAIN ] JPI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:03:21.497791] [INFO ] [MAIN ] JPI: Wiping existing primary data before full refresh. [2025-09-15T19:03:21.497839] [INFO ] [LOCAL ] JPI: Starting deletion of primary data. [2025-09-15T19:03:21.498108] [DEBUG] [LOCAL ] JPI: Deleted primary data file. [2025-09-15T19:03:21.498155] [INFO ] [MAIN ] JPI: Starting full primary refresh. [2025-09-15T19:03:21.874430] [INFO ] [REMOTE ] JPI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:03:22.057869] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-02. [2025-09-15T19:03:22.570094] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-15T19:03:22.629139] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T19:03:22.857881] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-09-15T19:03:23.657876] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-03. [2025-09-15T19:03:24.222202] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T19:03:24.248089] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-15T19:03:24.457891] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-09-15T19:03:25.257935] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-09-15T19:03:25.940051] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T19:03:26.010525] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-15T19:03:26.057828] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-09-15T19:03:26.857899] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-09-15T19:03:27.079255] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-15T19:03:27.657937] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-04. [2025-09-15T19:03:27.891484] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-15T19:03:28.051971] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-15T19:03:28.457868] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-09-15T19:03:29.257890] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-09-15T19:03:29.432484] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-15T19:03:29.960344] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-15T19:03:30.057876] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-05. [2025-09-15T19:03:30.667672] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-15T19:03:30.857872] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-09-15T19:03:31.434937] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-15T19:03:31.657857] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-06. [2025-09-15T19:03:32.235971] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-15T19:03:32.457862] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-09-15T19:03:33.257870] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-07. [2025-09-15T19:03:33.607463] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-15T19:03:33.835402] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-15T19:03:34.057879] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-08. [2025-09-15T19:03:34.682025] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-15T19:03:34.857870] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-09-15T19:03:35.599317] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-15T19:03:35.602159] [INFO ] [REMOTE ] JOE: Full fetch complete (26974 records). [2025-09-15T19:03:35.602233] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-09-15T19:03:35.663952] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-09-15T19:03:35.976763] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-09-15T19:03:35.976846] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-09-15T19:03:35.977402] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-09-15T19:03:35.977442] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-09-15T19:03:35.978144] [DEBUG] [LOCAL ] JOE: Trimmed 26974 records to 17669 (keeping 150 days of data) [2025-09-15T19:03:36.087695] [DEBUG] [LOCAL ] JOE: Primary data saved (17669 records). [2025-09-15T19:03:36.087848] [INFO ] [MAIN ] JOE: Full history saved. [2025-09-15T19:03:36.087934] [INFO ] [MAIN ] Update Progress: 1165/2369 symbols completed. JOE took 30.9s. Estimated remaining: 2h 7m 41s. Rate: 9.4 symbols/min [2025-09-15T19:03:36.258118] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:03:36.303141] [DEBUG] [LOCAL ] JPM: Loaded 40534 existing records from primary storage. [2025-09-15T19:03:36.303296] [INFO ] [MAIN ] JPM: Loaded 40534 existing records. [2025-09-15T19:03:36.457921] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-09. [2025-09-15T19:03:36.480854] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:03:36.481107] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-09-15T19:03:36.481154] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-09-15T19:03:36.482228] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-09-15T19:03:36.482282] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-09-15T19:03:36.845494] [INFO ] [REMOTE ] JPM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:03:36.869351] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T19:03:37.065455] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-15T19:03:37.066736] [INFO ] [REMOTE ] JPI: Full fetch complete (5865 records). [2025-09-15T19:03:37.066852] [DEBUG] [VALIDATOR ] JPI: Validating primary data. [2025-09-15T19:03:37.263025] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-09-15T19:03:37.442185] [DEBUG] [VALIDATOR ] JPI: All expected trading days are present. [2025-09-15T19:03:37.442296] [DEBUG] [VALIDATOR ] JPI: Primary data validation passed. [2025-09-15T19:03:37.442620] [INFO ] [MAIN ] JPI: Fetched primary data is valid. [2025-09-15T19:03:37.442683] [DEBUG] [LOCAL ] JPI: Saving primary data. [2025-09-15T19:03:37.443186] [DEBUG] [LOCAL ] JPI: Trimmed 5865 records to 3826 (keeping 150 days of data) [2025-09-15T19:03:37.474087] [DEBUG] [LOCAL ] JPI: Primary data saved (3826 records). [2025-09-15T19:03:37.474303] [INFO ] [MAIN ] JPI: Full history saved. [2025-09-15T19:03:37.474439] [INFO ] [MAIN ] Update Progress: 1166/2369 symbols completed. JPI took 16.3s. Estimated remaining: 2h 7m 29s. Rate: 9.4 symbols/min [2025-09-15T19:03:37.645140] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:03:37.668672] [DEBUG] [LOCAL ] JQC: Loaded 24817 existing records from primary storage. [2025-09-15T19:03:37.668824] [INFO ] [MAIN ] JQC: Loaded 24817 existing records. [2025-09-15T19:03:37.850502] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:03:37.850836] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-09-15T19:03:37.850884] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-09-15T19:03:37.851615] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-09-15T19:03:37.851693] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-09-15T19:03:38.063044] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-09-15T19:03:38.210911] [INFO ] [REMOTE ] JQC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:03:38.797367] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-15T19:03:38.857891] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-09-15T19:03:39.287073] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-15T19:03:39.459890] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-15T19:03:39.657939] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-09-15T19:03:40.244627] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-15T19:03:40.457864] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-09-15T19:03:41.096197] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-15T19:03:41.097914] [INFO ] [REMOTE ] JOF: Full fetch complete (7540 records). [2025-09-15T19:03:41.098003] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-09-15T19:03:41.258100] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-09-15T19:03:41.469075] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-09-15T19:03:41.469178] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-09-15T19:03:41.469419] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-09-15T19:03:41.469463] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-09-15T19:03:41.470166] [DEBUG] [LOCAL ] JOF: Trimmed 7540 records to 5046 (keeping 150 days of data) [2025-09-15T19:03:41.502551] [DEBUG] [LOCAL ] JOF: Primary data saved (5046 records). [2025-09-15T19:03:41.502741] [INFO ] [MAIN ] JOF: Full history saved. [2025-09-15T19:03:41.502840] [INFO ] [MAIN ] Update Progress: 1167/2369 symbols completed. JOF took 23.8s. Estimated remaining: 2h 7m 21s. Rate: 9.4 symbols/min [2025-09-15T19:03:41.681438] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:03:41.694006] [DEBUG] [LOCAL ] JRI: Loaded 11176 existing records from primary storage. [2025-09-15T19:03:41.698534] [INFO ] [MAIN ] JRI: Loaded 11176 existing records. [2025-09-15T19:03:41.880564] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:03:41.880887] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-09-15T19:03:41.880939] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-09-15T19:03:41.881359] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-09-15T19:03:41.881408] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-09-15T19:03:42.061266] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-09-15T19:03:42.286976] [INFO ] [REMOTE ] JRI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:03:42.857865] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-09-15T19:03:43.092302] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-15T19:03:43.657869] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-09-15T19:03:43.826892] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-09-15T19:03:43.847744] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-15T19:03:44.457958] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-09-15T19:03:44.663196] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-15T19:03:45.258006] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-09-15T19:03:45.780219] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T19:03:45.785934] [INFO ] [REMOTE ] JPC: Full fetch complete (40726 records). [2025-09-15T19:03:45.786064] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-09-15T19:03:46.061327] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-15T19:03:46.061450] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-09-15T19:03:46.204893] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-09-15T19:03:46.205057] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-09-15T19:03:46.206173] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-09-15T19:03:46.206244] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-09-15T19:03:46.207822] [DEBUG] [LOCAL ] JPC: Trimmed 40726 records to 26736 (keeping 150 days of data) [2025-09-15T19:03:46.378435] [DEBUG] [LOCAL ] JPC: Primary data saved (26736 records). [2025-09-15T19:03:46.378663] [INFO ] [MAIN ] JPC: Full history saved. [2025-09-15T19:03:46.378788] [INFO ] [MAIN ] Update Progress: 1168/2369 symbols completed. JPC took 27.1s. Estimated remaining: 2h 7m 13s. Rate: 9.4 symbols/min [2025-09-15T19:03:46.557998] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:03:46.568889] [DEBUG] [LOCAL ] JRS: Loaded 8399 existing records from primary storage. [2025-09-15T19:03:46.569054] [INFO ] [MAIN ] JRS: Loaded 8399 existing records. [2025-09-15T19:03:46.757841] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:03:46.758192] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-09-15T19:03:46.758243] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-09-15T19:03:46.758695] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-09-15T19:03:46.758750] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-09-15T19:03:46.864499] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-09-15T19:03:47.137106] [INFO ] [REMOTE ] JRS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:03:47.587165] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-15T19:03:47.657828] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-09-15T19:03:48.457937] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-09-15T19:03:49.050492] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-15T19:03:49.097355] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-15T19:03:49.215194] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-15T19:03:49.257826] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-09-15T19:03:50.057923] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-09-15T19:03:50.857904] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-09-15T19:03:50.996949] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-15T19:03:51.172113] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-15T19:03:51.657909] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-09-15T19:03:51.702823] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-15T19:03:52.457888] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-09-15T19:03:52.554244] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-15T19:03:53.257874] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-09-15T19:03:53.641477] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-15T19:03:54.057885] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-09-15T19:03:54.857902] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-09-15T19:03:55.167622] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-15T19:03:55.391811] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-15T19:03:55.405996] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-15T19:03:55.657870] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-09-15T19:03:56.457899] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-09-15T19:03:56.875725] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-15T19:03:56.879432] [INFO ] [REMOTE ] JQC: Full fetch complete (36678 records). [2025-09-15T19:03:56.879549] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-09-15T19:03:57.248267] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-09-15T19:03:57.248345] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-09-15T19:03:57.249031] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-09-15T19:03:57.249077] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-09-15T19:03:57.249878] [DEBUG] [LOCAL ] JQC: Trimmed 36678 records to 24051 (keeping 150 days of data) [2025-09-15T19:03:57.299614] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-09-15T19:03:57.394003] [DEBUG] [LOCAL ] JQC: Primary data saved (24051 records). [2025-09-15T19:03:57.394154] [INFO ] [MAIN ] JQC: Full history saved. [2025-09-15T19:03:57.394267] [INFO ] [MAIN ] Update Progress: 1169/2369 symbols completed. JQC took 19.9s. Estimated remaining: 2h 7m 11s. Rate: 9.4 symbols/min [2025-09-15T19:03:57.565505] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:03:57.597622] [DEBUG] [LOCAL ] JXN: Loaded 33633 existing records from primary storage. [2025-09-15T19:03:57.597797] [INFO ] [MAIN ] JXN: Loaded 33633 existing records. [2025-09-15T19:03:57.769571] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:03:57.769882] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-09-15T19:03:57.769941] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-09-15T19:03:57.770702] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-09-15T19:03:57.770752] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-09-15T19:03:58.063105] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-09-15T19:03:58.131360] [INFO ] [REMOTE ] JXN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:03:58.133756] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-15T19:03:58.857838] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-09-15T19:03:58.951854] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-15T19:03:59.019590] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-15T19:03:59.657906] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-09-15T19:04:00.156245] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-15T19:04:00.393123] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-15T19:04:00.457891] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-09-15T19:04:01.257900] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-09-15T19:04:01.268047] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-15T19:04:02.057929] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-09-15T19:04:02.713760] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-15T19:04:02.857907] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-09-15T19:04:03.552913] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-15T19:04:03.639259] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-15T19:04:03.657851] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-09-15T19:04:04.407714] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-15T19:04:04.457915] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-09-15T19:04:05.263593] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-09-15T19:04:05.266613] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T19:04:05.269565] [INFO ] [REMOTE ] JRI: Full fetch complete (16746 records). [2025-09-15T19:04:05.269672] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-09-15T19:04:05.636769] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-09-15T19:04:05.636883] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-09-15T19:04:05.637296] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-09-15T19:04:05.637344] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-09-15T19:04:05.638277] [DEBUG] [LOCAL ] JRI: Trimmed 16746 records to 11077 (keeping 150 days of data) [2025-09-15T19:04:05.711437] [DEBUG] [LOCAL ] JRI: Primary data saved (11077 records). [2025-09-15T19:04:05.711601] [INFO ] [MAIN ] JRI: Full history saved. [2025-09-15T19:04:05.711739] [INFO ] [MAIN ] Update Progress: 1170/2369 symbols completed. JRI took 24.2s. Estimated remaining: 2h 7m 7s. Rate: 9.4 symbols/min [2025-09-15T19:04:05.887245] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:04:05.927116] [DEBUG] [LOCAL ] K: Loaded 37697 existing records from primary storage. [2025-09-15T19:04:05.927270] [INFO ] [MAIN ] K: Loaded 37697 existing records. [2025-09-15T19:04:06.073277] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-09-15T19:04:06.114879] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:04:06.115171] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-09-15T19:04:06.115225] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-09-15T19:04:06.116144] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-09-15T19:04:06.116199] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-09-15T19:04:06.483483] [INFO ] [REMOTE ] K: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:04:06.743029] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-15T19:04:06.857922] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-09-15T19:04:06.920731] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-15T19:04:07.657993] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-09-15T19:04:08.246512] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-15T19:04:08.307357] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-15T19:04:08.310399] [INFO ] [REMOTE ] JRS: Full fetch complete (11972 records). [2025-09-15T19:04:08.310515] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-09-15T19:04:08.479037] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-09-15T19:04:08.726607] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-09-15T19:04:08.726753] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-09-15T19:04:08.727334] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-09-15T19:04:08.727381] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-09-15T19:04:08.727959] [DEBUG] [LOCAL ] JRS: Trimmed 11972 records to 8279 (keeping 150 days of data) [2025-09-15T19:04:08.781147] [DEBUG] [LOCAL ] JRS: Primary data saved (8279 records). [2025-09-15T19:04:08.781359] [INFO ] [MAIN ] JRS: Full history saved. [2025-09-15T19:04:08.781506] [INFO ] [MAIN ] Update Progress: 1171/2369 symbols completed. JRS took 22.4s. Estimated remaining: 2h 6m 57s. Rate: 9.4 symbols/min [2025-09-15T19:04:08.965904] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:04:08.977994] [DEBUG] [LOCAL ] KAI: Loaded 9945 existing records from primary storage. [2025-09-15T19:04:08.978142] [INFO ] [MAIN ] KAI: Loaded 9945 existing records. [2025-09-15T19:04:09.165998] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:04:09.166343] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-09-15T19:04:09.166394] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-09-15T19:04:09.166920] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-09-15T19:04:09.166982] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-09-15T19:04:09.263757] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-09-15T19:04:09.576793] [INFO ] [REMOTE ] KAI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:04:09.978606] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-15T19:04:10.057892] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-09-15T19:04:10.857908] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-09-15T19:04:11.611319] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T19:04:11.657829] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-09-15T19:04:11.676407] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-15T19:04:11.682291] [INFO ] [REMOTE ] JPM: Full fetch complete (58474 records). [2025-09-15T19:04:11.682449] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-09-15T19:04:12.071726] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-09-15T19:04:12.071829] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-09-15T19:04:12.072694] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-09-15T19:04:12.072757] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-09-15T19:04:12.074290] [DEBUG] [LOCAL ] JPM: Trimmed 58474 records to 39754 (keeping 150 days of data) [2025-09-15T19:04:12.220690] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-15T19:04:12.392309] [DEBUG] [LOCAL ] JPM: Primary data saved (39754 records). [2025-09-15T19:04:12.392479] [INFO ] [MAIN ] JPM: Full history saved. [2025-09-15T19:04:12.393321] [INFO ] [MAIN ] Update Progress: 1172/2369 symbols completed. JPM took 36.3s. Estimated remaining: 2h 6m 48s. Rate: 9.4 symbols/min [2025-09-15T19:04:12.466447] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-09-15T19:04:12.568486] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:04:12.601146] [DEBUG] [LOCAL ] KAR: Loaded 29952 existing records from primary storage. [2025-09-15T19:04:12.601301] [INFO ] [MAIN ] KAR: Loaded 29952 existing records. [2025-09-15T19:04:12.790439] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:04:12.790763] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-09-15T19:04:12.790815] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-09-15T19:04:12.791441] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-09-15T19:04:12.791492] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-09-15T19:04:13.164912] [INFO ] [REMOTE ] KAR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:04:13.235790] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T19:04:13.259407] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-09-15T19:04:13.262059] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-15T19:04:14.057910] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-09-15T19:04:14.857921] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-09-15T19:04:15.117732] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-15T19:04:15.361511] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-15T19:04:15.657915] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-09-15T19:04:16.226362] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T19:04:16.457937] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-09-15T19:04:16.861743] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-15T19:04:17.257885] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-09-15T19:04:17.736819] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T19:04:18.057855] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-09-15T19:04:18.478815] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T19:04:18.857873] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-09-15T19:04:19.657884] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-09-15T19:04:19.861534] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-15T19:04:19.885812] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-15T19:04:20.457911] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-09-15T19:04:20.757081] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-15T19:04:21.257897] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-09-15T19:04:22.044301] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-15T19:04:22.057816] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-09-15T19:04:22.328526] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-15T19:04:22.857871] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-09-15T19:04:23.533338] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T19:04:23.538273] [INFO ] [REMOTE ] JXN: Full fetch complete (50145 records). [2025-09-15T19:04:23.538375] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-09-15T19:04:23.662990] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-09-15T19:04:23.919880] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-09-15T19:04:23.920018] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-09-15T19:04:23.920789] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-09-15T19:04:23.920832] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-09-15T19:04:23.921846] [DEBUG] [LOCAL ] JXN: Trimmed 50145 records to 32954 (keeping 150 days of data) [2025-09-15T19:04:24.128149] [DEBUG] [LOCAL ] JXN: Primary data saved (32954 records). [2025-09-15T19:04:24.128287] [INFO ] [MAIN ] JXN: Full history saved. [2025-09-15T19:04:24.128368] [INFO ] [MAIN ] Update Progress: 1173/2369 symbols completed. JXN took 26.7s. Estimated remaining: 2h 6m 47s. Rate: 9.4 symbols/min [2025-09-15T19:04:24.300312] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:04:24.325547] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T19:04:24.345477] [DEBUG] [LOCAL ] KB: Loaded 18330 existing records from primary storage. [2025-09-15T19:04:24.345601] [INFO ] [MAIN ] KB: Loaded 18330 existing records. [2025-09-15T19:04:24.463034] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-09-15T19:04:24.523124] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:04:24.523416] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-09-15T19:04:24.523480] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-09-15T19:04:24.524130] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-09-15T19:04:24.524205] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-09-15T19:04:24.877279] [INFO ] [REMOTE ] KB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:04:25.257897] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-09-15T19:04:25.419250] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-15T19:04:25.457306] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-15T19:04:26.057937] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-09-15T19:04:26.792921] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-15T19:04:26.857875] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-09-15T19:04:27.371416] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-15T19:04:27.377353] [INFO ] [REMOTE ] K: Full fetch complete (53984 records). [2025-09-15T19:04:27.377524] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-09-15T19:04:27.662958] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-09-15T19:04:27.768939] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-09-15T19:04:27.769066] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-09-15T19:04:27.770144] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-09-15T19:04:27.770212] [DEBUG] [LOCAL ] K: Saving primary data. [2025-09-15T19:04:27.785216] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-15T19:04:27.784321] [DEBUG] [LOCAL ] K: Trimmed 53984 records to 37003 (keeping 150 days of data) [2025-09-15T19:04:28.033124] [DEBUG] [LOCAL ] K: Primary data saved (37003 records). [2025-09-15T19:04:28.033305] [INFO ] [MAIN ] K: Full history saved. [2025-09-15T19:04:28.035245] [INFO ] [MAIN ] Update Progress: 1174/2369 symbols completed. K took 22.3s. Estimated remaining: 2h 6m 38s. Rate: 9.4 symbols/min [2025-09-15T19:04:28.205256] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:04:28.222693] [DEBUG] [LOCAL ] KBDC: Loaded 14766 existing records from primary storage. [2025-09-15T19:04:28.222839] [INFO ] [MAIN ] KBDC: Loaded 14766 existing records. [2025-09-15T19:04:28.398570] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:04:28.398848] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-09-15T19:04:28.398895] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-09-15T19:04:28.399423] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-09-15T19:04:28.399481] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-09-15T19:04:28.462852] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-09-15T19:04:28.803694] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:04:28.813955] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-15T19:04:29.257866] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-09-15T19:04:29.727521] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T19:04:29.908025] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-15T19:04:30.057872] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-09-15T19:04:30.857872] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-09-15T19:04:31.056367] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-15T19:04:31.657903] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-09-15T19:04:31.873292] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-15T19:04:32.353454] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-15T19:04:32.457939] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-09-15T19:04:33.257883] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-09-15T19:04:33.341610] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-15T19:04:34.057862] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-09-15T19:04:34.313723] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-15T19:04:34.857897] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-09-15T19:04:35.049308] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T19:04:35.657867] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-09-15T19:04:36.178102] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T19:04:36.182984] [INFO ] [REMOTE ] KAR: Full fetch complete (43781 records). [2025-09-15T19:04:36.183116] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-09-15T19:04:36.458265] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-09-15T19:04:36.595689] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-09-15T19:04:36.595877] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-09-15T19:04:36.601894] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-09-15T19:04:36.601976] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-09-15T19:04:36.610257] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T19:04:36.615329] [DEBUG] [LOCAL ] KAR: Trimmed 43781 records to 29474 (keeping 150 days of data) [2025-09-15T19:04:36.797345] [DEBUG] [LOCAL ] KAR: Primary data saved (29474 records). [2025-09-15T19:04:36.797500] [INFO ] [MAIN ] KAR: Full history saved. [2025-09-15T19:04:36.797588] [INFO ] [MAIN ] Update Progress: 1175/2369 symbols completed. KAR took 24.4s. Estimated remaining: 2h 6m 34s. Rate: 9.4 symbols/min [2025-09-15T19:04:36.972937] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:04:37.015198] [DEBUG] [LOCAL ] KBH: Loaded 36402 existing records from primary storage. [2025-09-15T19:04:37.015344] [INFO ] [MAIN ] KBH: Loaded 36402 existing records. [2025-09-15T19:04:37.189287] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:04:37.189550] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-09-15T19:04:37.189595] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-09-15T19:04:37.190381] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-09-15T19:04:37.190434] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-09-15T19:04:37.264108] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-09-15T19:04:37.555606] [INFO ] [REMOTE ] KBH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:04:37.738135] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-15T19:04:38.057938] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-09-15T19:04:38.105859] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-15T19:04:38.857851] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-09-15T19:04:39.261197] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-15T19:04:39.490510] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-15T19:04:39.657891] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-09-15T19:04:40.457968] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-09-15T19:04:40.965830] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-15T19:04:41.257986] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-09-15T19:04:41.835656] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-15T19:04:41.976110] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-15T19:04:42.057938] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-09-15T19:04:42.857969] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-09-15T19:04:43.033913] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T19:04:43.035834] [INFO ] [REMOTE ] KAI: Full fetch complete (15359 records). [2025-09-15T19:04:43.035918] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-09-15T19:04:43.437332] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-09-15T19:04:43.437473] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-09-15T19:04:43.438147] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-09-15T19:04:43.438201] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-09-15T19:04:43.439061] [DEBUG] [LOCAL ] KAI: Trimmed 15359 records to 9742 (keeping 150 days of data) [2025-09-15T19:04:43.510257] [DEBUG] [LOCAL ] KAI: Primary data saved (9742 records). [2025-09-15T19:04:43.510478] [INFO ] [MAIN ] KAI: Full history saved. [2025-09-15T19:04:43.510634] [INFO ] [MAIN ] Update Progress: 1176/2369 symbols completed. KAI took 34.7s. Estimated remaining: 2h 6m 28s. Rate: 9.4 symbols/min [2025-09-15T19:04:43.665550] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-09-15T19:04:43.707284] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:04:43.754057] [DEBUG] [LOCAL ] KBR: Loaded 36186 existing records from primary storage. [2025-09-15T19:04:43.754303] [INFO ] [MAIN ] KBR: Loaded 36186 existing records. [2025-09-15T19:04:43.944692] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:04:43.945033] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-09-15T19:04:43.945084] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-09-15T19:04:43.946002] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-09-15T19:04:43.946057] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-09-15T19:04:44.327885] [INFO ] [REMOTE ] KBR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:04:44.457941] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-09-15T19:04:44.510760] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-15T19:04:44.690949] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-15T19:04:45.257903] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-09-15T19:04:45.525888] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-15T19:04:46.057960] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-09-15T19:04:46.321773] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T19:04:46.324603] [INFO ] [REMOTE ] KB: Full fetch complete (26821 records). [2025-09-15T19:04:46.324749] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-09-15T19:04:46.719340] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-09-15T19:04:46.719458] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-09-15T19:04:46.720467] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-09-15T19:04:46.720531] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-09-15T19:04:46.722728] [DEBUG] [LOCAL ] KB: Trimmed 26821 records to 17840 (keeping 150 days of data) [2025-09-15T19:04:46.846989] [DEBUG] [LOCAL ] KB: Primary data saved (17840 records). [2025-09-15T19:04:46.847185] [INFO ] [MAIN ] KB: Full history saved. [2025-09-15T19:04:46.847305] [INFO ] [MAIN ] Update Progress: 1177/2369 symbols completed. KB took 22.7s. Estimated remaining: 2h 6m 19s. Rate: 9.4 symbols/min [2025-09-15T19:04:46.863072] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-09-15T19:04:47.039348] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:04:47.040633] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T19:04:47.046285] [INFO ] [REMOTE ] KBDC: Full fetch complete (21941 records). [2025-09-15T19:04:47.046679] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-09-15T19:04:47.377192] [DEBUG] [LOCAL ] KD: Loaded 39273 existing records from primary storage. [2025-09-15T19:04:47.393325] [INFO ] [MAIN ] KD: Loaded 39273 existing records. [2025-09-15T19:04:47.550530] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-09-15T19:04:47.569817] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-09-15T19:04:47.573904] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-09-15T19:04:47.574355] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-09-15T19:04:47.636607] [DEBUG] [LOCAL ] KBDC: Trimmed 21941 records to 14554 (keeping 150 days of data) [2025-09-15T19:04:47.658493] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-09-15T19:04:47.658723] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:04:47.660480] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-09-15T19:04:47.660610] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-09-15T19:04:47.661736] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-09-15T19:04:47.661811] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-09-15T19:04:48.117528] [DEBUG] [LOCAL ] KBDC: Primary data saved (14554 records). [2025-09-15T19:04:48.142424] [INFO ] [MAIN ] KBDC: Full history saved. [2025-09-15T19:04:48.152184] [INFO ] [MAIN ] Update Progress: 1178/2369 symbols completed. KBDC took 20.1s. Estimated remaining: 2h 6m 7s. Rate: 9.4 symbols/min [2025-09-15T19:04:48.225811] [INFO ] [REMOTE ] KD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:04:48.369011] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:04:48.376472] [DEBUG] [LOCAL ] KEN: Loaded 3435 existing records from primary storage. [2025-09-15T19:04:48.376629] [INFO ] [MAIN ] KEN: Loaded 3435 existing records. [2025-09-15T19:04:48.460250] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-09-15T19:04:48.570216] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:04:48.570994] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-09-15T19:04:48.571149] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-09-15T19:04:48.580828] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-09-15T19:04:48.595343] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-09-15T19:04:48.673778] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-15T19:04:48.986785] [INFO ] [REMOTE ] KEN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:04:49.257952] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-09-15T19:04:49.466770] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-15T19:04:49.563111] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-15T19:04:49.980775] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-15T19:04:50.057888] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-09-15T19:04:50.857903] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-09-15T19:04:51.332572] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-15T19:04:51.640528] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T19:04:51.657811] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-09-15T19:04:52.457932] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-09-15T19:04:53.004473] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-15T19:04:53.257923] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-09-15T19:04:53.477803] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-15T19:04:54.057930] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-09-15T19:04:54.445614] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-15T19:04:54.857874] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-09-15T19:04:54.960982] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-15T19:04:55.210685] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-15T19:04:55.657877] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-09-15T19:04:56.457888] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-09-15T19:04:57.257882] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-09-15T19:04:57.385584] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-15T19:04:58.057912] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-09-15T19:04:58.162799] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-15T19:04:58.585375] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-15T19:04:58.857878] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-09-15T19:04:59.552095] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T19:04:59.657926] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-09-15T19:05:00.457891] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-09-15T19:05:00.547779] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-15T19:05:01.257938] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-09-15T19:05:01.393659] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-15T19:05:01.758435] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-15T19:05:01.770973] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-15T19:05:02.057938] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-09-15T19:05:02.639586] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-15T19:05:02.857871] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-09-15T19:05:03.459837] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-15T19:05:03.460882] [INFO ] [REMOTE ] KEN: Full fetch complete (4864 records). [2025-09-15T19:05:03.460953] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-09-15T19:05:03.663072] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-09-15T19:05:03.825413] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-09-15T19:05:03.825515] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-09-15T19:05:03.825729] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-09-15T19:05:03.825786] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-09-15T19:05:03.826175] [DEBUG] [LOCAL ] KEN: Trimmed 4864 records to 3286 (keeping 150 days of data) [2025-09-15T19:05:03.846803] [DEBUG] [LOCAL ] KEN: Primary data saved (3286 records). [2025-09-15T19:05:03.846905] [INFO ] [MAIN ] KEN: Full history saved. [2025-09-15T19:05:03.846999] [INFO ] [MAIN ] Update Progress: 1179/2369 symbols completed. KEN took 15.7s. Estimated remaining: 2h 6m 10s. Rate: 9.4 symbols/min [2025-09-15T19:05:04.015551] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:05:04.041211] [DEBUG] [LOCAL ] KEP: Loaded 24446 existing records from primary storage. [2025-09-15T19:05:04.041361] [INFO ] [MAIN ] KEP: Loaded 24446 existing records. [2025-09-15T19:05:04.218577] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:05:04.218934] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-09-15T19:05:04.218987] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-09-15T19:05:04.219690] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-09-15T19:05:04.219752] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-09-15T19:05:04.463104] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-09-15T19:05:04.570121] [INFO ] [REMOTE ] KEP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:05:05.257896] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-09-15T19:05:05.577958] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-15T19:05:05.791930] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-15T19:05:05.798338] [INFO ] [REMOTE ] KBH: Full fetch complete (53020 records). [2025-09-15T19:05:05.798473] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-09-15T19:05:06.067068] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-09-15T19:05:06.187464] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-09-15T19:05:06.187609] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-09-15T19:05:06.188566] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-09-15T19:05:06.188822] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-09-15T19:05:06.202073] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T19:05:06.206371] [DEBUG] [LOCAL ] KBH: Trimmed 53020 records to 35669 (keeping 150 days of data) [2025-09-15T19:05:06.439597] [DEBUG] [LOCAL ] KBH: Primary data saved (35669 records). [2025-09-15T19:05:06.439777] [INFO ] [MAIN ] KBH: Full history saved. [2025-09-15T19:05:06.439891] [INFO ] [MAIN ] Update Progress: 1180/2369 symbols completed. KBH took 29.6s. Estimated remaining: 2h 6m 0s. Rate: 9.4 symbols/min [2025-09-15T19:05:06.608320] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:05:06.636202] [DEBUG] [LOCAL ] KEX: Loaded 28008 existing records from primary storage. [2025-09-15T19:05:06.636384] [INFO ] [MAIN ] KEX: Loaded 28008 existing records. [2025-09-15T19:05:06.811695] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:05:06.811995] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-09-15T19:05:06.812040] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-09-15T19:05:06.812799] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-09-15T19:05:06.812850] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-09-15T19:05:06.865667] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-09-15T19:05:07.166678] [INFO ] [REMOTE ] KEX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:05:07.650301] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T19:05:07.660081] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-09-15T19:05:08.457876] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-09-15T19:05:08.591210] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-15T19:05:08.707208] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-15T19:05:09.257882] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-09-15T19:05:09.496128] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-15T19:05:10.057888] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-09-15T19:05:10.330247] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T19:05:10.857872] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-09-15T19:05:11.450975] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-15T19:05:11.456820] [INFO ] [REMOTE ] KD: Full fetch complete (56901 records). [2025-09-15T19:05:11.456992] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-09-15T19:05:11.668129] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-09-15T19:05:11.861287] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-09-15T19:05:11.861385] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-09-15T19:05:11.862403] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-09-15T19:05:11.862455] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-09-15T19:05:11.863819] [DEBUG] [LOCAL ] KD: Trimmed 56901 records to 38505 (keeping 150 days of data) [2025-09-15T19:05:12.096486] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T19:05:12.136445] [DEBUG] [LOCAL ] KD: Primary data saved (38505 records). [2025-09-15T19:05:12.136668] [INFO ] [MAIN ] KD: Full history saved. [2025-09-15T19:05:12.136778] [INFO ] [MAIN ] Update Progress: 1181/2369 symbols completed. KD took 25.3s. Estimated remaining: 2h 5m 53s. Rate: 9.4 symbols/min [2025-09-15T19:05:12.312466] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:05:12.312688] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-09-15T19:05:12.312732] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-09-15T19:05:12.312870] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-09-15T19:05:12.312913] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-15T19:05:12.312956] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-15T19:05:12.312993] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-09-15T19:05:12.463089] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-09-15T19:05:12.668491] [INFO ] [REMOTE ] KEY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:05:13.212051] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-15T19:05:13.257944] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-09-15T19:05:13.923166] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T19:05:14.057881] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-09-15T19:05:14.514041] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-15T19:05:14.857982] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-09-15T19:05:15.486334] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-15T19:05:15.657905] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-09-15T19:05:15.927558] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-15T19:05:16.457924] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-09-15T19:05:16.802471] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-15T19:05:17.257870] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-09-15T19:05:17.829713] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T19:05:18.057884] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-09-15T19:05:18.723382] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T19:05:18.857911] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-09-15T19:05:19.579685] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T19:05:19.657961] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-09-15T19:05:20.276096] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-15T19:05:20.457923] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-09-15T19:05:20.643801] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-15T19:05:21.257882] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-09-15T19:05:21.958690] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T19:05:22.057907] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-09-15T19:05:22.414144] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-15T19:05:22.857879] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-09-15T19:05:23.335405] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-15T19:05:23.341488] [INFO ] [REMOTE ] KBR: Full fetch complete (52855 records). [2025-09-15T19:05:23.341636] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-09-15T19:05:23.668762] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-09-15T19:05:23.718161] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-09-15T19:05:23.718242] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-09-15T19:05:23.719048] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-09-15T19:05:23.719093] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-09-15T19:05:23.720197] [DEBUG] [LOCAL ] KBR: Trimmed 52855 records to 35623 (keeping 150 days of data) [2025-09-15T19:05:23.946554] [DEBUG] [LOCAL ] KBR: Primary data saved (35623 records). [2025-09-15T19:05:23.946715] [INFO ] [MAIN ] KBR: Full history saved. [2025-09-15T19:05:23.947432] [INFO ] [MAIN ] Update Progress: 1182/2369 symbols completed. KBR took 40.4s. Estimated remaining: 2h 5m 52s. Rate: 9.4 symbols/min [2025-09-15T19:05:24.118466] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:05:24.153215] [DEBUG] [LOCAL ] KEYS: Loaded 32034 existing records from primary storage. [2025-09-15T19:05:24.153395] [INFO ] [MAIN ] KEYS: Loaded 32034 existing records. [2025-09-15T19:05:24.331066] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:05:24.331335] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-09-15T19:05:24.331381] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-09-15T19:05:24.332213] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-09-15T19:05:24.332266] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-09-15T19:05:24.459408] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-09-15T19:05:24.694231] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:05:24.733277] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-15T19:05:25.134623] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-15T19:05:25.257893] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-09-15T19:05:25.471779] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-15T19:05:25.475456] [INFO ] [REMOTE ] KEP: Full fetch complete (32007 records). [2025-09-15T19:05:25.475609] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-09-15T19:05:25.853215] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-09-15T19:05:25.853316] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-09-15T19:05:25.854201] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-09-15T19:05:25.854248] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-09-15T19:05:25.855282] [DEBUG] [LOCAL ] KEP: Trimmed 32007 records to 24216 (keeping 150 days of data) [2025-09-15T19:05:26.008272] [DEBUG] [LOCAL ] KEP: Primary data saved (24216 records). [2025-09-15T19:05:26.008428] [INFO ] [MAIN ] KEP: Full history saved. [2025-09-15T19:05:26.008522] [INFO ] [MAIN ] Update Progress: 1183/2369 symbols completed. KEP took 22.2s. Estimated remaining: 2h 5m 42s. Rate: 9.4 symbols/min [2025-09-15T19:05:26.063487] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-09-15T19:05:26.188149] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:05:26.192292] [DEBUG] [LOCAL ] KF: Loaded 1764 existing records from primary storage. [2025-09-15T19:05:26.192428] [INFO ] [MAIN ] KF: Loaded 1764 existing records. [2025-09-15T19:05:26.379533] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:05:26.379846] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-09-15T19:05:26.379894] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-09-15T19:05:26.380094] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-09-15T19:05:26.380137] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-09-15T19:05:26.744773] [INFO ] [REMOTE ] KF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:05:26.777552] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-15T19:05:26.857876] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-09-15T19:05:27.632598] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-15T19:05:27.657824] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-09-15T19:05:28.386019] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-15T19:05:28.457855] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-09-15T19:05:28.785887] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-15T19:05:29.214064] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-15T19:05:29.219820] [INFO ] [REMOTE ] KEX: Full fetch complete (40779 records). [2025-09-15T19:05:29.219928] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-09-15T19:05:29.263028] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-09-15T19:05:29.625008] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-09-15T19:05:29.625163] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-09-15T19:05:29.625946] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-09-15T19:05:29.626013] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-09-15T19:05:29.626992] [DEBUG] [LOCAL ] KEX: Trimmed 40779 records to 27514 (keeping 150 days of data) [2025-09-15T19:05:29.797023] [DEBUG] [LOCAL ] KEX: Primary data saved (27514 records). [2025-09-15T19:05:29.797169] [INFO ] [MAIN ] KEX: Full history saved. [2025-09-15T19:05:29.797257] [INFO ] [MAIN ] Update Progress: 1184/2369 symbols completed. KEX took 23.4s. Estimated remaining: 2h 5m 33s. Rate: 9.4 symbols/min [2025-09-15T19:05:29.966311] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:05:29.983923] [DEBUG] [LOCAL ] KFRC: Loaded 14958 existing records from primary storage. [2025-09-15T19:05:29.984145] [INFO ] [MAIN ] KFRC: Loaded 14958 existing records. [2025-09-15T19:05:30.063060] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-09-15T19:05:30.169321] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:05:30.169739] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-09-15T19:05:30.169792] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-09-15T19:05:30.170445] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-09-15T19:05:30.170499] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-09-15T19:05:30.539164] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:05:30.857979] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-09-15T19:05:31.021955] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-15T19:05:31.594870] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-15T19:05:31.612794] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-15T19:05:31.657894] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-09-15T19:05:32.457945] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-09-15T19:05:32.911586] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-15T19:05:32.917361] [INFO ] [REMOTE ] KEY: Full fetch complete (57927 records). [2025-09-15T19:05:32.917545] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-09-15T19:05:33.127439] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-15T19:05:33.128321] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:05:33.128380] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:05:33.128432] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-15T19:05:33.128510] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-15T19:05:33.128551] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-09-15T19:05:33.128599] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-09-15T19:05:33.128723] [INFO ] [MAIN ] Update Progress: 1185/2369 symbols completed. KEY took 21.0s. Estimated remaining: 2h 5m 23s. Rate: 9.4 symbols/min [2025-09-15T19:05:33.263036] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-09-15T19:05:33.311966] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:05:33.320723] [DEBUG] [LOCAL ] KFS: Loaded 6394 existing records from primary storage. [2025-09-15T19:05:33.320904] [INFO ] [MAIN ] KFS: Loaded 6394 existing records. [2025-09-15T19:05:33.512576] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:05:33.513011] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-09-15T19:05:33.513059] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-09-15T19:05:33.513402] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-09-15T19:05:33.513450] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-09-15T19:05:33.875985] [INFO ] [REMOTE ] KFS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:05:34.045532] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-15T19:05:34.064120] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-09-15T19:05:34.081599] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T19:05:34.407567] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-15T19:05:34.857874] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-09-15T19:05:35.657931] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-09-15T19:05:36.235275] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-15T19:05:36.457909] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-09-15T19:05:36.510596] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T19:05:36.970311] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-15T19:05:37.257869] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-09-15T19:05:37.835775] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-15T19:05:38.057886] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-09-15T19:05:38.857896] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-09-15T19:05:39.046436] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-15T19:05:39.195960] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-15T19:05:39.657923] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-09-15T19:05:40.098765] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-15T19:05:40.457901] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-09-15T19:05:41.234907] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-15T19:05:41.257830] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-09-15T19:05:42.042490] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-15T19:05:42.057809] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-09-15T19:05:42.832194] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-15T19:05:42.857844] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-09-15T19:05:43.596663] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-15T19:05:43.657891] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-09-15T19:05:44.457909] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-09-15T19:05:45.141437] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T19:05:45.257862] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-09-15T19:05:45.356479] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-15T19:05:46.057932] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-09-15T19:05:46.382932] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-15T19:05:46.689558] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T19:05:46.857868] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-09-15T19:05:47.228818] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-15T19:05:47.657872] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-09-15T19:05:48.337827] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-15T19:05:48.339318] [INFO ] [REMOTE ] KFS: Full fetch complete (8355 records). [2025-09-15T19:05:48.339395] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-09-15T19:05:48.462977] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-09-15T19:05:48.710541] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-09-15T19:05:48.710635] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-09-15T19:05:48.710906] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-09-15T19:05:48.710956] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-09-15T19:05:48.711407] [DEBUG] [LOCAL ] KFS: Trimmed 8355 records to 6290 (keeping 150 days of data) [2025-09-15T19:05:48.749358] [DEBUG] [LOCAL ] KFS: Primary data saved (6290 records). [2025-09-15T19:05:48.749497] [INFO ] [MAIN ] KFS: Full history saved. [2025-09-15T19:05:48.749588] [INFO ] [MAIN ] Update Progress: 1186/2369 symbols completed. KFS took 15.6s. Estimated remaining: 2h 5m 26s. Rate: 9.4 symbols/min [2025-09-15T19:05:48.931588] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:05:48.953959] [DEBUG] [LOCAL ] KFY: Loaded 22010 existing records from primary storage. [2025-09-15T19:05:48.954291] [INFO ] [MAIN ] KFY: Loaded 22010 existing records. [2025-09-15T19:05:49.136154] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:05:49.136480] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-09-15T19:05:49.136537] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-09-15T19:05:49.137558] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-09-15T19:05:49.137617] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-09-15T19:05:49.263059] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-09-15T19:05:49.495925] [INFO ] [REMOTE ] KFY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:05:49.755306] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-15T19:05:49.756215] [INFO ] [REMOTE ] KF: Full fetch complete (2695 records). [2025-09-15T19:05:49.756284] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-09-15T19:05:50.062791] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-09-15T19:05:50.030387] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-15T19:05:50.184245] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-09-15T19:05:50.184328] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-09-15T19:05:50.184446] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-09-15T19:05:50.184483] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-09-15T19:05:50.184939] [DEBUG] [LOCAL ] KF: Trimmed 2695 records to 1744 (keeping 150 days of data) [2025-09-15T19:05:50.195977] [DEBUG] [LOCAL ] KF: Primary data saved (1744 records). [2025-09-15T19:05:50.196041] [INFO ] [MAIN ] KF: Full history saved. [2025-09-15T19:05:50.196155] [INFO ] [MAIN ] Update Progress: 1187/2369 symbols completed. KF took 24.2s. Estimated remaining: 2h 5m 15s. Rate: 9.4 symbols/min [2025-09-15T19:05:50.362620] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:05:50.403300] [DEBUG] [LOCAL ] KGC: Loaded 40440 existing records from primary storage. [2025-09-15T19:05:50.403468] [INFO ] [MAIN ] KGC: Loaded 40440 existing records. [2025-09-15T19:05:50.580993] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:05:50.581251] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-09-15T19:05:50.581298] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-09-15T19:05:50.582358] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-09-15T19:05:50.582412] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-09-15T19:05:50.863115] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-09-15T19:05:50.959430] [INFO ] [REMOTE ] KGC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:05:51.275849] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T19:05:51.657902] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-09-15T19:05:52.460231] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-09-15T19:05:52.467870] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-15T19:05:52.492158] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-15T19:05:53.257891] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-09-15T19:05:54.050190] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-15T19:05:54.062070] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-09-15T19:05:54.093831] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-15T19:05:54.857899] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-09-15T19:05:55.353959] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T19:05:55.359319] [INFO ] [REMOTE ] KEYS: Full fetch complete (47495 records). [2025-09-15T19:05:55.359459] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-09-15T19:05:55.663074] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-09-15T19:05:55.774037] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-09-15T19:05:55.774842] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-09-15T19:05:55.776697] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-09-15T19:05:55.775392] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-15T19:05:55.776888] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-09-15T19:05:55.783570] [DEBUG] [LOCAL ] KEYS: Trimmed 47495 records to 31401 (keeping 150 days of data) [2025-09-15T19:05:56.004981] [DEBUG] [LOCAL ] KEYS: Primary data saved (31401 records). [2025-09-15T19:05:56.005211] [INFO ] [MAIN ] KEYS: Full history saved. [2025-09-15T19:05:56.005341] [INFO ] [MAIN ] Update Progress: 1188/2369 symbols completed. KEYS took 32.1s. Estimated remaining: 2h 5m 8s. Rate: 9.4 symbols/min [2025-09-15T19:05:56.180962] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:05:56.217912] [DEBUG] [LOCAL ] KGS: Loaded 34220 existing records from primary storage. [2025-09-15T19:05:56.218142] [INFO ] [MAIN ] KGS: Loaded 34220 existing records. [2025-09-15T19:05:56.407455] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:05:56.407876] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-09-15T19:05:56.407996] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-09-15T19:05:56.409171] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-09-15T19:05:56.409235] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-09-15T19:05:56.467462] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-09-15T19:05:56.787144] [INFO ] [REMOTE ] KGS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:05:57.257848] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-09-15T19:05:57.694854] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-15T19:05:57.786138] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-15T19:05:58.057851] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-09-15T19:05:58.118166] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-15T19:05:58.857895] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-09-15T19:05:59.657874] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-09-15T19:06:00.137799] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-15T19:06:00.170726] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-15T19:06:00.457872] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-09-15T19:06:00.867365] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T19:06:01.257907] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-09-15T19:06:02.057931] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-09-15T19:06:02.857933] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-09-15T19:06:03.413113] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-15T19:06:03.519579] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (3.06 seconds). [2025-09-15T19:06:03.657861] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-09-15T19:06:04.457896] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-09-15T19:06:04.892455] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-09-15T19:06:04.895518] [INFO ] [REMOTE ] KFRC: Full fetch complete (20151 records). [2025-09-15T19:06:04.895597] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-09-15T19:06:05.277610] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-09-15T19:06:05.277741] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-09-15T19:06:05.278202] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-09-15T19:06:05.278245] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-09-15T19:06:05.279138] [DEBUG] [LOCAL ] KFRC: Trimmed 20151 records to 14809 (keeping 150 days of data) [2025-09-15T19:06:05.393575] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-09-15T19:06:05.406690] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-09-15T19:06:05.417751] [DEBUG] [LOCAL ] KFRC: Primary data saved (14809 records). [2025-09-15T19:06:05.417915] [INFO ] [MAIN ] KFRC: Full history saved. [2025-09-15T19:06:05.418039] [INFO ] [MAIN ] Update Progress: 1189/2369 symbols completed. KFRC took 35.6s. Estimated remaining: 2h 5m 5s. Rate: 9.4 symbols/min [2025-09-15T19:06:05.605167] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:06:05.647075] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-15T19:06:05.680777] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-15T19:06:05.725160] [DEBUG] [LOCAL ] KIM: Loaded 39911 existing records from primary storage. [2025-09-15T19:06:05.725319] [INFO ] [MAIN ] KIM: Loaded 39911 existing records. [2025-09-15T19:06:05.905042] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:06:05.905333] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-09-15T19:06:05.905384] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-09-15T19:06:05.906297] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-09-15T19:06:05.906350] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-09-15T19:06:06.061068] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-09-15T19:06:06.313919] [INFO ] [REMOTE ] KIM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:06:06.679122] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-15T19:06:06.857927] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-09-15T19:06:07.453853] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-15T19:06:07.657861] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-09-15T19:06:08.040659] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-15T19:06:08.457860] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-09-15T19:06:08.669904] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T19:06:09.257918] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-09-15T19:06:09.462074] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-15T19:06:10.057870] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-09-15T19:06:10.517333] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T19:06:10.523091] [INFO ] [REMOTE ] KFY: Full fetch complete (33271 records). [2025-09-15T19:06:10.523234] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-09-15T19:06:10.863071] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-09-15T19:06:10.906906] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-09-15T19:06:10.906984] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-09-15T19:06:10.907616] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-09-15T19:06:10.907683] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-09-15T19:06:10.908544] [DEBUG] [LOCAL ] KFY: Trimmed 33271 records to 21543 (keeping 150 days of data) [2025-09-15T19:06:11.042504] [DEBUG] [LOCAL ] KFY: Primary data saved (21543 records). [2025-09-15T19:06:11.042619] [INFO ] [MAIN ] KFY: Full history saved. [2025-09-15T19:06:11.042729] [INFO ] [MAIN ] Update Progress: 1190/2369 symbols completed. KFY took 22.3s. Estimated remaining: 2h 4m 58s. Rate: 9.4 symbols/min [2025-09-15T19:06:11.211382] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:06:11.242002] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-15T19:06:11.256687] [DEBUG] [LOCAL ] KIO: Loaded 15563 existing records from primary storage. [2025-09-15T19:06:11.256808] [INFO ] [MAIN ] KIO: Loaded 15563 existing records. [2025-09-15T19:06:11.431277] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:06:11.431485] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-09-15T19:06:11.431530] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-09-15T19:06:11.431994] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-09-15T19:06:11.432047] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-09-15T19:06:11.667144] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-09-15T19:06:11.791387] [INFO ] [REMOTE ] KIO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:06:12.456278] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-15T19:06:12.466714] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-09-15T19:06:13.257947] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-09-15T19:06:13.490153] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-15T19:06:14.057908] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-09-15T19:06:14.136406] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-15T19:06:14.857941] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-09-15T19:06:15.668060] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-09-15T19:06:15.673736] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-15T19:06:16.379064] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T19:06:16.451454] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-15T19:06:16.462296] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-09-15T19:06:16.722549] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-15T19:06:17.257882] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-09-15T19:06:17.878212] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-15T19:06:18.057876] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-09-15T19:06:18.359674] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-15T19:06:18.857879] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-09-15T19:06:19.657884] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-09-15T19:06:19.700610] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-15T19:06:19.728858] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-15T19:06:20.457876] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-09-15T19:06:21.107376] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-15T19:06:21.238074] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-15T19:06:21.244153] [INFO ] [REMOTE ] KGS: Full fetch complete (49570 records). [2025-09-15T19:06:21.244324] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-09-15T19:06:21.266435] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-09-15T19:06:21.640167] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-09-15T19:06:21.640271] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-09-15T19:06:21.641207] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-09-15T19:06:21.641266] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-09-15T19:06:21.642572] [DEBUG] [LOCAL ] KGS: Trimmed 49570 records to 33588 (keeping 150 days of data) [2025-09-15T19:06:21.866761] [DEBUG] [LOCAL ] KGS: Primary data saved (33588 records). [2025-09-15T19:06:21.866961] [INFO ] [MAIN ] KGS: Full history saved. [2025-09-15T19:06:21.867602] [INFO ] [MAIN ] Update Progress: 1191/2369 symbols completed. KGS took 25.9s. Estimated remaining: 2h 4m 56s. Rate: 9.4 symbols/min [2025-09-15T19:06:22.040804] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:06:22.064149] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-09-15T19:06:22.082466] [DEBUG] [LOCAL ] KKR: Loaded 40272 existing records from primary storage. [2025-09-15T19:06:22.082607] [INFO ] [MAIN ] KKR: Loaded 40272 existing records. [2025-09-15T19:06:22.259895] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:06:22.260162] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-09-15T19:06:22.260209] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-09-15T19:06:22.261181] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-09-15T19:06:22.261232] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-09-15T19:06:22.568520] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-15T19:06:22.666354] [INFO ] [REMOTE ] KKR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:06:22.857888] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-09-15T19:06:23.657889] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-09-15T19:06:23.855872] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-15T19:06:24.213295] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-15T19:06:24.457883] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-09-15T19:06:24.724526] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-15T19:06:25.257876] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-09-15T19:06:26.057900] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-09-15T19:06:26.218700] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-15T19:06:26.365690] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-15T19:06:26.370339] [INFO ] [REMOTE ] KIO: Full fetch complete (23378 records). [2025-09-15T19:06:26.370574] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-09-15T19:06:26.753004] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-09-15T19:06:26.753111] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-09-15T19:06:26.754087] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-09-15T19:06:26.754211] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-09-15T19:06:26.755038] [DEBUG] [LOCAL ] KIO: Trimmed 23378 records to 15394 (keeping 150 days of data) [2025-09-15T19:06:26.863092] [DEBUG] [LOCAL ] KIO: Primary data saved (15394 records). [2025-09-15T19:06:26.863541] [INFO ] [MAIN ] KIO: Full history saved. [2025-09-15T19:06:26.863365] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-09-15T19:06:26.863718] [INFO ] [MAIN ] Update Progress: 1192/2369 symbols completed. KIO took 15.8s. Estimated remaining: 2h 4m 48s. Rate: 9.4 symbols/min [2025-09-15T19:06:27.047673] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:06:27.055689] [DEBUG] [LOCAL ] KKRS: Loaded 4649 existing records from primary storage. [2025-09-15T19:06:27.055858] [INFO ] [MAIN ] KKRS: Loaded 4649 existing records. [2025-09-15T19:06:27.239117] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:06:27.239495] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-09-15T19:06:27.239545] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-09-15T19:06:27.239954] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-09-15T19:06:27.240014] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-09-15T19:06:27.619396] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:06:27.658600] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-09-15T19:06:27.664213] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-15T19:06:28.457862] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-09-15T19:06:28.667280] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-15T19:06:28.673169] [INFO ] [REMOTE ] KIM: Full fetch complete (57700 records). [2025-09-15T19:06:28.673275] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-09-15T19:06:29.054092] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-09-15T19:06:29.054188] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-09-15T19:06:29.055106] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-09-15T19:06:29.055152] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-09-15T19:06:29.056357] [DEBUG] [LOCAL ] KIM: Trimmed 57700 records to 39124 (keeping 150 days of data) [2025-09-15T19:06:29.269660] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-09-15T19:06:29.305584] [DEBUG] [LOCAL ] KIM: Primary data saved (39124 records). [2025-09-15T19:06:29.305715] [INFO ] [MAIN ] KIM: Full history saved. [2025-09-15T19:06:29.306727] [INFO ] [MAIN ] Update Progress: 1193/2369 symbols completed. KIM took 23.9s. Estimated remaining: 2h 4m 38s. Rate: 9.4 symbols/min [2025-09-15T19:06:29.487679] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:06:29.487913] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-09-15T19:06:29.488039] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-09-15T19:06:29.488288] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-09-15T19:06:29.488337] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-15T19:06:29.488442] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-15T19:06:29.488544] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-09-15T19:06:29.606264] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-15T19:06:29.671818] [INFO ] [REMOTE ] KGC: Full fetch complete (58377 records). [2025-09-15T19:06:29.725472] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-09-15T19:06:29.896313] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-15T19:06:29.987781] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:06:30.061423] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-02. [2025-09-15T19:06:30.273970] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-09-15T19:06:30.274092] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-09-15T19:06:30.275062] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-09-15T19:06:30.275235] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-09-15T19:06:30.276739] [DEBUG] [LOCAL ] KGC: Trimmed 58377 records to 39660 (keeping 150 days of data) [2025-09-15T19:06:30.374359] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:06:30.375736] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-02 [2025-09-15T19:06:30.417868] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-15T19:06:30.580746] [DEBUG] [LOCAL ] KGC: Primary data saved (39660 records). [2025-09-15T19:06:30.580984] [INFO ] [MAIN ] KGC: Full history saved. [2025-09-15T19:06:30.582150] [INFO ] [MAIN ] Update Progress: 1194/2369 symbols completed. KGC took 40.4s. Estimated remaining: 2h 4m 27s. Rate: 9.4 symbols/min [2025-09-15T19:06:30.752125] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:06:30.752339] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-09-15T19:06:30.752380] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-09-15T19:06:30.752554] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-09-15T19:06:30.752605] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-15T19:06:30.752666] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-15T19:06:30.752703] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-09-15T19:06:30.862979] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-03. [2025-09-15T19:06:31.107299] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:06:31.180991] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:06:31.181270] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-03 [2025-09-15T19:06:31.657859] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-04. [2025-09-15T19:06:31.903278] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:06:31.903618] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-04 [2025-09-15T19:06:32.457879] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-09-15T19:06:33.257913] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-02. [2025-09-15T19:06:33.473755] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:06:33.474140] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-02 [2025-09-15T19:06:34.057931] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-03. [2025-09-15T19:06:34.249990] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:06:34.250352] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-03 [2025-09-15T19:06:34.431916] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-15T19:06:34.857874] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-05. [2025-09-15T19:06:35.241218] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-15T19:06:35.657867] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-09-15T19:06:36.457914] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-06. [2025-09-15T19:06:37.257863] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-09-15T19:06:37.753249] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-15T19:06:37.754038] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-15T19:06:37.782467] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-15T19:06:38.057875] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-09-15T19:06:38.634994] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-15T19:06:38.857879] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-09-15T19:06:39.607142] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-15T19:06:39.657866] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-07. [2025-09-15T19:06:40.426270] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-15T19:06:40.457830] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-08. [2025-09-15T19:06:41.257895] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-09-15T19:06:41.313126] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-15T19:06:41.666694] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-15T19:06:42.057984] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-04. [2025-09-15T19:06:42.249907] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:06:42.250419] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-04 [2025-09-15T19:06:42.857920] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-09-15T19:06:43.657903] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-09-15T19:06:44.217086] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-15T19:06:44.390009] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-15T19:06:44.457960] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-09-15T19:06:45.257966] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-09-15T19:06:45.687177] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-15T19:06:46.057916] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-09. [2025-09-15T19:06:46.154017] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-15T19:06:46.857980] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-09-15T19:06:46.938594] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-15T19:06:46.940524] [INFO ] [REMOTE ] KKRT: Full fetch complete (7924 records). [2025-09-15T19:06:46.940602] [DEBUG] [VALIDATOR ] KKRT: Validating primary data. [2025-09-15T19:06:47.132899] [WARN ] [VALIDATOR ] KKRT: Validation failed - insufficient historical data. Have 74 unique days, need 150 days [2025-09-15T19:06:47.133246] [FATAL] [MAIN ] KKRT: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:06:47.133326] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:06:47.133408] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-15T19:06:47.133478] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-15T19:06:47.133519] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-09-15T19:06:47.133569] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-09-15T19:06:47.133724] [INFO ] [MAIN ] Update Progress: 1195/2369 symbols completed. KKRT took 17.8s. Estimated remaining: 2h 4m 30s. Rate: 9.4 symbols/min [2025-09-15T19:06:47.309677] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:06:47.342388] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-15T19:06:47.344060] [INFO ] [REMOTE ] KKRS: Full fetch complete (6309 records). [2025-09-15T19:06:47.344138] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-09-15T19:06:47.462466] [DEBUG] [LOCAL ] KLC: Loaded 26667 existing records from primary storage. [2025-09-15T19:06:47.473601] [INFO ] [MAIN ] KLC: Loaded 26667 existing records. [2025-09-15T19:06:47.668262] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-09-15T19:06:47.937135] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-09-15T19:06:47.929750] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:06:47.937352] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-09-15T19:06:47.937916] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-09-15T19:06:47.938045] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-09-15T19:06:47.938210] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-09-15T19:06:47.938479] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-09-15T19:06:47.938940] [DEBUG] [LOCAL ] KKRS: Trimmed 6309 records to 4474 (keeping 150 days of data) [2025-09-15T19:06:47.939886] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-09-15T19:06:47.940002] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-09-15T19:06:48.211539] [DEBUG] [LOCAL ] KKRS: Primary data saved (4474 records). [2025-09-15T19:06:48.248761] [INFO ] [MAIN ] KKRS: Full history saved. [2025-09-15T19:06:48.269776] [INFO ] [MAIN ] Update Progress: 1196/2369 symbols completed. KKRS took 21.4s. Estimated remaining: 2h 4m 19s. Rate: 9.4 symbols/min [2025-09-15T19:06:48.458518] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-05. [2025-09-15T19:06:48.471138] [INFO ] [REMOTE ] KLC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:06:48.541122] [INFO ] [MAIN ] KLG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:06:48.584283] [DEBUG] [LOCAL ] KLG: Loaded 31211 existing records from primary storage. [2025-09-15T19:06:48.584497] [INFO ] [MAIN ] KLG: Loaded 31211 existing records. [2025-09-15T19:06:48.747079] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:06:48.749056] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-05 [2025-09-15T19:06:48.770177] [WARN ] [MAIN ] KLG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:06:48.770564] [INFO ] [MAIN ] KLG: Wiping existing primary data before full refresh. [2025-09-15T19:06:48.770621] [INFO ] [LOCAL ] KLG: Starting deletion of primary data. [2025-09-15T19:06:48.771618] [DEBUG] [LOCAL ] KLG: Deleted primary data file. [2025-09-15T19:06:48.771699] [INFO ] [MAIN ] KLG: Starting full primary refresh. [2025-09-15T19:06:49.136383] [INFO ] [REMOTE ] KLG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:06:49.257894] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-09-15T19:06:49.836509] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-15T19:06:50.057891] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-02. [2025-09-15T19:06:50.324256] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-15T19:06:50.857980] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-09-15T19:06:51.341824] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T19:06:51.657917] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-06. [2025-09-15T19:06:51.875198] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:06:51.875528] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-06 [2025-09-15T19:06:52.384523] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-15T19:06:52.390988] [INFO ] [REMOTE ] KKR: Full fetch complete (58198 records). [2025-09-15T19:06:52.391179] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-09-15T19:06:52.463108] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-09-15T19:06:52.809391] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-09-15T19:06:52.809522] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-09-15T19:06:52.810593] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-09-15T19:06:52.810657] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-09-15T19:06:52.812341] [DEBUG] [LOCAL ] KKR: Trimmed 58198 records to 39486 (keeping 150 days of data) [2025-09-15T19:06:53.101961] [DEBUG] [LOCAL ] KKR: Primary data saved (39486 records). [2025-09-15T19:06:53.102374] [INFO ] [MAIN ] KKR: Full history saved. [2025-09-15T19:06:53.103722] [INFO ] [MAIN ] Update Progress: 1197/2369 symbols completed. KKR took 31.2s. Estimated remaining: 2h 4m 11s. Rate: 9.4 symbols/min [2025-09-15T19:06:53.257998] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-07. [2025-09-15T19:06:53.453416] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:06:53.453816] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-07 [2025-09-15T19:06:53.634363] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-15T19:06:54.057954] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-03. [2025-09-15T19:06:54.857897] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-09-15T19:06:55.471954] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-15T19:06:55.657886] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-08. [2025-09-15T19:06:55.859305] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:06:55.859693] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-08 [2025-09-15T19:06:56.457881] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-09. [2025-09-15T19:06:56.506781] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T19:06:57.257925] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-09-15T19:06:57.453325] [INFO ] [REMOTE ] KLAR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-15T19:06:57.456894] [INFO ] [REMOTE ] KLAR: Full fetch complete (1343 records). [2025-09-15T19:06:57.456982] [DEBUG] [VALIDATOR ] KLAR: Validating primary data. [2025-09-15T19:06:57.658022] [WARN ] [VALIDATOR ] KLAR: Validation failed - insufficient historical data. Have 4 unique days, need 150 days [2025-09-15T19:06:57.658323] [FATAL] [MAIN ] KLAR: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:06:57.658383] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:06:57.658441] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-15T19:06:57.658517] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-15T19:06:57.658557] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-09-15T19:06:57.658618] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-09-15T19:06:57.658725] [INFO ] [MAIN ] Update Progress: 1198/2369 symbols completed. KLAR took 27.1s. Estimated remaining: 2h 4m 3s. Rate: 9.4 symbols/min [2025-09-15T19:06:58.057915] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-04. [2025-09-15T19:06:58.498719] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T19:06:58.857885] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-09-15T19:06:59.396302] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T19:06:59.657943] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-05. [2025-09-15T19:06:59.846816] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-15T19:07:00.457877] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-09-15T19:07:00.869395] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-15T19:07:01.257892] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-06. [2025-09-15T19:07:01.426726] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-15T19:07:02.057888] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-09-15T19:07:02.672553] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T19:07:02.857887] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-07. [2025-09-15T19:07:03.136879] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-15T19:07:03.657877] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-09-15T19:07:04.485800] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-15T19:07:04.496201] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-08. [2025-09-15T19:07:05.280633] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-15T19:07:05.286985] [INFO ] [REMOTE ] KLC: Full fetch complete (38381 records). [2025-09-15T19:07:05.287310] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-09-15T19:07:05.802510] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-09-15T19:07:05.802745] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-09-15T19:07:05.807419] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-09-15T19:07:05.807676] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-09-15T19:07:05.845354] [DEBUG] [LOCAL ] KLC: Trimmed 38381 records to 26104 (keeping 150 days of data) [2025-09-15T19:07:05.848229] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T19:07:05.863331] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-09. [2025-09-15T19:07:06.105273] [DEBUG] [LOCAL ] KLC: Primary data saved (26104 records). [2025-09-15T19:07:06.105488] [INFO ] [MAIN ] KLC: Full history saved. [2025-09-15T19:07:06.105672] [INFO ] [MAIN ] Update Progress: 1199/2369 symbols completed. KLC took 19.0s. Estimated remaining: 2h 3m 58s. Rate: 9.4 symbols/min [2025-09-15T19:07:07.382764] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-15T19:07:07.387553] [INFO ] [REMOTE ] KLG: Full fetch complete (45805 records). [2025-09-15T19:07:07.387688] [DEBUG] [VALIDATOR ] KLG: Validating primary data. [2025-09-15T19:07:07.817475] [DEBUG] [VALIDATOR ] KLG: All expected trading days are present. [2025-09-15T19:07:07.817556] [DEBUG] [VALIDATOR ] KLG: Primary data validation passed. [2025-09-15T19:07:07.818318] [INFO ] [MAIN ] KLG: Fetched primary data is valid. [2025-09-15T19:07:07.818363] [DEBUG] [LOCAL ] KLG: Saving primary data. [2025-09-15T19:07:07.819379] [DEBUG] [LOCAL ] KLG: Trimmed 45805 records to 30713 (keeping 150 days of data) [2025-09-15T19:07:08.024605] [DEBUG] [LOCAL ] KLG: Primary data saved (30713 records). [2025-09-15T19:07:08.024792] [INFO ] [MAIN ] KLG: Full history saved. [2025-09-15T19:07:08.024897] [INFO ] [MAIN ] Update Progress: 1200/2369 symbols completed. KLG took 19.8s. Estimated remaining: 2h 3m 48s. Rate: 9.4 symbols/min [2025-09-15T19:07:08.565316] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:07:08.650254] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:07:08.656785] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:07:08.724543] [DEBUG] [LOCAL ] KMPB: Loaded 2589 existing records from primary storage. [2025-09-15T19:07:08.724244] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:07:08.724758] [INFO ] [MAIN ] KMPB: Loaded 2589 existing records. [2025-09-15T19:07:08.863750] [DEBUG] [LOCAL ] KMPR: Loaded 29412 existing records from primary storage. [2025-09-15T19:07:08.922726] [INFO ] [MAIN ] KMPR: Loaded 29412 existing records. [2025-09-15T19:07:08.941712] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:07:08.949290] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-09-15T19:07:08.954707] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-09-15T19:07:08.972580] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-09-15T19:07:08.986894] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-09-15T19:07:09.162424] [DEBUG] [LOCAL ] KMT: Loaded 32243 existing records from primary storage. [2025-09-15T19:07:09.151487] [DEBUG] [LOCAL ] KMI: Loaded 40433 existing records from primary storage. [2025-09-15T19:07:09.185538] [INFO ] [MAIN ] KMT: Loaded 32243 existing records. [2025-09-15T19:07:09.185836] [INFO ] [MAIN ] KMI: Loaded 40433 existing records. [2025-09-15T19:07:09.533731] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:07:09.699922] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-09-15T19:07:09.766412] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:07:09.771620] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-09-15T19:07:09.837505] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-09-15T19:07:09.828158] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-09-15T19:07:09.865574] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-09-15T19:07:09.885677] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-09-15T19:07:09.936039] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-09-15T19:07:09.896521] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:07:09.947698] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-09-15T19:07:10.002856] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:07:10.036726] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-09-15T19:07:10.066049] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-09-15T19:07:10.085663] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-09-15T19:07:10.157782] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-09-15T19:07:10.186542] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-09-15T19:07:10.730511] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-15T19:07:10.838065] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-09-15T19:07:10.805677] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:07:10.899961] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-09-15T19:07:10.905150] [INFO ] [REMOTE ] KMT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:07:10.937871] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-09-15T19:07:11.117949] [INFO ] [REMOTE ] KMI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:07:11.118368] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-09-15T19:07:11.426475] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-15T19:07:11.428182] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-09-15T19:07:11.876521] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-15T19:07:11.878062] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-09-15T19:07:12.248925] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-15T19:07:12.250315] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-09-15T19:07:12.309141] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T19:07:12.457842] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-09-15T19:07:12.487304] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-15T19:07:12.734686] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T19:07:12.874894] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-15T19:07:13.257894] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-09-15T19:07:13.647047] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-15T19:07:14.057880] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-09-15T19:07:14.491448] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-15T19:07:14.857876] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-09-15T19:07:15.595536] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-15T19:07:15.657857] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-09-15T19:07:16.192047] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-15T19:07:16.457908] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-09-15T19:07:16.626228] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-15T19:07:17.257900] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-09-15T19:07:17.695134] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T19:07:18.057882] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-09-15T19:07:18.857864] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-09-15T19:07:19.122369] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-15T19:07:19.161436] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-15T19:07:19.657913] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-09-15T19:07:20.244735] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-15T19:07:20.457868] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-09-15T19:07:20.980153] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-15T19:07:21.257904] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-09-15T19:07:21.691517] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-15T19:07:21.813377] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-15T19:07:22.057879] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-09-15T19:07:22.452889] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-15T19:07:22.857870] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-09-15T19:07:23.657891] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-09-15T19:07:24.140595] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-15T19:07:24.141537] [INFO ] [REMOTE ] KMPB: Full fetch complete (3857 records). [2025-09-15T19:07:24.141606] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-09-15T19:07:24.462311] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-09-15T19:07:24.533210] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-09-15T19:07:24.533629] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-09-15T19:07:24.563889] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-09-15T19:07:24.568022] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-09-15T19:07:24.569258] [DEBUG] [LOCAL ] KMPB: Trimmed 3857 records to 2557 (keeping 150 days of data) [2025-09-15T19:07:24.571855] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-15T19:07:24.601239] [DEBUG] [LOCAL ] KMPB: Primary data saved (2557 records). [2025-09-15T19:07:24.601428] [INFO ] [MAIN ] KMPB: Full history saved. [2025-09-15T19:07:24.601532] [INFO ] [MAIN ] Update Progress: 1201/2369 symbols completed. KMPB took 16.6s. Estimated remaining: 2h 3m 51s. Rate: 9.4 symbols/min [2025-09-15T19:07:24.778358] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:07:24.834555] [DEBUG] [LOCAL ] KMX: Loaded 40060 existing records from primary storage. [2025-09-15T19:07:24.834815] [INFO ] [MAIN ] KMX: Loaded 40060 existing records. [2025-09-15T19:07:25.013960] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:07:25.014289] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-09-15T19:07:25.014337] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-09-15T19:07:25.015254] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-09-15T19:07:25.015306] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-09-15T19:07:25.264322] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-09-15T19:07:25.382026] [INFO ] [REMOTE ] KMX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:07:26.057906] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-09-15T19:07:26.168982] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-15T19:07:26.857876] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-09-15T19:07:27.422168] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-15T19:07:27.554578] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-15T19:07:27.559940] [INFO ] [REMOTE ] KMPR: Full fetch complete (39768 records). [2025-09-15T19:07:27.560069] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-09-15T19:07:27.662941] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-09-15T19:07:27.948041] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-09-15T19:07:27.948128] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-09-15T19:07:27.949000] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-09-15T19:07:27.949050] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-09-15T19:07:27.950109] [DEBUG] [LOCAL ] KMPR: Trimmed 39768 records to 29002 (keeping 150 days of data) [2025-09-15T19:07:28.143153] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T19:07:28.157575] [INFO ] [REMOTE ] KMT: Full fetch complete (46910 records). [2025-09-15T19:07:28.163444] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-09-15T19:07:28.163385] [DEBUG] [LOCAL ] KMPR: Primary data saved (29002 records). [2025-09-15T19:07:28.163677] [INFO ] [MAIN ] KMPR: Full history saved. [2025-09-15T19:07:28.163817] [INFO ] [MAIN ] Update Progress: 1202/2369 symbols completed. KMPR took 20.1s. Estimated remaining: 2h 3m 42s. Rate: 9.4 symbols/min [2025-09-15T19:07:28.461297] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-09-15T19:07:28.503985] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:07:28.725939] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-09-15T19:07:28.726888] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-09-15T19:07:28.727679] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-09-15T19:07:28.728111] [DEBUG] [LOCAL ] KN: Loaded 28476 existing records from primary storage. [2025-09-15T19:07:28.728259] [INFO ] [MAIN ] KN: Loaded 28476 existing records. [2025-09-15T19:07:28.728159] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-09-15T19:07:28.840203] [DEBUG] [LOCAL ] KMT: Trimmed 46910 records to 31670 (keeping 150 days of data) [2025-09-15T19:07:29.007819] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:07:29.013700] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-09-15T19:07:29.015992] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-09-15T19:07:29.017012] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-09-15T19:07:29.017112] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-09-15T19:07:29.431741] [INFO ] [REMOTE ] KN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:07:29.454348] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-09-15T19:07:29.485385] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-15T19:07:29.512272] [DEBUG] [LOCAL ] KMT: Primary data saved (31670 records). [2025-09-15T19:07:29.512413] [INFO ] [MAIN ] KMT: Full history saved. [2025-09-15T19:07:29.512509] [INFO ] [MAIN ] Update Progress: 1203/2369 symbols completed. KMT took 21.5s. Estimated remaining: 2h 3m 31s. Rate: 9.4 symbols/min [2025-09-15T19:07:29.684138] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:07:29.709961] [DEBUG] [LOCAL ] KNF: Loaded 26885 existing records from primary storage. [2025-09-15T19:07:29.710100] [INFO ] [MAIN ] KNF: Loaded 26885 existing records. [2025-09-15T19:07:29.885927] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:07:29.886234] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-09-15T19:07:29.886285] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-09-15T19:07:29.887005] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-09-15T19:07:29.887056] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-09-15T19:07:30.062018] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-09-15T19:07:30.250303] [INFO ] [REMOTE ] KNF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:07:30.289968] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-15T19:07:30.616385] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T19:07:30.857867] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-09-15T19:07:31.657930] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-09-15T19:07:31.895260] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-15T19:07:32.019375] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-15T19:07:32.457891] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-09-15T19:07:33.257844] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-09-15T19:07:33.356388] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-15T19:07:34.057890] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-09-15T19:07:34.357567] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-15T19:07:34.533890] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T19:07:34.857878] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-09-15T19:07:35.254802] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-15T19:07:35.657907] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-09-15T19:07:36.457872] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-09-15T19:07:36.645490] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-15T19:07:36.968210] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-15T19:07:37.257885] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-09-15T19:07:37.647602] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-15T19:07:38.057909] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-09-15T19:07:38.857937] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-09-15T19:07:39.150325] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-15T19:07:39.491624] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-15T19:07:39.657885] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-09-15T19:07:39.981227] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-15T19:07:40.457952] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-09-15T19:07:41.083546] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T19:07:41.089697] [INFO ] [REMOTE ] KMI: Full fetch complete (58373 records). [2025-09-15T19:07:41.089832] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-09-15T19:07:41.263886] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-09-15T19:07:41.486215] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-09-15T19:07:41.486327] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-09-15T19:07:41.487248] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-09-15T19:07:41.487294] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-09-15T19:07:41.488580] [DEBUG] [LOCAL ] KMI: Trimmed 58373 records to 39653 (keeping 150 days of data) [2025-09-15T19:07:41.740655] [DEBUG] [LOCAL ] KMI: Primary data saved (39653 records). [2025-09-15T19:07:41.740838] [INFO ] [MAIN ] KMI: Full history saved. [2025-09-15T19:07:41.740945] [INFO ] [MAIN ] Update Progress: 1204/2369 symbols completed. KMI took 33.7s. Estimated remaining: 2h 3m 30s. Rate: 9.4 symbols/min [2025-09-15T19:07:41.909812] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:07:41.936881] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-15T19:07:41.948526] [DEBUG] [LOCAL ] KNOP: Loaded 6675 existing records from primary storage. [2025-09-15T19:07:41.949043] [INFO ] [MAIN ] KNOP: Loaded 6675 existing records. [2025-09-15T19:07:42.063084] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-09-15T19:07:42.131070] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:07:42.131684] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-09-15T19:07:42.131740] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-09-15T19:07:42.132151] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-09-15T19:07:42.132199] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-09-15T19:07:42.476090] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:07:42.850336] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T19:07:42.860444] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-09-15T19:07:43.613862] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T19:07:43.657821] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-09-15T19:07:44.206673] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-15T19:07:44.457874] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-09-15T19:07:44.668387] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-15T19:07:45.257880] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-09-15T19:07:45.616699] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-15T19:07:46.057884] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-09-15T19:07:46.630189] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-15T19:07:46.634927] [INFO ] [REMOTE ] KN: Full fetch complete (42882 records). [2025-09-15T19:07:46.635033] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-09-15T19:07:46.752747] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-15T19:07:46.863127] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-09-15T19:07:47.031951] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-09-15T19:07:47.032062] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-09-15T19:07:47.033073] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-09-15T19:07:47.033168] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-09-15T19:07:47.034440] [DEBUG] [LOCAL ] KN: Trimmed 42882 records to 27770 (keeping 150 days of data) [2025-09-15T19:07:47.205276] [DEBUG] [LOCAL ] KN: Primary data saved (27770 records). [2025-09-15T19:07:47.205452] [INFO ] [MAIN ] KN: Full history saved. [2025-09-15T19:07:47.205552] [INFO ] [MAIN ] Update Progress: 1205/2369 symbols completed. KN took 19.0s. Estimated remaining: 2h 3m 23s. Rate: 9.4 symbols/min [2025-09-15T19:07:47.375223] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:07:47.390580] [DEBUG] [LOCAL ] KNSL: Loaded 13657 existing records from primary storage. [2025-09-15T19:07:47.390736] [INFO ] [MAIN ] KNSL: Loaded 13657 existing records. [2025-09-15T19:07:47.597716] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:07:47.598050] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-09-15T19:07:47.598097] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-09-15T19:07:47.598671] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-09-15T19:07:47.598721] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-09-15T19:07:47.663092] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-09-15T19:07:47.954607] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:07:48.457902] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-09-15T19:07:48.481082] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-15T19:07:48.749803] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-15T19:07:49.257927] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-09-15T19:07:49.656544] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-15T19:07:49.872243] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-15T19:07:50.057975] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-09-15T19:07:50.802112] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-15T19:07:50.857820] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-09-15T19:07:51.331304] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-15T19:07:51.657876] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-09-15T19:07:52.457906] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-09-15T19:07:52.971554] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-15T19:07:53.257884] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-09-15T19:07:53.333903] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-15T19:07:53.894332] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-15T19:07:54.057894] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-09-15T19:07:54.857852] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-09-15T19:07:54.937014] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-15T19:07:55.657884] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-09-15T19:07:56.258427] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-15T19:07:56.457879] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-09-15T19:07:56.969774] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-15T19:07:56.975405] [INFO ] [REMOTE ] KNF: Full fetch complete (38686 records). [2025-09-15T19:07:56.975603] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-09-15T19:07:57.102403] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-15T19:07:57.263047] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-09-15T19:07:57.385042] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-09-15T19:07:57.385130] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-09-15T19:07:57.385924] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-09-15T19:07:57.385972] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-09-15T19:07:57.387035] [DEBUG] [LOCAL ] KNF: Trimmed 38686 records to 26473 (keeping 150 days of data) [2025-09-15T19:07:57.558121] [DEBUG] [LOCAL ] KNF: Primary data saved (26473 records). [2025-09-15T19:07:57.558284] [INFO ] [MAIN ] KNF: Full history saved. [2025-09-15T19:07:57.558446] [INFO ] [MAIN ] Update Progress: 1206/2369 symbols completed. KNF took 28.0s. Estimated remaining: 2h 3m 21s. Rate: 9.4 symbols/min [2025-09-15T19:07:57.734408] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:07:57.770538] [DEBUG] [LOCAL ] KNTK: Loaded 35256 existing records from primary storage. [2025-09-15T19:07:57.770709] [INFO ] [MAIN ] KNTK: Loaded 35256 existing records. [2025-09-15T19:07:57.951717] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:07:57.952024] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-09-15T19:07:57.952074] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-09-15T19:07:57.953016] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-09-15T19:07:57.953074] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-09-15T19:07:58.063138] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-09-15T19:07:58.417237] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:07:58.436166] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-15T19:07:58.857961] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-09-15T19:07:59.594043] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-15T19:07:59.657875] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-09-15T19:07:59.848727] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-15T19:07:59.854748] [INFO ] [REMOTE ] KMX: Full fetch complete (57375 records). [2025-09-15T19:07:59.854860] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-09-15T19:08:00.235657] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-09-15T19:08:00.235786] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-09-15T19:08:00.236752] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-09-15T19:08:00.236801] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-09-15T19:08:00.238181] [DEBUG] [LOCAL ] KMX: Trimmed 57375 records to 39282 (keeping 150 days of data) [2025-09-15T19:08:00.461567] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-09-15T19:08:00.475883] [DEBUG] [LOCAL ] KMX: Primary data saved (39282 records). [2025-09-15T19:08:00.476033] [INFO ] [MAIN ] KMX: Full history saved. [2025-09-15T19:08:00.477581] [INFO ] [MAIN ] Update Progress: 1207/2369 symbols completed. KMX took 35.9s. Estimated remaining: 2h 3m 11s. Rate: 9.4 symbols/min [2025-09-15T19:08:00.646408] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:08:00.686959] [DEBUG] [LOCAL ] KNX: Loaded 39453 existing records from primary storage. [2025-09-15T19:08:00.687107] [INFO ] [MAIN ] KNX: Loaded 39453 existing records. [2025-09-15T19:08:00.864968] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:08:00.865220] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-09-15T19:08:00.865266] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-09-15T19:08:00.866215] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-09-15T19:08:00.866266] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-09-15T19:08:01.247523] [INFO ] [REMOTE ] KNX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:08:01.257915] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-09-15T19:08:01.287350] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-15T19:08:01.287522] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-15T19:08:01.297185] [INFO ] [REMOTE ] KNOP: Full fetch complete (10662 records). [2025-09-15T19:08:01.297263] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-09-15T19:08:01.653450] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-09-15T19:08:01.653537] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-09-15T19:08:01.653923] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-09-15T19:08:01.653988] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-09-15T19:08:01.654525] [DEBUG] [LOCAL ] KNOP: Trimmed 10662 records to 6609 (keeping 150 days of data) [2025-09-15T19:08:01.693679] [DEBUG] [LOCAL ] KNOP: Primary data saved (6609 records). [2025-09-15T19:08:01.693829] [INFO ] [MAIN ] KNOP: Full history saved. [2025-09-15T19:08:01.693957] [INFO ] [MAIN ] Update Progress: 1208/2369 symbols completed. KNOP took 20.0s. Estimated remaining: 2h 2m 60s. Rate: 9.4 symbols/min [2025-09-15T19:08:01.876785] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:08:01.914765] [DEBUG] [LOCAL ] KO: Loaded 40558 existing records from primary storage. [2025-09-15T19:08:01.914916] [INFO ] [MAIN ] KO: Loaded 40558 existing records. [2025-09-15T19:08:02.062950] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-09-15T19:08:02.090027] [WARN ] [MAIN ] KO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:08:02.091102] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-09-15T19:08:02.091173] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-15T19:08:02.091973] [DEBUG] [LOCAL ] KO: Deleted primary data file. [2025-09-15T19:08:02.092022] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-09-15T19:08:02.392405] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-15T19:08:02.473984] [INFO ] [REMOTE ] KO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:08:02.857883] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-09-15T19:08:03.625851] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T19:08:03.657850] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-09-15T19:08:04.175463] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T19:08:04.457875] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-09-15T19:08:04.887474] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-15T19:08:05.257841] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-09-15T19:08:05.331034] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-15T19:08:06.057884] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-09-15T19:08:06.857902] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-09-15T19:08:07.148482] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-15T19:08:07.321804] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-15T19:08:07.657929] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-09-15T19:08:08.107092] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-15T19:08:08.457918] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-09-15T19:08:09.172363] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-15T19:08:09.175665] [INFO ] [REMOTE ] KNSL: Full fetch complete (20037 records). [2025-09-15T19:08:09.175795] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-09-15T19:08:09.263007] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-09-15T19:08:09.564961] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-09-15T19:08:09.565049] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-09-15T19:08:09.565578] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-09-15T19:08:09.565631] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-09-15T19:08:09.566299] [DEBUG] [LOCAL ] KNSL: Trimmed 20037 records to 13501 (keeping 150 days of data) [2025-09-15T19:08:09.653017] [DEBUG] [LOCAL ] KNSL: Primary data saved (13501 records). [2025-09-15T19:08:09.653171] [INFO ] [MAIN ] KNSL: Full history saved. [2025-09-15T19:08:09.653257] [INFO ] [MAIN ] Update Progress: 1209/2369 symbols completed. KNSL took 22.4s. Estimated remaining: 2h 2m 55s. Rate: 9.4 symbols/min [2025-09-15T19:08:09.825833] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:08:09.860847] [DEBUG] [LOCAL ] KODK: Loaded 32592 existing records from primary storage. [2025-09-15T19:08:09.861016] [INFO ] [MAIN ] KODK: Loaded 32592 existing records. [2025-09-15T19:08:10.049665] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:08:10.049947] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-09-15T19:08:10.050000] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-09-15T19:08:10.050695] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-09-15T19:08:10.050789] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-09-15T19:08:10.063857] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-09-15T19:08:10.435131] [INFO ] [REMOTE ] KODK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:08:10.497946] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.84 seconds). [2025-09-15T19:08:10.539058] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T19:08:10.857882] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-09-15T19:08:11.657888] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-09-15T19:08:11.833527] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-15T19:08:12.457896] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-09-15T19:08:12.883117] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-15T19:08:13.195089] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-15T19:08:13.257837] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-09-15T19:08:13.793560] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T19:08:14.057899] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-09-15T19:08:14.813055] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-15T19:08:14.857843] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-09-15T19:08:15.533506] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T19:08:15.657916] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-09-15T19:08:16.453197] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T19:08:16.458310] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-09-15T19:08:16.460022] [INFO ] [REMOTE ] KNTK: Full fetch complete (49767 records). [2025-09-15T19:08:16.460128] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-09-15T19:08:16.847103] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-09-15T19:08:16.847198] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-09-15T19:08:16.848085] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-09-15T19:08:16.848201] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-09-15T19:08:16.849484] [DEBUG] [LOCAL ] KNTK: Trimmed 49767 records to 34724 (keeping 150 days of data) [2025-09-15T19:08:17.064227] [DEBUG] [LOCAL ] KNTK: Primary data saved (34724 records). [2025-09-15T19:08:17.064376] [INFO ] [MAIN ] KNTK: Full history saved. [2025-09-15T19:08:17.064467] [INFO ] [MAIN ] Update Progress: 1210/2369 symbols completed. KNTK took 19.5s. Estimated remaining: 2h 2m 49s. Rate: 9.4 symbols/min [2025-09-15T19:08:17.237224] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:08:17.257709] [DEBUG] [LOCAL ] KOF: Loaded 19800 existing records from primary storage. [2025-09-15T19:08:17.257885] [INFO ] [MAIN ] KOF: Loaded 19800 existing records. [2025-09-15T19:08:17.257951] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-09-15T19:08:17.438523] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:08:17.438854] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-09-15T19:08:17.438919] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-09-15T19:08:17.439455] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-09-15T19:08:17.439517] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-09-15T19:08:17.794291] [INFO ] [REMOTE ] KOF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:08:17.849797] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-15T19:08:18.057870] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-09-15T19:08:18.258368] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-09-15T19:08:18.857882] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-09-15T19:08:18.991189] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-15T19:08:19.046819] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-15T19:08:19.657908] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-09-15T19:08:20.457869] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-09-15T19:08:20.750602] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-15T19:08:21.257885] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-09-15T19:08:21.291120] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-09-15T19:08:21.973069] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-15T19:08:22.057858] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-09-15T19:08:22.561590] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-15T19:08:22.857865] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-09-15T19:08:23.657868] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-09-15T19:08:23.765169] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-15T19:08:23.776881] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-15T19:08:24.457896] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-09-15T19:08:25.257850] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-09-15T19:08:25.278908] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T19:08:26.057942] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-09-15T19:08:26.327010] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-09-15T19:08:26.451959] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-15T19:08:26.458487] [INFO ] [REMOTE ] KNX: Full fetch complete (57154 records). [2025-09-15T19:08:26.458704] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-09-15T19:08:26.837393] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-09-15T19:08:26.837480] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-09-15T19:08:26.838397] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-09-15T19:08:26.838442] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-09-15T19:08:26.839658] [DEBUG] [LOCAL ] KNX: Trimmed 57154 records to 38684 (keeping 150 days of data) [2025-09-15T19:08:26.896880] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-09-15T19:08:27.102583] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-15T19:08:27.111610] [DEBUG] [LOCAL ] KNX: Primary data saved (38684 records). [2025-09-15T19:08:27.111741] [INFO ] [MAIN ] KNX: Full history saved. [2025-09-15T19:08:27.113166] [INFO ] [MAIN ] Update Progress: 1211/2369 symbols completed. KNX took 26.6s. Estimated remaining: 2h 2m 47s. Rate: 9.4 symbols/min [2025-09-15T19:08:27.298791] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:08:27.313394] [DEBUG] [LOCAL ] KOP: Loaded 12894 existing records from primary storage. [2025-09-15T19:08:27.313527] [INFO ] [MAIN ] KOP: Loaded 12894 existing records. [2025-09-15T19:08:27.491805] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:08:27.492117] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-09-15T19:08:27.492166] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-09-15T19:08:27.492595] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-09-15T19:08:27.492675] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-09-15T19:08:27.663242] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-09-15T19:08:27.842417] [INFO ] [REMOTE ] KOP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:08:28.328835] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-15T19:08:28.457830] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-09-15T19:08:28.902953] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-15T19:08:29.257887] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-09-15T19:08:29.904347] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T19:08:30.057888] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-09-15T19:08:30.330985] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-15T19:08:30.334577] [INFO ] [REMOTE ] KOF: Full fetch complete (28698 records). [2025-09-15T19:08:30.334691] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-09-15T19:08:30.696685] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-09-15T19:08:30.696765] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-09-15T19:08:30.697368] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-09-15T19:08:30.697418] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-09-15T19:08:30.698502] [DEBUG] [LOCAL ] KOF: Trimmed 28698 records to 19529 (keeping 150 days of data) [2025-09-15T19:08:30.818484] [DEBUG] [LOCAL ] KOF: Primary data saved (19529 records). [2025-09-15T19:08:30.818653] [INFO ] [MAIN ] KOF: Full history saved. [2025-09-15T19:08:30.818745] [INFO ] [MAIN ] Update Progress: 1212/2369 symbols completed. KOF took 13.8s. Estimated remaining: 2h 2m 38s. Rate: 9.4 symbols/min [2025-09-15T19:08:30.862963] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-09-15T19:08:30.994762] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:08:30.998341] [DEBUG] [LOCAL ] KORE: Loaded 1563 existing records from primary storage. [2025-09-15T19:08:30.998413] [INFO ] [MAIN ] KORE: Loaded 1563 existing records. [2025-09-15T19:08:31.171322] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:08:31.171547] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-09-15T19:08:31.171592] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-09-15T19:08:31.171763] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-09-15T19:08:31.171808] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-09-15T19:08:31.521604] [INFO ] [REMOTE ] KORE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:08:31.657873] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-09-15T19:08:31.703152] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-15T19:08:32.394752] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-15T19:08:32.457832] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-09-15T19:08:33.257921] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-09-15T19:08:33.327023] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-09-15T19:08:33.562608] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-15T19:08:33.686835] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-15T19:08:34.057882] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-09-15T19:08:34.857864] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-09-15T19:08:34.932538] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-15T19:08:35.657938] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-09-15T19:08:36.293307] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T19:08:36.348675] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-15T19:08:36.457913] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-09-15T19:08:37.257920] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-09-15T19:08:38.057910] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-09-15T19:08:38.242618] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-15T19:08:38.325509] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-09-15T19:08:38.857889] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-09-15T19:08:39.275089] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-15T19:08:39.657901] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-09-15T19:08:39.907266] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-09-15T19:08:39.913245] [INFO ] [REMOTE ] KO: Full fetch complete (58498 records). [2025-09-15T19:08:39.913424] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-09-15T19:08:40.023001] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-15T19:08:40.301822] [DEBUG] [VALIDATOR ] KO: All expected trading days are present. [2025-09-15T19:08:40.301905] [DEBUG] [VALIDATOR ] KO: Primary data validation passed. [2025-09-15T19:08:40.302773] [INFO ] [MAIN ] KO: Fetched primary data is valid. [2025-09-15T19:08:40.302820] [DEBUG] [LOCAL ] KO: Saving primary data. [2025-09-15T19:08:40.306394] [DEBUG] [LOCAL ] KO: Trimmed 58498 records to 39778 (keeping 150 days of data) [2025-09-15T19:08:40.495136] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-09-15T19:08:40.569880] [DEBUG] [LOCAL ] KO: Primary data saved (39778 records). [2025-09-15T19:08:40.570048] [INFO ] [MAIN ] KO: Full history saved. [2025-09-15T19:08:40.570627] [INFO ] [MAIN ] Update Progress: 1213/2369 symbols completed. KO took 38.9s. Estimated remaining: 2h 2m 35s. Rate: 9.4 symbols/min [2025-09-15T19:08:40.745374] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:08:40.792827] [DEBUG] [LOCAL ] KOS: Loaded 39954 existing records from primary storage. [2025-09-15T19:08:40.793001] [INFO ] [MAIN ] KOS: Loaded 39954 existing records. [2025-09-15T19:08:40.968205] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:08:40.968557] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-09-15T19:08:40.968627] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-09-15T19:08:40.969708] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-09-15T19:08:40.969783] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-09-15T19:08:41.263090] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-09-15T19:08:41.321596] [INFO ] [REMOTE ] KOS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:08:41.727722] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-15T19:08:42.062929] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-09-15T19:08:42.076894] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T19:08:42.857870] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-09-15T19:08:43.449261] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-15T19:08:43.657877] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-09-15T19:08:43.744420] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T19:08:44.075249] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-15T19:08:44.457873] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-09-15T19:08:45.035568] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-15T19:08:45.257873] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-09-15T19:08:45.701349] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-15T19:08:45.702386] [INFO ] [REMOTE ] KORE: Full fetch complete (2245 records). [2025-09-15T19:08:45.702469] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-09-15T19:08:46.065322] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-09-15T19:08:46.106426] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-09-15T19:08:46.106535] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-09-15T19:08:46.106699] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-09-15T19:08:46.106746] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-09-15T19:08:46.107120] [DEBUG] [LOCAL ] KORE: Trimmed 2245 records to 1525 (keeping 150 days of data) [2025-09-15T19:08:46.117815] [DEBUG] [LOCAL ] KORE: Primary data saved (1525 records). [2025-09-15T19:08:46.117876] [INFO ] [MAIN ] KORE: Full history saved. [2025-09-15T19:08:46.117997] [INFO ] [MAIN ] Update Progress: 1214/2369 symbols completed. KORE took 15.3s. Estimated remaining: 2h 2m 27s. Rate: 9.4 symbols/min [2025-09-15T19:08:46.289297] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:08:46.337364] [DEBUG] [LOCAL ] KR: Loaded 40423 existing records from primary storage. [2025-09-15T19:08:46.337606] [INFO ] [MAIN ] KR: Loaded 40423 existing records. [2025-09-15T19:08:46.514991] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:08:46.515313] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-09-15T19:08:46.515363] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-09-15T19:08:46.516487] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-09-15T19:08:46.516543] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-09-15T19:08:46.858625] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-09-15T19:08:46.939369] [INFO ] [REMOTE ] KR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:08:47.657959] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-09-15T19:08:47.944022] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-15T19:08:48.086000] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-15T19:08:48.091137] [INFO ] [REMOTE ] KODK: Full fetch complete (47179 records). [2025-09-15T19:08:48.091250] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-09-15T19:08:48.469989] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-09-15T19:08:48.467155] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-09-15T19:08:48.479960] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-09-15T19:08:48.482147] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-09-15T19:08:48.482414] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-09-15T19:08:48.483775] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-15T19:08:48.488384] [DEBUG] [LOCAL ] KODK: Trimmed 47179 records to 31957 (keeping 150 days of data) [2025-09-15T19:08:48.700386] [DEBUG] [LOCAL ] KODK: Primary data saved (31957 records). [2025-09-15T19:08:48.700579] [INFO ] [MAIN ] KODK: Full history saved. [2025-09-15T19:08:48.700738] [INFO ] [MAIN ] Update Progress: 1215/2369 symbols completed. KODK took 39.0s. Estimated remaining: 2h 2m 18s. Rate: 9.4 symbols/min [2025-09-15T19:08:48.875891] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:08:48.914534] [DEBUG] [LOCAL ] KRC: Loaded 36061 existing records from primary storage. [2025-09-15T19:08:48.914706] [INFO ] [MAIN ] KRC: Loaded 36061 existing records. [2025-09-15T19:08:49.092925] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:08:49.093285] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-09-15T19:08:49.093344] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-09-15T19:08:49.094167] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-09-15T19:08:49.094233] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-09-15T19:08:49.263037] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-09-15T19:08:49.441323] [INFO ] [REMOTE ] KRC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:08:50.048539] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-15T19:08:50.057808] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-09-15T19:08:50.120493] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T19:08:50.857878] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-09-15T19:08:51.040580] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T19:08:51.043359] [INFO ] [REMOTE ] KOP: Full fetch complete (19457 records). [2025-09-15T19:08:51.043431] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-09-15T19:08:51.402333] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-09-15T19:08:51.402460] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-09-15T19:08:51.402938] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-09-15T19:08:51.402994] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-09-15T19:08:51.403974] [DEBUG] [LOCAL ] KOP: Trimmed 19457 records to 12639 (keeping 150 days of data) [2025-09-15T19:08:51.487868] [DEBUG] [LOCAL ] KOP: Primary data saved (12639 records). [2025-09-15T19:08:51.488021] [INFO ] [MAIN ] KOP: Full history saved. [2025-09-15T19:08:51.488157] [INFO ] [MAIN ] Update Progress: 1216/2369 symbols completed. KOP took 24.4s. Estimated remaining: 2h 2m 8s. Rate: 9.4 symbols/min [2025-09-15T19:08:51.657485] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:08:51.657917] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-09-15T19:08:51.688613] [DEBUG] [LOCAL ] KREF: Loaded 27613 existing records from primary storage. [2025-09-15T19:08:51.688777] [INFO ] [MAIN ] KREF: Loaded 27613 existing records. [2025-09-15T19:08:51.862851] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:08:51.863087] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-09-15T19:08:51.863134] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-09-15T19:08:51.863930] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-09-15T19:08:51.863985] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-09-15T19:08:52.212388] [INFO ] [REMOTE ] KREF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:08:52.457838] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-09-15T19:08:52.499195] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T19:08:53.257937] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-09-15T19:08:53.558712] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-15T19:08:54.057894] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-09-15T19:08:54.143594] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T19:08:54.859391] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-09-15T19:08:54.865731] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-15T19:08:54.950767] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-15T19:08:55.657911] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-09-15T19:08:56.469944] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-09-15T19:08:56.504329] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-15T19:08:57.257943] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-09-15T19:08:57.304628] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-15T19:08:58.057904] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-09-15T19:08:58.148238] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-15T19:08:58.270926] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-15T19:08:58.857924] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-09-15T19:08:59.657919] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-09-15T19:08:59.738105] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-15T19:09:00.457888] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-09-15T19:09:00.542107] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-15T19:09:01.175930] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-15T19:09:01.257824] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-09-15T19:09:02.057918] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-09-15T19:09:02.857939] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-09-15T19:09:03.314550] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-15T19:09:03.424627] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (2.97 seconds). [2025-09-15T19:09:03.657828] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-09-15T19:09:04.457899] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-09-15T19:09:05.455346] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-15T19:09:05.467113] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-09-15T19:09:05.642616] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (3.58 seconds). [2025-09-15T19:09:06.034739] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-15T19:09:06.057830] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-09-15T19:09:06.270396] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (3.41 seconds). [2025-09-15T19:09:06.857901] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-09-15T19:09:07.012309] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-15T19:09:07.019236] [INFO ] [REMOTE ] KR: Full fetch complete (58358 records). [2025-09-15T19:09:07.019412] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-09-15T19:09:07.438713] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-09-15T19:09:07.441535] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-09-15T19:09:07.442825] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-09-15T19:09:07.441406] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-15T19:09:07.443097] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-09-15T19:09:07.453769] [DEBUG] [LOCAL ] KR: Trimmed 58358 records to 39643 (keeping 150 days of data) [2025-09-15T19:09:07.659332] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-09-15T19:09:07.722653] [DEBUG] [LOCAL ] KR: Primary data saved (39643 records). [2025-09-15T19:09:07.722825] [INFO ] [MAIN ] KR: Full history saved. [2025-09-15T19:09:07.722919] [INFO ] [MAIN ] Update Progress: 1217/2369 symbols completed. KR took 21.6s. Estimated remaining: 2h 2m 11s. Rate: 9.4 symbols/min [2025-09-15T19:09:07.893140] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:09:07.929494] [DEBUG] [LOCAL ] KRG: Loaded 36852 existing records from primary storage. [2025-09-15T19:09:07.929667] [INFO ] [MAIN ] KRG: Loaded 36852 existing records. [2025-09-15T19:09:08.104100] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:09:08.104390] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-09-15T19:09:08.104439] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-09-15T19:09:08.105308] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-09-15T19:09:08.105360] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-09-15T19:09:08.459845] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-09-15T19:09:08.459725] [INFO ] [REMOTE ] KRG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:09:08.491412] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T19:09:09.257895] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-09-15T19:09:09.476456] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-15T19:09:09.507063] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-15T19:09:10.057882] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-09-15T19:09:10.383448] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-15T19:09:10.857927] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-09-15T19:09:11.621873] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-15T19:09:11.657955] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-09-15T19:09:12.117684] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-15T19:09:12.457958] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-09-15T19:09:13.257837] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-09-15T19:09:13.644046] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-15T19:09:13.650616] [INFO ] [REMOTE ] KOS: Full fetch complete (57713 records). [2025-09-15T19:09:13.650830] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-09-15T19:09:14.047032] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-09-15T19:09:14.047118] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-09-15T19:09:14.047973] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-09-15T19:09:14.048021] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-09-15T19:09:14.049256] [DEBUG] [LOCAL ] KOS: Trimmed 57713 records to 39184 (keeping 150 days of data) [2025-09-15T19:09:14.099604] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-09-15T19:09:14.287195] [DEBUG] [LOCAL ] KOS: Primary data saved (39184 records). [2025-09-15T19:09:14.287363] [INFO ] [MAIN ] KOS: Full history saved. [2025-09-15T19:09:14.288302] [INFO ] [MAIN ] Update Progress: 1218/2369 symbols completed. KOS took 33.7s. Estimated remaining: 2h 2m 5s. Rate: 9.4 symbols/min [2025-09-15T19:09:14.464822] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:09:14.465064] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-09-15T19:09:14.465106] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-09-15T19:09:14.465236] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-09-15T19:09:14.465276] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-15T19:09:14.465348] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-15T19:09:14.465400] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-09-15T19:09:14.828064] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:09:14.857827] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-02. [2025-09-15T19:09:15.040514] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-15T19:09:15.103589] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-15T19:09:15.107787] [INFO ] [REMOTE ] KREF: Full fetch complete (39298 records). [2025-09-15T19:09:15.107907] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-09-15T19:09:15.489963] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-09-15T19:09:15.490047] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-09-15T19:09:15.490858] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-09-15T19:09:15.490909] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-09-15T19:09:15.491928] [DEBUG] [LOCAL ] KREF: Trimmed 39298 records to 27019 (keeping 150 days of data) [2025-09-15T19:09:15.623040] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T19:09:15.659709] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-03. [2025-09-15T19:09:15.684345] [DEBUG] [LOCAL ] KREF: Primary data saved (27019 records). [2025-09-15T19:09:15.684501] [INFO ] [MAIN ] KREF: Full history saved. [2025-09-15T19:09:15.684605] [INFO ] [MAIN ] Update Progress: 1219/2369 symbols completed. KREF took 24.2s. Estimated remaining: 2h 1m 54s. Rate: 9.4 symbols/min [2025-09-15T19:09:15.863624] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:09:15.883034] [DEBUG] [LOCAL ] KRO: Loaded 19761 existing records from primary storage. [2025-09-15T19:09:15.883174] [INFO ] [MAIN ] KRO: Loaded 19761 existing records. [2025-09-15T19:09:16.057674] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:09:16.057976] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-09-15T19:09:16.058154] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-09-15T19:09:16.058944] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-09-15T19:09:16.059002] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-09-15T19:09:16.385630] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-15T19:09:16.454668] [INFO ] [REMOTE ] KRO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:09:16.457815] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-09-15T19:09:17.152287] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-15T19:09:17.257889] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-04. [2025-09-15T19:09:17.380411] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-15T19:09:18.057897] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-09-15T19:09:18.629419] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T19:09:18.857926] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-09-15T19:09:19.657914] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-09-15T19:09:19.710789] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-15T19:09:19.823465] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-15T19:09:20.457889] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-05. [2025-09-15T19:09:21.236369] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T19:09:21.257826] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-09-15T19:09:21.648743] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-15T19:09:22.057877] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-09-15T19:09:22.719635] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T19:09:22.857877] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-09-15T19:09:23.201975] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-15T19:09:23.657868] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-06. [2025-09-15T19:09:24.352555] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T19:09:24.457911] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-09-15T19:09:25.129281] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T19:09:25.257863] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-07. [2025-09-15T19:09:26.057869] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-09-15T19:09:26.138590] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T19:09:26.785842] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-15T19:09:26.857885] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-08. [2025-09-15T19:09:27.178509] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-15T19:09:27.657892] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-09-15T19:09:28.206311] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-15T19:09:28.429321] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-15T19:09:28.457878] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-09-15T19:09:29.257925] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-09. [2025-09-15T19:09:29.635596] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-15T19:09:30.057943] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-09-15T19:09:30.748727] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-15T19:09:30.754318] [INFO ] [REMOTE ] KRMN: Full fetch complete (47392 records). [2025-09-15T19:09:30.754466] [DEBUG] [VALIDATOR ] KRMN: Validating primary data. [2025-09-15T19:09:30.864016] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-09-15T19:09:30.959428] [WARN ] [VALIDATOR ] KRMN: Validation failed - insufficient historical data. Have 147 unique days, need 150 days [2025-09-15T19:09:30.960068] [FATAL] [MAIN ] KRMN: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:09:30.960130] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:09:30.960192] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-15T19:09:30.960281] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-15T19:09:30.960330] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-09-15T19:09:30.960394] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-09-15T19:09:30.960479] [INFO ] [MAIN ] Update Progress: 1220/2369 symbols completed. KRMN took 16.7s. Estimated remaining: 2h 1m 56s. Rate: 9.4 symbols/min [2025-09-15T19:09:31.139384] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:09:31.169908] [DEBUG] [LOCAL ] KRP: Loaded 27131 existing records from primary storage. [2025-09-15T19:09:31.170109] [INFO ] [MAIN ] KRP: Loaded 27131 existing records. [2025-09-15T19:09:31.352814] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:09:31.353103] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-09-15T19:09:31.353165] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-09-15T19:09:31.353980] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-09-15T19:09:31.354032] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-09-15T19:09:31.657507] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T19:09:31.662708] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-09-15T19:09:31.711359] [INFO ] [REMOTE ] KRC: Full fetch complete (52806 records). [2025-09-15T19:09:31.730590] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-09-15T19:09:31.734146] [INFO ] [REMOTE ] KRP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:09:32.132380] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-15T19:09:32.130877] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-09-15T19:09:32.138692] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-09-15T19:09:32.140070] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-09-15T19:09:32.140161] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-09-15T19:09:32.141742] [DEBUG] [LOCAL ] KRC: Trimmed 52806 records to 35359 (keeping 150 days of data) [2025-09-15T19:09:32.371579] [DEBUG] [LOCAL ] KRC: Primary data saved (35359 records). [2025-09-15T19:09:32.371915] [INFO ] [MAIN ] KRC: Full history saved. [2025-09-15T19:09:32.372066] [INFO ] [MAIN ] Update Progress: 1221/2369 symbols completed. KRC took 43.7s. Estimated remaining: 2h 1m 45s. Rate: 9.4 symbols/min [2025-09-15T19:09:32.464313] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-09-15T19:09:32.548258] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:09:32.591125] [DEBUG] [LOCAL ] KSS: Loaded 40357 existing records from primary storage. [2025-09-15T19:09:32.591296] [INFO ] [MAIN ] KSS: Loaded 40357 existing records. [2025-09-15T19:09:32.805124] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:09:32.805561] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-09-15T19:09:32.805620] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-09-15T19:09:32.807097] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-09-15T19:09:32.807179] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-09-15T19:09:33.204611] [INFO ] [REMOTE ] KSS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:09:33.220593] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-15T19:09:33.226454] [INFO ] [REMOTE ] KRG: Full fetch complete (53439 records). [2025-09-15T19:09:33.226665] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-09-15T19:09:33.262961] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-09-15T19:09:33.587177] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-15T19:09:33.638911] [INFO ] [REMOTE ] KRO: Full fetch complete (27003 records). [2025-09-15T19:09:33.641758] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-09-15T19:09:33.642125] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-09-15T19:09:33.642293] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-09-15T19:09:33.643226] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-09-15T19:09:33.676292] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-09-15T19:09:33.772565] [DEBUG] [LOCAL ] KRG: Trimmed 53439 records to 36082 (keeping 150 days of data) [2025-09-15T19:09:34.081805] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-09-15T19:09:34.177857] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-09-15T19:09:34.179816] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-09-15T19:09:34.182290] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-09-15T19:09:34.184505] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-09-15T19:09:34.228835] [DEBUG] [LOCAL ] KRO: Trimmed 27003 records to 19369 (keeping 150 days of data) [2025-09-15T19:09:34.385627] [DEBUG] [LOCAL ] KRO: Primary data saved (19369 records). [2025-09-15T19:09:34.386595] [INFO ] [MAIN ] KRO: Full history saved. [2025-09-15T19:09:34.386993] [INFO ] [MAIN ] Update Progress: 1222/2369 symbols completed. KRO took 18.7s. Estimated remaining: 2h 1m 34s. Rate: 9.4 symbols/min [2025-09-15T19:09:34.563830] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:09:34.570509] [DEBUG] [LOCAL ] KRG: Primary data saved (36082 records). [2025-09-15T19:09:34.570629] [INFO ] [MAIN ] KRG: Full history saved. [2025-09-15T19:09:34.570743] [INFO ] [MAIN ] Update Progress: 1223/2369 symbols completed. KRG took 26.8s. Estimated remaining: 2h 1m 22s. Rate: 9.4 symbols/min [2025-09-15T19:09:34.750801] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:09:34.764155] [DEBUG] [LOCAL ] KT: Loaded 33903 existing records from primary storage. [2025-09-15T19:09:34.764338] [INFO ] [MAIN ] KT: Loaded 33903 existing records. [2025-09-15T19:09:34.967276] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:09:34.963296] [DEBUG] [LOCAL ] KTB: Loaded 30714 existing records from primary storage. [2025-09-15T19:09:34.967819] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-09-15T19:09:34.968079] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-09-15T19:09:34.968166] [INFO ] [MAIN ] KTB: Loaded 30714 existing records. [2025-09-15T19:09:34.989018] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-09-15T19:09:34.989219] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-09-15T19:09:35.263031] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:09:35.290034] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-09-15T19:09:35.316790] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-09-15T19:09:35.327267] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-09-15T19:09:35.338256] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-09-15T19:09:35.586279] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-15T19:09:35.717957] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-09-15T19:09:35.746268] [INFO ] [REMOTE ] KT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:09:35.790716] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-09-15T19:09:35.948166] [INFO ] [REMOTE ] KTB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:09:35.950102] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-15T19:09:36.457863] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-09-15T19:09:37.110385] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T19:09:37.257888] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-09-15T19:09:37.616433] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-15T19:09:38.041905] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T19:09:38.057841] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-09-15T19:09:38.734960] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-15T19:09:38.857875] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-09-15T19:09:39.246718] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-15T19:09:39.657932] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-09-15T19:09:40.457893] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-09-15T19:09:40.511800] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-15T19:09:40.845595] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-15T19:09:41.257889] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-09-15T19:09:42.057977] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-09-15T19:09:42.352400] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-15T19:09:42.444555] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-15T19:09:42.857914] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-09-15T19:09:43.465582] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-15T19:09:43.657923] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-09-15T19:09:44.076189] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T19:09:44.457917] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-09-15T19:09:44.663551] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T19:09:45.257903] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-09-15T19:09:46.057845] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-09-15T19:09:46.175923] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-15T19:09:46.558948] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-15T19:09:46.857873] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-09-15T19:09:47.167254] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T19:09:47.657949] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-09-15T19:09:48.169710] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-15T19:09:48.173576] [INFO ] [REMOTE ] KRP: Full fetch complete (41642 records). [2025-09-15T19:09:48.173700] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-09-15T19:09:48.461932] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-09-15T19:09:48.549565] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-09-15T19:09:48.549679] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-09-15T19:09:48.550476] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-09-15T19:09:48.550519] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-09-15T19:09:48.551534] [DEBUG] [LOCAL ] KRP: Trimmed 41642 records to 26642 (keeping 150 days of data) [2025-09-15T19:09:48.725089] [DEBUG] [LOCAL ] KRP: Primary data saved (26642 records). [2025-09-15T19:09:48.725262] [INFO ] [MAIN ] KRP: Full history saved. [2025-09-15T19:09:48.725385] [INFO ] [MAIN ] Update Progress: 1224/2369 symbols completed. KRP took 17.8s. Estimated remaining: 2h 1m 23s. Rate: 9.4 symbols/min [2025-09-15T19:09:48.899591] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:09:48.909321] [DEBUG] [LOCAL ] KTF: Loaded 8981 existing records from primary storage. [2025-09-15T19:09:48.909422] [INFO ] [MAIN ] KTF: Loaded 8981 existing records. [2025-09-15T19:09:49.091907] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:09:49.092154] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-09-15T19:09:49.092204] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-09-15T19:09:49.092596] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-09-15T19:09:49.092674] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-09-15T19:09:49.261153] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-09-15T19:09:49.462481] [INFO ] [REMOTE ] KTF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:09:49.528412] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-15T19:09:49.562559] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-15T19:09:50.057882] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-09-15T19:09:50.857963] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-09-15T19:09:51.160482] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-15T19:09:51.662993] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-09-15T19:09:51.680769] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-15T19:09:52.268183] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-15T19:09:52.457910] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-09-15T19:09:52.635410] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-15T19:09:53.257925] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-09-15T19:09:53.590488] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T19:09:53.994392] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-15T19:09:54.057890] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-09-15T19:09:54.857919] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-09-15T19:09:55.480948] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-15T19:09:55.485350] [INFO ] [REMOTE ] KTB: Full fetch complete (45339 records). [2025-09-15T19:09:55.485448] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-09-15T19:09:55.660927] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-09-15T19:09:55.667739] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-15T19:09:55.907220] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-09-15T19:09:55.907341] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-09-15T19:09:55.908532] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-09-15T19:09:55.908697] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-09-15T19:09:55.910286] [DEBUG] [LOCAL ] KTB: Trimmed 45339 records to 30183 (keeping 150 days of data) [2025-09-15T19:09:56.111130] [DEBUG] [LOCAL ] KTB: Primary data saved (30183 records). [2025-09-15T19:09:56.111330] [INFO ] [MAIN ] KTB: Full history saved. [2025-09-15T19:09:56.111511] [INFO ] [MAIN ] Update Progress: 1225/2369 symbols completed. KTB took 21.5s. Estimated remaining: 2h 1m 17s. Rate: 9.4 symbols/min [2025-09-15T19:09:56.287361] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:09:56.287690] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-09-15T19:09:56.287732] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-09-15T19:09:56.287877] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-09-15T19:09:56.287917] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-15T19:09:56.287957] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-15T19:09:56.287991] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-09-15T19:09:56.463076] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-09-15T19:09:56.652980] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:09:57.257905] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-09-15T19:09:57.691613] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-15T19:09:57.723256] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-15T19:09:58.057961] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-09-15T19:09:58.148175] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-15T19:09:58.857927] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-09-15T19:09:59.540222] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-15T19:09:59.640932] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-15T19:09:59.647423] [INFO ] [REMOTE ] KSS: Full fetch complete (58287 records). [2025-09-15T19:09:59.647678] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-09-15T19:09:59.662964] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-09-15T19:10:00.050887] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-09-15T19:10:00.050992] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-09-15T19:10:00.052156] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-09-15T19:10:00.052206] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-09-15T19:10:00.053836] [DEBUG] [LOCAL ] KSS: Trimmed 58287 records to 39575 (keeping 150 days of data) [2025-09-15T19:10:00.328710] [DEBUG] [LOCAL ] KSS: Primary data saved (39575 records). [2025-09-15T19:10:00.328895] [INFO ] [MAIN ] KSS: Full history saved. [2025-09-15T19:10:00.329521] [INFO ] [MAIN ] Update Progress: 1226/2369 symbols completed. KSS took 28.0s. Estimated remaining: 2h 1m 9s. Rate: 9.4 symbols/min [2025-09-15T19:10:00.462782] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-09-15T19:10:00.521808] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T19:10:00.527294] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:10:00.569480] [DEBUG] [LOCAL ] KVUE: Loaded 40407 existing records from primary storage. [2025-09-15T19:10:00.569663] [INFO ] [MAIN ] KVUE: Loaded 40407 existing records. [2025-09-15T19:10:00.744933] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:10:00.745234] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-09-15T19:10:00.745284] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-09-15T19:10:00.746434] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-09-15T19:10:00.746493] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-09-15T19:10:01.095894] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:10:01.257844] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-09-15T19:10:01.596364] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-15T19:10:02.057877] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-09-15T19:10:02.835597] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-15T19:10:02.857922] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-09-15T19:10:03.432072] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-15T19:10:03.657952] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-09-15T19:10:03.810952] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-15T19:10:04.458022] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-09-15T19:10:05.075565] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-15T19:10:05.257990] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-09-15T19:10:05.268855] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-15T19:10:05.271165] [INFO ] [REMOTE ] KTF: Full fetch complete (14226 records). [2025-09-15T19:10:05.271519] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-09-15T19:10:05.662732] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-09-15T19:10:05.662851] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-09-15T19:10:05.663311] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-09-15T19:10:05.663360] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-09-15T19:10:05.664410] [DEBUG] [LOCAL ] KTF: Trimmed 14226 records to 8631 (keeping 150 days of data) [2025-09-15T19:10:05.726115] [DEBUG] [LOCAL ] KTF: Primary data saved (8631 records). [2025-09-15T19:10:05.726343] [INFO ] [MAIN ] KTF: Full history saved. [2025-09-15T19:10:05.726551] [INFO ] [MAIN ] Update Progress: 1227/2369 symbols completed. KTF took 17.0s. Estimated remaining: 2h 1m 2s. Rate: 9.4 symbols/min [2025-09-15T19:10:05.845531] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-15T19:10:05.932790] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:10:05.973145] [DEBUG] [LOCAL ] KVYO: Loaded 37922 existing records from primary storage. [2025-09-15T19:10:05.973559] [INFO ] [MAIN ] KVYO: Loaded 37922 existing records. [2025-09-15T19:10:06.063118] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-09-15T19:10:06.158966] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:10:06.159272] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-09-15T19:10:06.159320] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-09-15T19:10:06.160260] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-09-15T19:10:06.160321] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-09-15T19:10:06.526924] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:10:06.857905] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-09-15T19:10:07.507710] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-15T19:10:07.657923] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-09-15T19:10:08.456558] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T19:10:08.465166] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-09-15T19:10:08.893284] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-15T19:10:09.257883] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-09-15T19:10:10.057888] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-09-15T19:10:10.272006] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-15T19:10:10.408376] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-15T19:10:10.857893] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-09-15T19:10:11.657875] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-09-15T19:10:11.755982] [DEBUG] [REMOTE ] KUKE: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-15T19:10:11.756338] [WARN ] [REMOTE ] KUKE: No data returned for month 2025-05 [2025-09-15T19:10:11.788598] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-15T19:10:12.081821] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-15T19:10:12.087287] [INFO ] [REMOTE ] KT: Full fetch complete (50030 records). [2025-09-15T19:10:12.087391] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-09-15T19:10:12.466973] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-09-15T19:10:12.469675] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-09-15T19:10:12.470004] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-09-15T19:10:12.471529] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-09-15T19:10:12.471609] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-09-15T19:10:12.473159] [DEBUG] [LOCAL ] KT: Trimmed 50030 records to 33182 (keeping 150 days of data) [2025-09-15T19:10:12.693115] [DEBUG] [LOCAL ] KT: Primary data saved (33182 records). [2025-09-15T19:10:12.693293] [INFO ] [MAIN ] KT: Full history saved. [2025-09-15T19:10:12.693444] [INFO ] [MAIN ] Update Progress: 1228/2369 symbols completed. KT took 38.3s. Estimated remaining: 2h 0m 56s. Rate: 9.4 symbols/min [2025-09-15T19:10:12.862019] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:10:12.894710] [DEBUG] [LOCAL ] KW: Loaded 30508 existing records from primary storage. [2025-09-15T19:10:12.894880] [INFO ] [MAIN ] KW: Loaded 30508 existing records. [2025-09-15T19:10:13.069189] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:10:13.069457] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-09-15T19:10:13.069510] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-09-15T19:10:13.070188] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-09-15T19:10:13.070244] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-09-15T19:10:13.263157] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-09-15T19:10:13.457552] [INFO ] [REMOTE ] KW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:10:13.668074] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-15T19:10:14.057903] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-09-15T19:10:14.364693] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-15T19:10:14.857951] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-09-15T19:10:15.414726] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-15T19:10:15.657876] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-09-15T19:10:16.457955] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-09-15T19:10:16.644885] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-15T19:10:16.848388] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-15T19:10:17.257878] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-09-15T19:10:17.831703] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T19:10:18.057917] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-09-15T19:10:18.712743] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-15T19:10:18.857943] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-09-15T19:10:19.419004] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-15T19:10:19.657873] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-09-15T19:10:20.457904] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-09-15T19:10:20.559564] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-15T19:10:20.939668] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-15T19:10:20.971835] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-15T19:10:21.257873] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-09-15T19:10:22.057885] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-09-15T19:10:22.857890] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-09-15T19:10:22.996147] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-15T19:10:23.002099] [INFO ] [REMOTE ] KVUE: Full fetch complete (58347 records). [2025-09-15T19:10:23.002221] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-09-15T19:10:23.408477] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-09-15T19:10:23.408669] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-09-15T19:10:23.410187] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-09-15T19:10:23.410251] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-09-15T19:10:23.414432] [DEBUG] [LOCAL ] KVUE: Trimmed 58347 records to 39627 (keeping 150 days of data) [2025-09-15T19:10:23.659291] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-09-15T19:10:23.717703] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T19:10:23.768367] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-15T19:10:23.785000] [DEBUG] [LOCAL ] KVUE: Primary data saved (39627 records). [2025-09-15T19:10:23.785181] [INFO ] [MAIN ] KVUE: Full history saved. [2025-09-15T19:10:23.785964] [INFO ] [MAIN ] Update Progress: 1229/2369 symbols completed. KVUE took 23.5s. Estimated remaining: 2h 0m 54s. Rate: 9.4 symbols/min [2025-09-15T19:10:23.958096] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:10:23.974609] [DEBUG] [LOCAL ] KWR: Loaded 12557 existing records from primary storage. [2025-09-15T19:10:23.974774] [INFO ] [MAIN ] KWR: Loaded 12557 existing records. [2025-09-15T19:10:24.098775] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-15T19:10:24.168321] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:10:24.168636] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-09-15T19:10:24.168711] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-09-15T19:10:24.169169] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-09-15T19:10:24.169217] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-09-15T19:10:24.463049] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-09-15T19:10:24.552173] [INFO ] [REMOTE ] KWR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:10:25.257870] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-09-15T19:10:26.057873] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-09-15T19:10:26.090212] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-15T19:10:26.205676] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T19:10:26.758957] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T19:10:26.760138] [INFO ] [REMOTE ] KUKE: Full fetch complete (4577 records). [2025-09-15T19:10:26.760207] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-09-15T19:10:26.862984] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-09-15T19:10:26.950841] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 128 unique days, need 150 days [2025-09-15T19:10:26.951165] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:10:26.951248] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:10:26.951331] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-15T19:10:26.951431] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-15T19:10:26.951503] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-09-15T19:10:26.951573] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-09-15T19:10:26.951689] [INFO ] [MAIN ] Update Progress: 1230/2369 symbols completed. KUKE took 30.8s. Estimated remaining: 2h 0m 45s. Rate: 9.4 symbols/min [2025-09-15T19:10:27.120791] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:10:27.147495] [DEBUG] [LOCAL ] KYN: Loaded 22403 existing records from primary storage. [2025-09-15T19:10:27.147702] [INFO ] [MAIN ] KYN: Loaded 22403 existing records. [2025-09-15T19:10:27.323877] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:10:27.324236] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-09-15T19:10:27.324305] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-09-15T19:10:27.324961] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-09-15T19:10:27.325016] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-09-15T19:10:27.665182] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-09-15T19:10:27.687217] [INFO ] [REMOTE ] KYN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:10:28.306335] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-15T19:10:28.356182] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-15T19:10:28.457862] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-09-15T19:10:29.257907] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-09-15T19:10:29.514467] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-15T19:10:30.057883] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-09-15T19:10:30.294147] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T19:10:30.299099] [INFO ] [REMOTE ] KW: Full fetch complete (43695 records). [2025-09-15T19:10:30.299194] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-09-15T19:10:30.674462] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-09-15T19:10:30.674574] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-09-15T19:10:30.675340] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-09-15T19:10:30.675423] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-09-15T19:10:30.676806] [DEBUG] [LOCAL ] KW: Trimmed 43695 records to 29877 (keeping 150 days of data) [2025-09-15T19:10:30.786224] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-15T19:10:30.857918] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-09-15T19:10:30.890771] [DEBUG] [LOCAL ] KW: Primary data saved (29877 records). [2025-09-15T19:10:30.890912] [INFO ] [MAIN ] KW: Full history saved. [2025-09-15T19:10:30.891024] [INFO ] [MAIN ] Update Progress: 1231/2369 symbols completed. KW took 18.2s. Estimated remaining: 2h 0m 36s. Rate: 9.4 symbols/min [2025-09-15T19:10:31.063117] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:10:31.097675] [DEBUG] [LOCAL ] L: Loaded 30602 existing records from primary storage. [2025-09-15T19:10:31.097878] [INFO ] [MAIN ] L: Loaded 30602 existing records. [2025-09-15T19:10:31.277093] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:10:31.277379] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-09-15T19:10:31.277426] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-09-15T19:10:31.278181] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-09-15T19:10:31.278232] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-09-15T19:10:31.640443] [INFO ] [REMOTE ] L: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:10:31.657826] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-09-15T19:10:32.457851] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-09-15T19:10:32.498169] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-15T19:10:32.898761] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T19:10:33.257828] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-09-15T19:10:33.722606] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-15T19:10:34.057875] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-09-15T19:10:34.519275] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-15T19:10:34.832062] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-15T19:10:34.857819] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-09-15T19:10:35.524476] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-15T19:10:35.657897] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-09-15T19:10:36.457880] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-09-15T19:10:37.084833] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T19:10:37.257890] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-09-15T19:10:37.441923] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-15T19:10:38.057908] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-09-15T19:10:38.777380] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T19:10:38.857854] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-09-15T19:10:39.657877] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-09-15T19:10:39.746718] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-15T19:10:40.372506] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-15T19:10:40.457890] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-09-15T19:10:40.482105] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-15T19:10:41.257893] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-09-15T19:10:42.057937] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-09-15T19:10:42.147464] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-15T19:10:42.153275] [INFO ] [REMOTE ] KVYO: Full fetch complete (54067 records). [2025-09-15T19:10:42.153404] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-09-15T19:10:42.540435] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-09-15T19:10:42.540575] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-09-15T19:10:42.541461] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-09-15T19:10:42.541520] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-09-15T19:10:42.543342] [DEBUG] [LOCAL ] KVYO: Trimmed 54067 records to 37223 (keeping 150 days of data) [2025-09-15T19:10:42.672994] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T19:10:42.698125] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-15T19:10:42.828631] [DEBUG] [LOCAL ] KVYO: Primary data saved (37223 records). [2025-09-15T19:10:42.828804] [INFO ] [MAIN ] KVYO: Full history saved. [2025-09-15T19:10:42.828919] [INFO ] [MAIN ] Update Progress: 1232/2369 symbols completed. KVYO took 37.1s. Estimated remaining: 2h 0m 35s. Rate: 9.4 symbols/min [2025-09-15T19:10:42.863000] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-09-15T19:10:43.040990] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:10:43.083224] [DEBUG] [LOCAL ] LAC: Loaded 39364 existing records from primary storage. [2025-09-15T19:10:43.083450] [INFO ] [MAIN ] LAC: Loaded 39364 existing records. [2025-09-15T19:10:43.263531] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:10:43.263881] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-09-15T19:10:43.263942] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-09-15T19:10:43.264878] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-09-15T19:10:43.264961] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-09-15T19:10:43.650859] [INFO ] [REMOTE ] LAC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:10:43.657824] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-09-15T19:10:43.904217] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-15T19:10:44.457890] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-09-15T19:10:45.082192] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T19:10:45.084231] [INFO ] [REMOTE ] KWR: Full fetch complete (18438 records). [2025-09-15T19:10:45.084320] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-09-15T19:10:45.258274] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-09-15T19:10:45.453913] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-09-15T19:10:45.454057] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-09-15T19:10:45.454532] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-09-15T19:10:45.454595] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-09-15T19:10:45.455680] [DEBUG] [LOCAL ] KWR: Trimmed 18438 records to 12280 (keeping 150 days of data) [2025-09-15T19:10:45.547372] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-15T19:10:45.576250] [DEBUG] [LOCAL ] KWR: Primary data saved (12280 records). [2025-09-15T19:10:45.576412] [INFO ] [MAIN ] KWR: Full history saved. [2025-09-15T19:10:45.576537] [INFO ] [MAIN ] Update Progress: 1233/2369 symbols completed. KWR took 21.8s. Estimated remaining: 2h 0m 25s. Rate: 9.4 symbols/min [2025-09-15T19:10:45.750559] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:10:45.768036] [DEBUG] [LOCAL ] LAD: Loaded 17159 existing records from primary storage. [2025-09-15T19:10:45.768203] [INFO ] [MAIN ] LAD: Loaded 17159 existing records. [2025-09-15T19:10:45.951622] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:10:45.951910] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-09-15T19:10:45.951958] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-09-15T19:10:45.952582] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-09-15T19:10:45.952638] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-09-15T19:10:46.063008] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-09-15T19:10:46.325087] [INFO ] [REMOTE ] LAD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:10:46.652956] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-15T19:10:46.857901] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-09-15T19:10:47.657930] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-09-15T19:10:47.971746] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-15T19:10:48.014543] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-15T19:10:48.454854] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-15T19:10:48.459877] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-09-15T19:10:49.257918] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-09-15T19:10:49.782739] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-15T19:10:50.057891] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-09-15T19:10:50.680799] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-15T19:10:50.857863] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-09-15T19:10:50.907130] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-15T19:10:51.657960] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-09-15T19:10:52.457912] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-09-15T19:10:52.562811] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T19:10:52.612488] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-15T19:10:53.257950] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-09-15T19:10:53.681314] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-15T19:10:53.685368] [INFO ] [REMOTE ] KYN: Full fetch complete (33110 records). [2025-09-15T19:10:53.685486] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-09-15T19:10:54.061217] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-09-15T19:10:54.083289] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-09-15T19:10:54.083404] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-09-15T19:10:54.084773] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-09-15T19:10:54.084845] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-09-15T19:10:54.086003] [DEBUG] [LOCAL ] KYN: Trimmed 33110 records to 21836 (keeping 150 days of data) [2025-09-15T19:10:54.250663] [DEBUG] [LOCAL ] KYN: Primary data saved (21836 records). [2025-09-15T19:10:54.250849] [INFO ] [MAIN ] KYN: Full history saved. [2025-09-15T19:10:54.251027] [INFO ] [MAIN ] Update Progress: 1234/2369 symbols completed. KYN took 27.3s. Estimated remaining: 2h 0m 21s. Rate: 9.4 symbols/min [2025-09-15T19:10:54.456046] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:10:54.492936] [DEBUG] [LOCAL ] LADR: Loaded 28952 existing records from primary storage. [2025-09-15T19:10:54.493133] [INFO ] [MAIN ] LADR: Loaded 28952 existing records. [2025-09-15T19:10:54.671289] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:10:54.671544] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-09-15T19:10:54.671595] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-09-15T19:10:54.672286] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-09-15T19:10:54.672339] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-09-15T19:10:54.863271] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-09-15T19:10:55.044762] [INFO ] [REMOTE ] LADR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:10:55.119457] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-15T19:10:55.415717] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T19:10:55.420319] [INFO ] [REMOTE ] L: Full fetch complete (44511 records). [2025-09-15T19:10:55.420422] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-09-15T19:10:55.664619] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-09-15T19:10:55.800362] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-09-15T19:10:55.800467] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-09-15T19:10:55.801255] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-09-15T19:10:55.801302] [DEBUG] [LOCAL ] L: Saving primary data. [2025-09-15T19:10:55.802413] [DEBUG] [LOCAL ] L: Trimmed 44511 records to 30026 (keeping 150 days of data) [2025-09-15T19:10:55.999590] [DEBUG] [LOCAL ] L: Primary data saved (30026 records). [2025-09-15T19:10:55.999798] [INFO ] [MAIN ] L: Full history saved. [2025-09-15T19:10:55.999896] [INFO ] [MAIN ] Update Progress: 1235/2369 symbols completed. L took 25.1s. Estimated remaining: 2h 0m 10s. Rate: 9.4 symbols/min [2025-09-15T19:10:56.131491] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-15T19:10:56.203370] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:10:56.206886] [DEBUG] [LOCAL ] LANV: Loaded 1944 existing records from primary storage. [2025-09-15T19:10:56.206968] [INFO ] [MAIN ] LANV: Loaded 1944 existing records. [2025-09-15T19:10:56.391170] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:10:56.391455] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-09-15T19:10:56.391506] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-09-15T19:10:56.391746] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-09-15T19:10:56.391796] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-09-15T19:10:56.463048] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-09-15T19:10:56.820087] [INFO ] [REMOTE ] LANV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:10:56.880752] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-15T19:10:57.257964] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-09-15T19:10:57.609326] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-15T19:10:57.738175] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-15T19:10:58.057921] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-09-15T19:10:58.857884] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-09-15T19:10:59.325968] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-15T19:10:59.367615] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T19:10:59.657867] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-09-15T19:11:00.089018] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-15T19:11:00.457891] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-09-15T19:11:01.257881] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-09-15T19:11:01.607137] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-15T19:11:01.717684] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-15T19:11:02.057907] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-09-15T19:11:02.521544] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-15T19:11:02.857920] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-09-15T19:11:03.657892] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-09-15T19:11:04.457957] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-09-15T19:11:05.257949] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-09-15T19:11:05.685068] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (2.83 seconds). [2025-09-15T19:11:05.728059] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-15T19:11:06.057886] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-09-15T19:11:06.480103] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T19:11:06.586992] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-15T19:11:06.857878] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-09-15T19:11:06.968813] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-15T19:11:07.657838] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-09-15T19:11:07.769844] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-15T19:11:08.458023] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-09-15T19:11:08.651517] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T19:11:09.257905] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-09-15T19:11:10.057879] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-09-15T19:11:10.251222] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T19:11:10.253991] [INFO ] [REMOTE ] LAD: Full fetch complete (26563 records). [2025-09-15T19:11:10.254073] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-09-15T19:11:10.614556] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-15T19:11:10.618713] [INFO ] [REMOTE ] LANV: Full fetch complete (2812 records). [2025-09-15T19:11:10.625442] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-09-15T19:11:10.625556] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-09-15T19:11:10.625675] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-09-15T19:11:10.637290] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-09-15T19:11:10.661763] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-09-15T19:11:10.726902] [DEBUG] [LOCAL ] LAD: Trimmed 26563 records to 16862 (keeping 150 days of data) [2025-09-15T19:11:10.879407] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-09-15T19:11:11.116799] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-09-15T19:11:11.121754] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-09-15T19:11:11.122835] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-09-15T19:11:11.123864] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-09-15T19:11:11.129685] [DEBUG] [LOCAL ] LANV: Trimmed 2812 records to 1908 (keeping 150 days of data) [2025-09-15T19:11:11.129571] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-09-15T19:11:11.156147] [DEBUG] [LOCAL ] LANV: Primary data saved (1908 records). [2025-09-15T19:11:11.157850] [INFO ] [MAIN ] LANV: Full history saved. [2025-09-15T19:11:11.157957] [INFO ] [MAIN ] Update Progress: 1236/2369 symbols completed. LANV took 15.2s. Estimated remaining: 2h 0m 12s. Rate: 9.4 symbols/min [2025-09-15T19:11:11.264531] [DEBUG] [LOCAL ] LAD: Primary data saved (16862 records). [2025-09-15T19:11:11.264697] [INFO ] [MAIN ] LAD: Full history saved. [2025-09-15T19:11:11.265019] [INFO ] [MAIN ] Update Progress: 1237/2369 symbols completed. LAD took 25.7s. Estimated remaining: 2h 0m 0s. Rate: 9.4 symbols/min [2025-09-15T19:11:11.333879] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:11:11.365002] [DEBUG] [LOCAL ] LAR: Loaded 33941 existing records from primary storage. [2025-09-15T19:11:11.365165] [INFO ] [MAIN ] LAR: Loaded 33941 existing records. [2025-09-15T19:11:11.539477] [WARN ] [MAIN ] LAR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:11:11.539712] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-09-15T19:11:11.539759] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-15T19:11:11.540602] [DEBUG] [LOCAL ] LAR: Deleted primary data file. [2025-09-15T19:11:11.540677] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-09-15T19:11:11.663009] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-09-15T19:11:11.896377] [INFO ] [REMOTE ] LAR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:11:12.072358] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T19:11:12.457850] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-09-15T19:11:13.257895] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-09-15T19:11:13.844232] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-15T19:11:13.901859] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-15T19:11:14.057868] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-09-15T19:11:14.857926] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-09-15T19:11:14.943463] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-15T19:11:15.662933] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-09-15T19:11:15.679476] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T19:11:16.457831] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-09-15T19:11:16.616832] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-15T19:11:16.623088] [INFO ] [REMOTE ] LAC: Full fetch complete (56828 records). [2025-09-15T19:11:16.623200] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-09-15T19:11:17.013225] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-09-15T19:11:17.013366] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-09-15T19:11:17.014558] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-09-15T19:11:17.014746] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-09-15T19:11:17.016535] [DEBUG] [LOCAL ] LAC: Trimmed 56828 records to 38655 (keeping 150 days of data) [2025-09-15T19:11:17.040945] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-15T19:11:17.259502] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-09-15T19:11:17.288447] [DEBUG] [LOCAL ] LAC: Primary data saved (38655 records). [2025-09-15T19:11:17.288624] [INFO ] [MAIN ] LAC: Full history saved. [2025-09-15T19:11:17.288739] [INFO ] [MAIN ] Update Progress: 1238/2369 symbols completed. LAC took 34.5s. Estimated remaining: 1h 59m 53s. Rate: 9.4 symbols/min [2025-09-15T19:11:18.857379] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-15T19:11:18.866914] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-09-15T19:11:19.099250] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-15T19:11:19.106109] [INFO ] [REMOTE ] LADR: Full fetch complete (41408 records). [2025-09-15T19:11:19.106252] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-09-15T19:11:19.487246] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-09-15T19:11:19.487333] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-09-15T19:11:19.488072] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-09-15T19:11:19.488119] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-09-15T19:11:19.489205] [DEBUG] [LOCAL ] LADR: Trimmed 41408 records to 28214 (keeping 150 days of data) [2025-09-15T19:11:19.669096] [DEBUG] [LOCAL ] LADR: Primary data saved (28214 records). [2025-09-15T19:11:19.669246] [INFO ] [MAIN ] LADR: Full history saved. [2025-09-15T19:11:19.669334] [INFO ] [MAIN ] Update Progress: 1239/2369 symbols completed. LADR took 25.4s. Estimated remaining: 1h 59m 43s. Rate: 9.4 symbols/min [2025-09-15T19:11:20.150731] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-15T19:11:20.160252] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-09-15T19:11:21.491687] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-15T19:11:21.500865] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-09-15T19:11:23.261272] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-15T19:11:23.272043] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-09-15T19:11:25.052813] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-15T19:11:25.062891] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-09-15T19:11:26.428721] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-15T19:11:26.436419] [INFO ] [REMOTE ] LAR: Full fetch complete (48888 records). [2025-09-15T19:11:26.436589] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-09-15T19:11:26.852731] [DEBUG] [VALIDATOR ] LAR: All expected trading days are present. [2025-09-15T19:11:26.852852] [DEBUG] [VALIDATOR ] LAR: Primary data validation passed. [2025-09-15T19:11:26.853768] [INFO ] [MAIN ] LAR: Fetched primary data is valid. [2025-09-15T19:11:26.853822] [DEBUG] [LOCAL ] LAR: Saving primary data. [2025-09-15T19:11:26.855267] [DEBUG] [LOCAL ] LAR: Trimmed 48888 records to 33317 (keeping 150 days of data) [2025-09-15T19:11:27.054366] [DEBUG] [LOCAL ] LAR: Primary data saved (33317 records). [2025-09-15T19:11:27.054531] [INFO ] [MAIN ] LAR: Full history saved. [2025-09-15T19:11:27.054679] [INFO ] [MAIN ] Update Progress: 1240/2369 symbols completed. LAR took 15.9s. Estimated remaining: 1h 59m 38s. Rate: 9.4 symbols/min [2025-09-15T19:11:27.752826] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:11:27.743259] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:11:27.797204] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:11:27.855668] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:11:27.880801] [DEBUG] [LOCAL ] LAW: Loaded 10652 existing records from primary storage. [2025-09-15T19:11:27.881052] [INFO ] [MAIN ] LAW: Loaded 10652 existing records. [2025-09-15T19:11:28.087826] [DEBUG] [LOCAL ] LBRT: Loaded 39791 existing records from primary storage. [2025-09-15T19:11:28.086701] [DEBUG] [LOCAL ] LB: Loaded 27942 existing records from primary storage. [2025-09-15T19:11:28.117880] [INFO ] [MAIN ] LBRT: Loaded 39791 existing records. [2025-09-15T19:11:28.138786] [INFO ] [MAIN ] LB: Loaded 27942 existing records. [2025-09-15T19:11:28.139449] [DEBUG] [LOCAL ] LAZ: Loaded 33715 existing records from primary storage. [2025-09-15T19:11:28.144798] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:11:28.216579] [INFO ] [MAIN ] LAZ: Loaded 33715 existing records. [2025-09-15T19:11:28.315268] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-09-15T19:11:28.360616] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-09-15T19:11:28.465627] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-09-15T19:11:28.516609] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-09-15T19:11:28.593966] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:11:28.704484] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-09-15T19:11:28.742807] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:11:28.742938] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-09-15T19:11:28.799094] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:11:28.799178] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-09-15T19:11:28.812207] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-09-15T19:11:28.812326] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-09-15T19:11:28.812688] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-09-15T19:11:28.812452] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-09-15T19:11:28.863560] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-09-15T19:11:28.868806] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-09-15T19:11:28.818204] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-09-15T19:11:28.920427] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-09-15T19:11:28.999281] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-09-15T19:11:29.624520] [INFO ] [REMOTE ] LAW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:11:29.675889] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-09-15T19:11:30.061405] [INFO ] [REMOTE ] LB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:11:30.096873] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-09-15T19:11:30.110507] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:11:30.144433] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-09-15T19:11:30.166567] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:11:30.166859] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-09-15T19:11:30.693092] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-15T19:11:30.696768] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-09-15T19:11:31.353432] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-15T19:11:31.356498] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-09-15T19:11:31.701609] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-15T19:11:31.711875] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-09-15T19:11:31.755170] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-15T19:11:31.763766] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-09-15T19:11:31.824348] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-15T19:11:31.832190] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-09-15T19:11:31.885090] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-15T19:11:31.888329] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-09-15T19:11:32.467799] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-15T19:11:32.471345] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-09-15T19:11:33.112811] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T19:11:33.123308] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-09-15T19:11:33.333148] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T19:11:33.344803] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-09-15T19:11:33.355084] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-15T19:11:33.358987] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-09-15T19:11:33.484793] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-15T19:11:33.493579] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-09-15T19:11:34.202130] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-15T19:11:34.206297] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-09-15T19:11:34.573510] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-15T19:11:34.674808] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-15T19:11:34.772421] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-15T19:11:34.857828] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-09-15T19:11:35.006588] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-15T19:11:35.657934] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-09-15T19:11:36.462971] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-09-15T19:11:36.480611] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-15T19:11:37.195241] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-15T19:11:37.211752] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-15T19:11:37.213953] [INFO ] [REMOTE ] LAW: Full fetch complete (15453 records). [2025-09-15T19:11:37.214030] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-09-15T19:11:37.263121] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-09-15T19:11:37.610428] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-09-15T19:11:37.610519] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-09-15T19:11:37.610928] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-09-15T19:11:37.610975] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-09-15T19:11:37.611535] [DEBUG] [LOCAL ] LAW: Trimmed 15453 records to 10545 (keeping 150 days of data) [2025-09-15T19:11:37.671386] [DEBUG] [LOCAL ] LAW: Primary data saved (10545 records). [2025-09-15T19:11:37.671525] [INFO ] [MAIN ] LAW: Full history saved. [2025-09-15T19:11:37.671620] [INFO ] [MAIN ] Update Progress: 1241/2369 symbols completed. LAW took 10.6s. Estimated remaining: 1h 59m 36s. Rate: 9.4 symbols/min [2025-09-15T19:11:37.851525] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:11:37.892915] [DEBUG] [LOCAL ] LC: Loaded 35913 existing records from primary storage. [2025-09-15T19:11:37.893097] [INFO ] [MAIN ] LC: Loaded 35913 existing records. [2025-09-15T19:11:38.076102] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-09-15T19:11:38.082402] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:11:38.082677] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-09-15T19:11:38.082727] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-09-15T19:11:38.083534] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-09-15T19:11:38.083587] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-09-15T19:11:38.455510] [INFO ] [REMOTE ] LC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:11:38.784344] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-15T19:11:38.857827] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-09-15T19:11:39.663002] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-09-15T19:11:39.673366] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-15T19:11:40.224534] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-15T19:11:40.457912] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-09-15T19:11:40.881785] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-15T19:11:41.257872] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-09-15T19:11:42.057939] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-09-15T19:11:42.241627] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-15T19:11:42.384880] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-15T19:11:42.857865] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-09-15T19:11:43.239220] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-15T19:11:43.657949] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-09-15T19:11:44.381926] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-15T19:11:44.457878] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-09-15T19:11:45.176165] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T19:11:45.257852] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-09-15T19:11:45.620456] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-15T19:11:46.057922] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-09-15T19:11:46.857952] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-09-15T19:11:47.017392] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T19:11:47.280759] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-15T19:11:47.657892] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-09-15T19:11:48.118533] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T19:11:48.123941] [INFO ] [REMOTE ] LAZ: Full fetch complete (49466 records). [2025-09-15T19:11:48.124119] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-09-15T19:11:48.466039] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-09-15T19:11:48.506877] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-09-15T19:11:48.506965] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-09-15T19:11:48.507797] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-09-15T19:11:48.507844] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-09-15T19:11:48.509058] [DEBUG] [LOCAL ] LAZ: Trimmed 49466 records to 33117 (keeping 150 days of data) [2025-09-15T19:11:48.732550] [DEBUG] [LOCAL ] LAZ: Primary data saved (33117 records). [2025-09-15T19:11:48.732757] [INFO ] [MAIN ] LAZ: Full history saved. [2025-09-15T19:11:48.732861] [INFO ] [MAIN ] Update Progress: 1242/2369 symbols completed. LAZ took 21.7s. Estimated remaining: 1h 59m 33s. Rate: 9.4 symbols/min [2025-09-15T19:11:48.909236] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:11:48.921280] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T19:11:48.925707] [INFO ] [REMOTE ] LB: Full fetch complete (41542 records). [2025-09-15T19:11:48.925817] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-09-15T19:11:49.208244] [DEBUG] [LOCAL ] LCII: Loaded 20847 existing records from primary storage. [2025-09-15T19:11:49.246324] [INFO ] [MAIN ] LCII: Loaded 20847 existing records. [2025-09-15T19:11:49.264992] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-09-15T19:11:49.499878] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-09-15T19:11:49.510154] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-09-15T19:11:49.521327] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-09-15T19:11:49.534696] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-09-15T19:11:49.573675] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:11:49.574052] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-09-15T19:11:49.574260] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-09-15T19:11:49.574425] [DEBUG] [LOCAL ] LB: Trimmed 41542 records to 27501 (keeping 150 days of data) [2025-09-15T19:11:49.574865] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-09-15T19:11:49.574940] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-09-15T19:11:50.239013] [INFO ] [REMOTE ] LCII: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:11:50.242211] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-09-15T19:11:50.252058] [DEBUG] [LOCAL ] LB: Primary data saved (27501 records). [2025-09-15T19:11:50.252696] [INFO ] [MAIN ] LB: Full history saved. [2025-09-15T19:11:50.252872] [INFO ] [MAIN ] Update Progress: 1243/2369 symbols completed. LB took 23.2s. Estimated remaining: 1h 59m 23s. Rate: 9.4 symbols/min [2025-09-15T19:11:50.543087] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-15T19:11:50.594150] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:11:50.645582] [DEBUG] [LOCAL ] LDI: Loaded 32413 existing records from primary storage. [2025-09-15T19:11:50.645813] [INFO ] [MAIN ] LDI: Loaded 32413 existing records. [2025-09-15T19:11:50.816504] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T19:11:50.870277] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-09-15T19:11:50.982511] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:11:50.983044] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-09-15T19:11:50.983115] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-09-15T19:11:50.983915] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-09-15T19:11:50.983979] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-09-15T19:11:51.383887] [INFO ] [REMOTE ] LDI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:11:51.399545] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T19:11:51.657916] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-09-15T19:11:52.457989] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-09-15T19:11:52.603755] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-15T19:11:52.609924] [INFO ] [REMOTE ] LBRT: Full fetch complete (57544 records). [2025-09-15T19:11:52.610110] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-09-15T19:11:52.992366] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-09-15T19:11:52.992507] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-09-15T19:11:52.993589] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-09-15T19:11:52.993740] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-09-15T19:11:53.002116] [DEBUG] [LOCAL ] LBRT: Trimmed 57544 records to 39012 (keeping 150 days of data) [2025-09-15T19:11:53.016193] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T19:11:53.257995] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-09-15T19:11:53.271946] [DEBUG] [LOCAL ] LBRT: Primary data saved (39012 records). [2025-09-15T19:11:53.272126] [INFO ] [MAIN ] LBRT: Full history saved. [2025-09-15T19:11:53.274370] [INFO ] [MAIN ] Update Progress: 1244/2369 symbols completed. LBRT took 26.2s. Estimated remaining: 1h 59m 13s. Rate: 9.4 symbols/min [2025-09-15T19:11:53.457244] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:11:53.500729] [DEBUG] [LOCAL ] LDOS: Loaded 33900 existing records from primary storage. [2025-09-15T19:11:53.500913] [INFO ] [MAIN ] LDOS: Loaded 33900 existing records. [2025-09-15T19:11:53.684415] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:11:53.684771] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-09-15T19:11:53.684822] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-09-15T19:11:53.685724] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-09-15T19:11:53.685787] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-09-15T19:11:54.061053] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T19:11:54.086996] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:11:54.083507] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-09-15T19:11:54.722346] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T19:11:54.857886] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-09-15T19:11:55.223322] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-15T19:11:55.657881] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-09-15T19:11:56.411135] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T19:11:56.457880] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-09-15T19:11:57.260010] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-09-15T19:11:57.263371] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-15T19:11:57.995330] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-15T19:11:58.057835] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-09-15T19:11:58.724058] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-15T19:11:58.857889] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-09-15T19:11:59.343413] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-15T19:11:59.657901] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-09-15T19:11:59.904988] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-15T19:12:00.457919] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-09-15T19:12:01.257903] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-09-15T19:12:01.347849] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-15T19:12:01.728015] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-15T19:12:02.057875] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-09-15T19:12:02.535575] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T19:12:02.857874] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-09-15T19:12:03.657895] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-09-15T19:12:04.435762] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-15T19:12:04.457841] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-09-15T19:12:05.262982] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-09-15T19:12:05.264879] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-15T19:12:05.613609] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-15T19:12:05.747129] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T19:12:06.057920] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-09-15T19:12:06.857889] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-09-15T19:12:06.924562] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-15T19:12:06.930098] [INFO ] [REMOTE ] LC: Full fetch complete (52459 records). [2025-09-15T19:12:06.930241] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-09-15T19:12:07.309974] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-09-15T19:12:07.310062] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-09-15T19:12:07.310905] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-09-15T19:12:07.310963] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-09-15T19:12:07.312158] [DEBUG] [LOCAL ] LC: Trimmed 52459 records to 35229 (keeping 150 days of data) [2025-09-15T19:12:07.540570] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T19:12:07.548060] [INFO ] [REMOTE ] LDI: Full fetch complete (46235 records). [2025-09-15T19:12:07.548690] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-09-15T19:12:07.661906] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-09-15T19:12:07.687038] [DEBUG] [LOCAL ] LC: Primary data saved (35229 records). [2025-09-15T19:12:07.702522] [INFO ] [MAIN ] LC: Full history saved. [2025-09-15T19:12:07.754140] [INFO ] [MAIN ] Update Progress: 1245/2369 symbols completed. LC took 30.1s. Estimated remaining: 1h 59m 14s. Rate: 9.4 symbols/min [2025-09-15T19:12:08.061791] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-09-15T19:12:08.061895] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-09-15T19:12:08.078071] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-09-15T19:12:08.099284] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-09-15T19:12:08.124365] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:12:08.132734] [DEBUG] [LOCAL ] LDI: Trimmed 46235 records to 31881 (keeping 150 days of data) [2025-09-15T19:12:08.143722] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T19:12:08.241904] [DEBUG] [LOCAL ] LDP: Loaded 9487 existing records from primary storage. [2025-09-15T19:12:08.247659] [INFO ] [MAIN ] LDP: Loaded 9487 existing records. [2025-09-15T19:12:08.471868] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-09-15T19:12:08.511189] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:12:08.512655] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-09-15T19:12:08.513325] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-09-15T19:12:08.515078] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-09-15T19:12:08.515769] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-09-15T19:12:08.823326] [DEBUG] [LOCAL ] LDI: Primary data saved (31881 records). [2025-09-15T19:12:08.824208] [INFO ] [MAIN ] LDI: Full history saved. [2025-09-15T19:12:08.824433] [INFO ] [MAIN ] Update Progress: 1246/2369 symbols completed. LDI took 18.6s. Estimated remaining: 1h 59m 3s. Rate: 9.4 symbols/min [2025-09-15T19:12:09.009448] [INFO ] [REMOTE ] LDP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:12:09.079782] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:12:09.113120] [DEBUG] [LOCAL ] LEA: Loaded 30762 existing records from primary storage. [2025-09-15T19:12:09.113267] [INFO ] [MAIN ] LEA: Loaded 30762 existing records. [2025-09-15T19:12:09.263480] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-09-15T19:12:09.294283] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:12:09.294527] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-09-15T19:12:09.294616] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-09-15T19:12:09.295409] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-09-15T19:12:09.295460] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-09-15T19:12:09.660452] [INFO ] [REMOTE ] LEA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:12:09.672310] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-15T19:12:09.675830] [INFO ] [REMOTE ] LCII: Full fetch complete (31080 records). [2025-09-15T19:12:09.675947] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-09-15T19:12:09.868731] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-15T19:12:10.034225] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T19:12:10.066989] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-09-15T19:12:10.113094] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-09-15T19:12:10.113176] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-09-15T19:12:10.113809] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-09-15T19:12:10.113853] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-09-15T19:12:10.115137] [DEBUG] [LOCAL ] LCII: Trimmed 31080 records to 20124 (keeping 150 days of data) [2025-09-15T19:12:10.261013] [DEBUG] [LOCAL ] LCII: Primary data saved (20124 records). [2025-09-15T19:12:10.261153] [INFO ] [MAIN ] LCII: Full history saved. [2025-09-15T19:12:10.261247] [INFO ] [MAIN ] Update Progress: 1247/2369 symbols completed. LCII took 21.5s. Estimated remaining: 1h 58m 52s. Rate: 9.4 symbols/min [2025-09-15T19:12:10.435422] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:12:10.477144] [DEBUG] [LOCAL ] LEG: Loaded 37656 existing records from primary storage. [2025-09-15T19:12:10.477306] [INFO ] [MAIN ] LEG: Loaded 37656 existing records. [2025-09-15T19:12:10.654089] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:12:10.654353] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-09-15T19:12:10.654399] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-09-15T19:12:10.655160] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-09-15T19:12:10.655212] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-09-15T19:12:10.862932] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-09-15T19:12:11.010299] [INFO ] [REMOTE ] LEG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:12:11.019513] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-15T19:12:11.657880] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-09-15T19:12:12.457876] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-09-15T19:12:12.729472] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-15T19:12:12.913406] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-15T19:12:13.029746] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-15T19:12:13.257875] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-09-15T19:12:13.399197] [DEBUG] [REMOTE ] LEG: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-15T19:12:13.399538] [WARN ] [REMOTE ] LEG: No data returned for month 2025-02 [2025-09-15T19:12:14.057870] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-09-15T19:12:14.857892] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-09-15T19:12:15.657942] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-09-15T19:12:16.458963] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-09-15T19:12:16.461973] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-15T19:12:17.257934] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-09-15T19:12:17.468024] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-09-15T19:12:17.751462] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-15T19:12:17.923879] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-15T19:12:18.057863] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-09-15T19:12:18.855059] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-15T19:12:18.857931] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-09-15T19:12:19.037774] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-15T19:12:19.403164] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-15T19:12:19.657879] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-09-15T19:12:20.314072] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-15T19:12:20.457855] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-09-15T19:12:21.233616] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-15T19:12:21.235479] [INFO ] [REMOTE ] LDP: Full fetch complete (14172 records). [2025-09-15T19:12:21.235549] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-09-15T19:12:21.265116] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-09-15T19:12:21.592392] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-09-15T19:12:21.592469] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-09-15T19:12:21.592844] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-09-15T19:12:21.592889] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-09-15T19:12:21.593390] [DEBUG] [LOCAL ] LDP: Trimmed 14172 records to 9342 (keeping 150 days of data) [2025-09-15T19:12:21.655779] [DEBUG] [LOCAL ] LDP: Primary data saved (9342 records). [2025-09-15T19:12:21.655938] [INFO ] [MAIN ] LDP: Full history saved. [2025-09-15T19:12:21.656059] [INFO ] [MAIN ] Update Progress: 1248/2369 symbols completed. LDP took 13.8s. Estimated remaining: 1h 58m 50s. Rate: 9.4 symbols/min [2025-09-15T19:12:21.833923] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:12:21.878582] [DEBUG] [LOCAL ] LEN: Loaded 39992 existing records from primary storage. [2025-09-15T19:12:21.878790] [INFO ] [MAIN ] LEN: Loaded 39992 existing records. [2025-09-15T19:12:22.053954] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:12:22.054222] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-09-15T19:12:22.054282] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-09-15T19:12:22.055172] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-09-15T19:12:22.055226] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-09-15T19:12:22.066531] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-09-15T19:12:22.410380] [INFO ] [REMOTE ] LEN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:12:22.857844] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-09-15T19:12:22.960916] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T19:12:23.491490] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-15T19:12:23.657891] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-09-15T19:12:24.302299] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-15T19:12:24.457870] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-09-15T19:12:24.887401] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-15T19:12:25.257869] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-09-15T19:12:26.057888] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-09-15T19:12:26.347742] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-15T19:12:26.857889] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-09-15T19:12:26.958849] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-15T19:12:27.218529] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-15T19:12:27.657833] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-09-15T19:12:28.005245] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-15T19:12:28.457893] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-09-15T19:12:28.869530] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T19:12:29.257890] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-09-15T19:12:29.988944] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-15T19:12:30.057914] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-09-15T19:12:30.768789] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-15T19:12:30.857883] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-09-15T19:12:31.356591] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-15T19:12:31.362215] [INFO ] [REMOTE ] LDOS: Full fetch complete (50562 records). [2025-09-15T19:12:31.362395] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-09-15T19:12:31.658326] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-09-15T19:12:31.769865] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-09-15T19:12:31.770021] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-09-15T19:12:31.771863] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-09-15T19:12:31.771974] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-09-15T19:12:31.773743] [DEBUG] [LOCAL ] LDOS: Trimmed 50562 records to 33182 (keeping 150 days of data) [2025-09-15T19:12:32.011673] [DEBUG] [LOCAL ] LDOS: Primary data saved (33182 records). [2025-09-15T19:12:32.011837] [INFO ] [MAIN ] LDOS: Full history saved. [2025-09-15T19:12:32.011984] [INFO ] [MAIN ] Update Progress: 1249/2369 symbols completed. LDOS took 38.7s. Estimated remaining: 1h 58m 48s. Rate: 9.4 symbols/min [2025-09-15T19:12:32.182949] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:12:32.196471] [DEBUG] [LOCAL ] LEO: Loaded 12504 existing records from primary storage. [2025-09-15T19:12:32.196605] [INFO ] [MAIN ] LEO: Loaded 12504 existing records. [2025-09-15T19:12:32.398295] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:12:32.401246] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-09-15T19:12:32.401686] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-09-15T19:12:32.403217] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T19:12:32.403284] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-09-15T19:12:32.412173] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-09-15T19:12:32.459350] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-09-15T19:12:32.779187] [INFO ] [REMOTE ] LEO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:12:33.257897] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-09-15T19:12:33.554732] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-15T19:12:34.057864] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-09-15T19:12:34.086493] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-15T19:12:34.092543] [INFO ] [REMOTE ] LEG: Full fetch complete (49675 records). [2025-09-15T19:12:34.092747] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-09-15T19:12:34.286429] [WARN ] [VALIDATOR ] LEG: Validation failed - insufficient historical data. Have 136 unique days, need 150 days [2025-09-15T19:12:34.287439] [FATAL] [MAIN ] LEG: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:12:34.287571] [WARN ] [MAIN ] LEG: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:12:34.287794] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-09-15T19:12:34.287907] [DEBUG] [LOCAL ] LEG: No primary data file found to delete. [2025-09-15T19:12:34.287976] [INFO ] [LOCAL ] LEG: Starting deletion of derivative data. [2025-09-15T19:12:34.293505] [DEBUG] [LOCAL ] LEG: Deleted derivative data file. [2025-09-15T19:12:34.303772] [INFO ] [MAIN ] Update Progress: 1250/2369 symbols completed. LEG took 24.0s. Estimated remaining: 1h 58m 38s. Rate: 9.4 symbols/min [2025-09-15T19:12:34.349555] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-15T19:12:34.483071] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:12:34.529228] [DEBUG] [LOCAL ] LEVI: Loaded 38710 existing records from primary storage. [2025-09-15T19:12:34.529393] [INFO ] [MAIN ] LEVI: Loaded 38710 existing records. [2025-09-15T19:12:34.719939] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:12:34.720209] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-09-15T19:12:34.720258] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-09-15T19:12:34.721188] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-09-15T19:12:34.721241] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-09-15T19:12:34.863064] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-09-15T19:12:35.141045] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:12:35.657937] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-09-15T19:12:35.907302] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-15T19:12:36.089266] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T19:12:36.347758] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-15T19:12:36.457935] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-09-15T19:12:37.257882] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-09-15T19:12:37.586028] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-15T19:12:38.057877] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-09-15T19:12:38.857886] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-09-15T19:12:38.917847] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-15T19:12:39.509402] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-15T19:12:39.657868] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-09-15T19:12:40.240313] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-15T19:12:40.247714] [INFO ] [REMOTE ] LEA: Full fetch complete (45331 records). [2025-09-15T19:12:40.247897] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-09-15T19:12:40.463047] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-09-15T19:12:40.632599] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-09-15T19:12:40.632708] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-09-15T19:12:40.633544] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-09-15T19:12:40.633588] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-09-15T19:12:40.634743] [DEBUG] [LOCAL ] LEA: Trimmed 45331 records to 30256 (keeping 150 days of data) [2025-09-15T19:12:40.841197] [DEBUG] [LOCAL ] LEA: Primary data saved (30256 records). [2025-09-15T19:12:40.841356] [INFO ] [MAIN ] LEA: Full history saved. [2025-09-15T19:12:40.841445] [INFO ] [MAIN ] Update Progress: 1251/2369 symbols completed. LEA took 32.0s. Estimated remaining: 1h 58m 32s. Rate: 9.4 symbols/min [2025-09-15T19:12:41.016147] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:12:41.031930] [DEBUG] [LOCAL ] LFT: Loaded 14281 existing records from primary storage. [2025-09-15T19:12:41.032059] [INFO ] [MAIN ] LFT: Loaded 14281 existing records. [2025-09-15T19:12:41.214979] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-15T19:12:41.233801] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:12:41.238003] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-09-15T19:12:41.238074] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-09-15T19:12:41.238503] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-09-15T19:12:41.238548] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-09-15T19:12:41.269129] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-09-15T19:12:41.591573] [INFO ] [REMOTE ] LFT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:12:41.666584] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-15T19:12:42.057876] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-09-15T19:12:42.267783] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-15T19:12:42.857927] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-09-15T19:12:43.657907] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-09-15T19:12:43.685049] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-15T19:12:43.776766] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-15T19:12:44.207706] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-15T19:12:44.457900] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-09-15T19:12:45.257877] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-09-15T19:12:45.367042] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-15T19:12:46.057945] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-09-15T19:12:46.857864] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-09-15T19:12:46.947101] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-15T19:12:46.949233] [INFO ] [REMOTE ] LEO: Full fetch complete (19660 records). [2025-09-15T19:12:46.949305] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-09-15T19:12:47.354571] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-09-15T19:12:47.356536] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-15T19:12:47.354960] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-09-15T19:12:47.367562] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-09-15T19:12:47.368209] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-09-15T19:12:47.369210] [DEBUG] [LOCAL ] LEO: Trimmed 19660 records to 11897 (keeping 150 days of data) [2025-09-15T19:12:47.442870] [DEBUG] [LOCAL ] LEO: Primary data saved (11897 records). [2025-09-15T19:12:47.443034] [INFO ] [MAIN ] LEO: Full history saved. [2025-09-15T19:12:47.443123] [INFO ] [MAIN ] Update Progress: 1252/2369 symbols completed. LEO took 15.4s. Estimated remaining: 1h 58m 25s. Rate: 9.4 symbols/min [2025-09-15T19:12:47.615247] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:12:47.623897] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-15T19:12:47.633937] [DEBUG] [LOCAL ] LGI: Loaded 7499 existing records from primary storage. [2025-09-15T19:12:47.634028] [INFO ] [MAIN ] LGI: Loaded 7499 existing records. [2025-09-15T19:12:47.663034] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-09-15T19:12:47.812922] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:12:47.813159] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-09-15T19:12:47.813207] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-09-15T19:12:47.813551] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-09-15T19:12:47.813600] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-09-15T19:12:48.165802] [INFO ] [REMOTE ] LGI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:12:48.384196] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-15T19:12:48.457913] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-09-15T19:12:49.257895] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-09-15T19:12:49.486085] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-15T19:12:50.057912] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-09-15T19:12:50.634318] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-15T19:12:50.857889] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-09-15T19:12:51.234465] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-15T19:12:51.657919] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-09-15T19:12:52.340877] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T19:12:52.457922] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-09-15T19:12:52.866971] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T19:12:53.257896] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-09-15T19:12:53.773236] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-15T19:12:54.057887] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-09-15T19:12:54.416511] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-15T19:12:54.422487] [INFO ] [REMOTE ] LEN: Full fetch complete (57810 records). [2025-09-15T19:12:54.422629] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-09-15T19:12:54.804025] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-09-15T19:12:54.804144] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-09-15T19:12:54.805073] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-09-15T19:12:54.805121] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-09-15T19:12:54.806469] [DEBUG] [LOCAL ] LEN: Trimmed 57810 records to 39223 (keeping 150 days of data) [2025-09-15T19:12:54.869441] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-09-15T19:12:55.068863] [DEBUG] [LOCAL ] LEN: Primary data saved (39223 records). [2025-09-15T19:12:55.069032] [INFO ] [MAIN ] LEN: Full history saved. [2025-09-15T19:12:55.070108] [INFO ] [MAIN ] Update Progress: 1253/2369 symbols completed. LEN took 33.4s. Estimated remaining: 1h 58m 20s. Rate: 9.4 symbols/min [2025-09-15T19:12:55.244604] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:12:55.276284] [DEBUG] [LOCAL ] LH: Loaded 28629 existing records from primary storage. [2025-09-15T19:12:55.276548] [INFO ] [MAIN ] LH: Loaded 28629 existing records. [2025-09-15T19:12:55.420018] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-15T19:12:55.504457] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:12:55.504762] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-09-15T19:12:55.504831] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-09-15T19:12:55.511919] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-09-15T19:12:55.512461] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-09-15T19:12:55.545264] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-15T19:12:55.667631] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-09-15T19:12:55.886506] [INFO ] [REMOTE ] LH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:12:56.457946] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-09-15T19:12:57.257879] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-09-15T19:12:57.319389] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T19:12:57.670527] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T19:12:58.057837] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-09-15T19:12:58.407033] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-15T19:12:58.857873] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-09-15T19:12:59.407562] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-15T19:12:59.434255] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T19:12:59.657882] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-09-15T19:13:00.457887] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-09-15T19:13:01.257866] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-09-15T19:13:01.552542] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-15T19:13:01.716593] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T19:13:02.063837] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-09-15T19:13:02.068738] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-15T19:13:02.612948] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-15T19:13:02.857952] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-09-15T19:13:03.657899] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-09-15T19:13:04.363789] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-15T19:13:04.404433] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T19:13:04.457864] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-09-15T19:13:05.257921] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-09-15T19:13:05.551557] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-15T19:13:06.057872] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-09-15T19:13:06.561547] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-15T19:13:06.567561] [INFO ] [REMOTE ] LEVI: Full fetch complete (55930 records). [2025-09-15T19:13:06.567721] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-09-15T19:13:06.867520] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-09-15T19:13:06.969719] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-09-15T19:13:06.969886] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-09-15T19:13:06.970898] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-09-15T19:13:06.970959] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-09-15T19:13:06.972346] [DEBUG] [LOCAL ] LEVI: Trimmed 55930 records to 37969 (keeping 150 days of data) [2025-09-15T19:13:07.215279] [DEBUG] [LOCAL ] LEVI: Primary data saved (37969 records). [2025-09-15T19:13:07.215439] [INFO ] [MAIN ] LEVI: Full history saved. [2025-09-15T19:13:07.216143] [INFO ] [MAIN ] Update Progress: 1254/2369 symbols completed. LEVI took 32.9s. Estimated remaining: 1h 58m 19s. Rate: 9.4 symbols/min [2025-09-15T19:13:07.392511] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:13:07.434968] [DEBUG] [LOCAL ] LHX: Loaded 36949 existing records from primary storage. [2025-09-15T19:13:07.435139] [INFO ] [MAIN ] LHX: Loaded 36949 existing records. [2025-09-15T19:13:07.615477] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:13:07.615917] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-09-15T19:13:07.616079] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-09-15T19:13:07.628659] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-09-15T19:13:07.628576] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-15T19:13:07.628865] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-09-15T19:13:07.663510] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-09-15T19:13:08.005876] [INFO ] [REMOTE ] LHX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:13:08.044776] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-15T19:13:08.457863] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-09-15T19:13:08.510365] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-15T19:13:08.512288] [INFO ] [REMOTE ] LFT: Full fetch complete (18660 records). [2025-09-15T19:13:08.512361] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-09-15T19:13:08.887459] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-09-15T19:13:08.887696] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-09-15T19:13:08.888187] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-09-15T19:13:08.888237] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-09-15T19:13:08.888994] [DEBUG] [LOCAL ] LFT: Trimmed 18660 records to 13970 (keeping 150 days of data) [2025-09-15T19:13:08.972827] [DEBUG] [LOCAL ] LFT: Primary data saved (13970 records). [2025-09-15T19:13:08.972985] [INFO ] [MAIN ] LFT: Full history saved. [2025-09-15T19:13:08.973092] [INFO ] [MAIN ] Update Progress: 1255/2369 symbols completed. LFT took 28.1s. Estimated remaining: 1h 58m 8s. Rate: 9.4 symbols/min [2025-09-15T19:13:09.146368] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:13:09.165914] [DEBUG] [LOCAL ] LII: Loaded 20548 existing records from primary storage. [2025-09-15T19:13:09.166054] [INFO ] [MAIN ] LII: Loaded 20548 existing records. [2025-09-15T19:13:09.265731] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-09-15T19:13:09.348282] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:13:09.353210] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T19:13:09.353501] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-09-15T19:13:09.355272] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-09-15T19:13:09.355411] [INFO ] [REMOTE ] LGI: Full fetch complete (11049 records). [2025-09-15T19:13:09.355631] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-09-15T19:13:09.388746] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-09-15T19:13:09.420732] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-09-15T19:13:10.061924] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-09-15T19:13:10.110213] [INFO ] [REMOTE ] LII: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:13:10.111506] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-09-15T19:13:10.111563] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-09-15T19:13:10.111875] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-09-15T19:13:10.111921] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-09-15T19:13:10.112437] [DEBUG] [LOCAL ] LGI: Trimmed 11049 records to 7281 (keeping 150 days of data) [2025-09-15T19:13:10.158533] [DEBUG] [LOCAL ] LGI: Primary data saved (7281 records). [2025-09-15T19:13:10.158666] [INFO ] [MAIN ] LGI: Full history saved. [2025-09-15T19:13:10.158768] [INFO ] [MAIN ] Update Progress: 1256/2369 symbols completed. LGI took 22.7s. Estimated remaining: 1h 57m 57s. Rate: 9.4 symbols/min [2025-09-15T19:13:10.330929] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:13:10.368596] [DEBUG] [LOCAL ] LION: Loaded 35561 existing records from primary storage. [2025-09-15T19:13:10.368757] [INFO ] [MAIN ] LION: Loaded 35561 existing records. [2025-09-15T19:13:10.559930] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:13:10.560289] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-09-15T19:13:10.560345] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-09-15T19:13:10.561211] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-09-15T19:13:10.561450] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-09-15T19:13:10.859218] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-09-15T19:13:10.942617] [INFO ] [REMOTE ] LION: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:13:10.972538] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-15T19:13:11.291263] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-15T19:13:11.657873] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-09-15T19:13:12.268475] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T19:13:12.457893] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-09-15T19:13:12.955103] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-15T19:13:12.958857] [INFO ] [REMOTE ] LH: Full fetch complete (42264 records). [2025-09-15T19:13:12.959008] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-09-15T19:13:13.263031] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-09-15T19:13:13.336296] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-09-15T19:13:13.336383] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-09-15T19:13:13.337281] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-09-15T19:13:13.337356] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-09-15T19:13:13.338335] [DEBUG] [LOCAL ] LH: Trimmed 42264 records to 27924 (keeping 150 days of data) [2025-09-15T19:13:13.521251] [DEBUG] [LOCAL ] LH: Primary data saved (27924 records). [2025-09-15T19:13:13.521428] [INFO ] [MAIN ] LH: Full history saved. [2025-09-15T19:13:13.521544] [INFO ] [MAIN ] Update Progress: 1257/2369 symbols completed. LH took 18.5s. Estimated remaining: 1h 57m 48s. Rate: 9.4 symbols/min [2025-09-15T19:13:13.694702] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:13:13.699105] [DEBUG] [LOCAL ] LITB: Loaded 2497 existing records from primary storage. [2025-09-15T19:13:13.699264] [INFO ] [MAIN ] LITB: Loaded 2497 existing records. [2025-09-15T19:13:13.870987] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-15T19:13:13.906991] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:13:13.907601] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-09-15T19:13:13.907673] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-09-15T19:13:13.907921] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-09-15T19:13:13.907966] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-09-15T19:13:14.062960] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-09-15T19:13:14.286890] [INFO ] [REMOTE ] LITB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:13:14.306793] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-15T19:13:14.857880] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-09-15T19:13:15.311587] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-15T19:13:15.405314] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T19:13:15.657877] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-09-15T19:13:16.133455] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-15T19:13:16.457873] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-09-15T19:13:16.955747] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-15T19:13:17.257886] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-09-15T19:13:17.713895] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-15T19:13:18.057877] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-09-15T19:13:18.495488] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-15T19:13:18.857880] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-09-15T19:13:19.297009] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-15T19:13:19.657868] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-09-15T19:13:20.148738] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-15T19:13:20.457930] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-09-15T19:13:21.257879] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-09-15T19:13:22.057897] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-09-15T19:13:22.267893] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-15T19:13:22.340508] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-15T19:13:22.857865] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-09-15T19:13:22.954548] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T19:13:22.956185] [INFO ] [REMOTE ] LITB: Full fetch complete (4447 records). [2025-09-15T19:13:22.956260] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-09-15T19:13:23.308292] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-09-15T19:13:23.308385] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-09-15T19:13:23.308542] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-09-15T19:13:23.308583] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-09-15T19:13:23.308966] [DEBUG] [LOCAL ] LITB: Trimmed 4447 records to 2317 (keeping 150 days of data) [2025-09-15T19:13:23.322346] [DEBUG] [LOCAL ] LITB: Primary data saved (2317 records). [2025-09-15T19:13:23.322416] [INFO ] [MAIN ] LITB: Full history saved. [2025-09-15T19:13:23.322500] [INFO ] [MAIN ] Update Progress: 1258/2369 symbols completed. LITB took 9.8s. Estimated remaining: 1h 57m 45s. Rate: 9.4 symbols/min [2025-09-15T19:13:23.497783] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:13:23.541572] [DEBUG] [LOCAL ] LLY: Loaded 40112 existing records from primary storage. [2025-09-15T19:13:23.541778] [INFO ] [MAIN ] LLY: Loaded 40112 existing records. [2025-09-15T19:13:23.662949] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-09-15T19:13:23.733397] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:13:23.733677] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-09-15T19:13:23.733729] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-09-15T19:13:23.734782] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-09-15T19:13:23.734842] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-09-15T19:13:24.128384] [INFO ] [REMOTE ] LLY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:13:24.150145] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-15T19:13:24.457891] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-09-15T19:13:24.569750] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-15T19:13:25.257894] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-09-15T19:13:26.057903] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-09-15T19:13:26.298668] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-15T19:13:26.335741] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-15T19:13:26.857848] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-09-15T19:13:27.657922] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-09-15T19:13:27.973068] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-15T19:13:28.318743] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T19:13:28.457851] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-09-15T19:13:28.812924] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-15T19:13:29.257899] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-09-15T19:13:30.005589] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-15T19:13:30.057819] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-09-15T19:13:30.858111] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-09-15T19:13:30.864025] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T19:13:31.657906] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-09-15T19:13:31.704623] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T19:13:32.457900] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-09-15T19:13:33.019860] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-15T19:13:33.257874] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-09-15T19:13:33.350731] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-15T19:13:33.980262] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T19:13:34.057835] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-09-15T19:13:34.857892] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-09-15T19:13:35.442817] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-15T19:13:35.448309] [INFO ] [REMOTE ] LION: Full fetch complete (43869 records). [2025-09-15T19:13:35.448424] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-09-15T19:13:35.666121] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-09-15T19:13:35.800333] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-09-15T19:13:35.878106] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-09-15T19:13:35.878200] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-09-15T19:13:35.879163] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-09-15T19:13:35.879218] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-09-15T19:13:35.880396] [DEBUG] [LOCAL ] LION: Trimmed 43869 records to 35366 (keeping 150 days of data) [2025-09-15T19:13:36.087193] [DEBUG] [LOCAL ] LION: Primary data saved (35366 records). [2025-09-15T19:13:36.087357] [INFO ] [MAIN ] LION: Full history saved. [2025-09-15T19:13:36.087470] [INFO ] [MAIN ] Update Progress: 1259/2369 symbols completed. LION took 25.9s. Estimated remaining: 1h 57m 44s. Rate: 9.4 symbols/min [2025-09-15T19:13:36.265295] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:13:36.304364] [DEBUG] [LOCAL ] LMND: Loaded 39073 existing records from primary storage. [2025-09-15T19:13:36.304591] [INFO ] [MAIN ] LMND: Loaded 39073 existing records. [2025-09-15T19:13:36.459140] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-09-15T19:13:36.492083] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:13:36.492493] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-09-15T19:13:36.492548] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-09-15T19:13:36.493416] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-09-15T19:13:36.493476] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-09-15T19:13:36.822529] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-15T19:13:36.900237] [INFO ] [REMOTE ] LMND: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:13:36.922363] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-15T19:13:37.257897] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-09-15T19:13:38.057900] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-09-15T19:13:38.875433] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-09-15T19:13:38.894477] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T19:13:38.900354] [INFO ] [REMOTE ] LHX: Full fetch complete (53609 records). [2025-09-15T19:13:38.900510] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-09-15T19:13:39.285783] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-09-15T19:13:39.285939] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-09-15T19:13:39.287209] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-09-15T19:13:39.287295] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-09-15T19:13:39.289261] [DEBUG] [LOCAL ] LHX: Trimmed 53609 records to 36187 (keeping 150 days of data) [2025-09-15T19:13:39.428496] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.97 seconds). [2025-09-15T19:13:39.591807] [DEBUG] [LOCAL ] LHX: Primary data saved (36187 records). [2025-09-15T19:13:39.591961] [INFO ] [MAIN ] LHX: Full history saved. [2025-09-15T19:13:39.594034] [INFO ] [MAIN ] Update Progress: 1260/2369 symbols completed. LHX took 32.4s. Estimated remaining: 1h 57m 36s. Rate: 9.4 symbols/min [2025-09-15T19:13:39.658189] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-09-15T19:13:39.773703] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:13:39.802159] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-15T19:13:39.829388] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T19:13:39.869628] [DEBUG] [LOCAL ] LMT: Loaded 37406 existing records from primary storage. [2025-09-15T19:13:39.869845] [INFO ] [MAIN ] LMT: Loaded 37406 existing records. [2025-09-15T19:13:40.046332] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:13:40.046620] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-09-15T19:13:40.046689] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-09-15T19:13:40.047694] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-09-15T19:13:40.047748] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-09-15T19:13:40.402681] [INFO ] [REMOTE ] LMT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:13:40.457816] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-09-15T19:13:41.257912] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-09-15T19:13:41.770363] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-15T19:13:42.057939] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-09-15T19:13:42.298820] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T19:13:42.318770] [INFO ] [REMOTE ] LII: Full fetch complete (31496 records). [2025-09-15T19:13:42.331605] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-09-15T19:13:42.381003] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-15T19:13:42.725005] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-09-15T19:13:42.725126] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-09-15T19:13:42.725929] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-09-15T19:13:42.725974] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-09-15T19:13:42.726876] [DEBUG] [LOCAL ] LII: Trimmed 31496 records to 20183 (keeping 150 days of data) [2025-09-15T19:13:42.859250] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-09-15T19:13:42.861085] [DEBUG] [LOCAL ] LII: Primary data saved (20183 records). [2025-09-15T19:13:42.861257] [INFO ] [MAIN ] LII: Full history saved. [2025-09-15T19:13:42.861349] [INFO ] [MAIN ] Update Progress: 1261/2369 symbols completed. LII took 33.9s. Estimated remaining: 1h 57m 26s. Rate: 9.4 symbols/min [2025-09-15T19:13:43.046105] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:13:43.085282] [DEBUG] [LOCAL ] LNC: Loaded 38705 existing records from primary storage. [2025-09-15T19:13:43.085600] [INFO ] [MAIN ] LNC: Loaded 38705 existing records. [2025-09-15T19:13:43.271358] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:13:43.271818] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-09-15T19:13:43.271873] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-09-15T19:13:43.272736] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-09-15T19:13:43.272794] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-09-15T19:13:43.644612] [INFO ] [REMOTE ] LNC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:13:43.657845] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-09-15T19:13:44.465746] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-09-15T19:13:44.492148] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-15T19:13:44.565528] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-15T19:13:44.977072] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T19:13:45.257986] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-09-15T19:13:46.057860] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-09-15T19:13:46.111396] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-15T19:13:46.857875] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-09-15T19:13:47.266676] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-15T19:13:47.657909] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-09-15T19:13:48.427986] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-15T19:13:48.457854] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-09-15T19:13:48.545461] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-09-15T19:13:48.939995] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T19:13:49.257912] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-09-15T19:13:50.057887] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-09-15T19:13:50.360957] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-15T19:13:50.857878] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-09-15T19:13:51.102305] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-15T19:13:51.657918] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-09-15T19:13:52.309875] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-15T19:13:52.316904] [INFO ] [REMOTE ] LLY: Full fetch complete (57940 records). [2025-09-15T19:13:52.317142] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-09-15T19:13:52.462981] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-09-15T19:13:52.745953] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-09-15T19:13:52.746109] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-09-15T19:13:52.747065] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-09-15T19:13:52.747113] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-09-15T19:13:52.748492] [DEBUG] [LOCAL ] LLY: Trimmed 57940 records to 39337 (keeping 150 days of data) [2025-09-15T19:13:52.905192] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-15T19:13:53.077611] [DEBUG] [LOCAL ] LLY: Primary data saved (39337 records). [2025-09-15T19:13:53.077798] [INFO ] [MAIN ] LLY: Full history saved. [2025-09-15T19:13:53.079144] [INFO ] [MAIN ] Update Progress: 1262/2369 symbols completed. LLY took 29.8s. Estimated remaining: 1h 57m 24s. Rate: 9.4 symbols/min [2025-09-15T19:13:53.255946] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:13:53.257860] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-09-15T19:13:53.264534] [DEBUG] [LOCAL ] LND: Loaded 3677 existing records from primary storage. [2025-09-15T19:13:53.264750] [INFO ] [MAIN ] LND: Loaded 3677 existing records. [2025-09-15T19:13:53.449008] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:13:53.449413] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-09-15T19:13:53.449492] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-09-15T19:13:53.449764] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-09-15T19:13:53.449822] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-09-15T19:13:53.592582] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-15T19:13:53.886435] [INFO ] [REMOTE ] LND: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:13:54.057893] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-09-15T19:13:54.548225] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-15T19:13:54.578104] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-15T19:13:54.857923] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-09-15T19:13:55.386155] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-15T19:13:55.435921] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-15T19:13:55.658016] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-09-15T19:13:56.326630] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-15T19:13:56.457956] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-09-15T19:13:57.257995] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-09-15T19:13:57.787975] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-15T19:13:58.057905] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-09-15T19:13:58.734721] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-15T19:13:58.857915] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-09-15T19:13:59.658120] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-09-15T19:13:59.667968] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T19:14:00.116164] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-15T19:14:00.457907] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-09-15T19:14:00.789482] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-15T19:14:00.798775] [INFO ] [REMOTE ] LMND: Full fetch complete (56465 records). [2025-09-15T19:14:00.798964] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-09-15T19:14:01.210621] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-09-15T19:14:01.210754] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-09-15T19:14:01.212257] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-09-15T19:14:01.212320] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-09-15T19:14:01.214294] [DEBUG] [LOCAL ] LMND: Trimmed 56465 records to 38437 (keeping 150 days of data) [2025-09-15T19:14:01.267089] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-09-15T19:14:01.456953] [DEBUG] [LOCAL ] LMND: Primary data saved (38437 records). [2025-09-15T19:14:01.457131] [INFO ] [MAIN ] LMND: Full history saved. [2025-09-15T19:14:01.458116] [INFO ] [MAIN ] Update Progress: 1263/2369 symbols completed. LMND took 25.4s. Estimated remaining: 1h 57m 19s. Rate: 9.4 symbols/min [2025-09-15T19:14:01.628394] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:14:01.669729] [DEBUG] [LOCAL ] LNG: Loaded 38725 existing records from primary storage. [2025-09-15T19:14:01.669880] [INFO ] [MAIN ] LNG: Loaded 38725 existing records. [2025-09-15T19:14:01.844629] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:14:01.844922] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-09-15T19:14:01.844970] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-09-15T19:14:01.845843] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-09-15T19:14:01.845892] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-09-15T19:14:02.063084] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-09-15T19:14:02.209524] [INFO ] [REMOTE ] LNG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:14:02.554592] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-15T19:14:02.709034] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-15T19:14:02.857898] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-09-15T19:14:03.126912] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-15T19:14:03.657943] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-09-15T19:14:04.260328] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-15T19:14:04.457923] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-09-15T19:14:04.713024] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-15T19:14:05.257963] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-09-15T19:14:06.063765] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-09-15T19:14:06.083712] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-15T19:14:06.857898] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-09-15T19:14:06.976386] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-15T19:14:07.489636] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-15T19:14:07.657938] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-09-15T19:14:08.001828] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-15T19:14:08.457909] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-09-15T19:14:09.257940] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-09-15T19:14:09.463095] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-15T19:14:09.913411] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-15T19:14:09.920977] [INFO ] [REMOTE ] LND: Full fetch complete (5976 records). [2025-09-15T19:14:09.921275] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-09-15T19:14:10.065206] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-09-15T19:14:10.289662] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-09-15T19:14:10.289763] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-09-15T19:14:10.289964] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-09-15T19:14:10.290006] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-09-15T19:14:10.290410] [DEBUG] [LOCAL ] LND: Trimmed 5976 records to 3604 (keeping 150 days of data) [2025-09-15T19:14:10.311956] [DEBUG] [LOCAL ] LND: Primary data saved (3604 records). [2025-09-15T19:14:10.312071] [INFO ] [MAIN ] LND: Full history saved. [2025-09-15T19:14:10.312218] [INFO ] [MAIN ] Update Progress: 1264/2369 symbols completed. LND took 17.2s. Estimated remaining: 1h 57m 15s. Rate: 9.4 symbols/min [2025-09-15T19:14:10.483725] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:14:10.502047] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-15T19:14:10.508281] [INFO ] [REMOTE ] LMT: Full fetch complete (54570 records). [2025-09-15T19:14:10.510850] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-09-15T19:14:10.594469] [DEBUG] [LOCAL ] LNN: Loaded 8309 existing records from primary storage. [2025-09-15T19:14:10.605938] [INFO ] [MAIN ] LNN: Loaded 8309 existing records. [2025-09-15T19:14:10.869117] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-09-15T19:14:10.932018] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:14:10.945944] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-09-15T19:14:10.946028] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-09-15T19:14:10.995464] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-09-15T19:14:11.006701] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-09-15T19:14:11.212086] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-09-15T19:14:11.222366] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-09-15T19:14:11.245938] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-09-15T19:14:11.268520] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-09-15T19:14:11.372930] [DEBUG] [LOCAL ] LMT: Trimmed 54570 records to 36693 (keeping 150 days of data) [2025-09-15T19:14:11.546404] [INFO ] [REMOTE ] LNN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:14:11.659490] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-09-15T19:14:11.707898] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-15T19:14:11.731994] [DEBUG] [LOCAL ] LMT: Primary data saved (36693 records). [2025-09-15T19:14:11.732114] [INFO ] [MAIN ] LMT: Full history saved. [2025-09-15T19:14:11.732208] [INFO ] [MAIN ] Update Progress: 1265/2369 symbols completed. LMT took 32.1s. Estimated remaining: 1h 57m 4s. Rate: 9.4 symbols/min [2025-09-15T19:14:11.898300] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:14:11.932918] [DEBUG] [LOCAL ] LOAR: Loaded 32743 existing records from primary storage. [2025-09-15T19:14:11.933061] [INFO ] [MAIN ] LOAR: Loaded 32743 existing records. [2025-09-15T19:14:12.107119] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:14:12.107348] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-09-15T19:14:12.107400] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-09-15T19:14:12.108077] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-09-15T19:14:12.108126] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-09-15T19:14:12.373224] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-15T19:14:12.466246] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-09-15T19:14:12.470377] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:14:12.626341] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-15T19:14:12.632553] [INFO ] [REMOTE ] LNC: Full fetch complete (56127 records). [2025-09-15T19:14:12.632671] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-09-15T19:14:13.011083] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-09-15T19:14:13.011246] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-09-15T19:14:13.012116] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-09-15T19:14:13.012169] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-09-15T19:14:13.019218] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-15T19:14:13.022248] [DEBUG] [LOCAL ] LNC: Trimmed 56127 records to 37942 (keeping 150 days of data) [2025-09-15T19:14:13.261159] [DEBUG] [LOCAL ] LNC: Primary data saved (37942 records). [2025-09-15T19:14:13.261360] [INFO ] [MAIN ] LNC: Full history saved. [2025-09-15T19:14:13.261573] [INFO ] [MAIN ] Update Progress: 1266/2369 symbols completed. LNC took 30.4s. Estimated remaining: 1h 56m 53s. Rate: 9.4 symbols/min [2025-09-15T19:14:13.261423] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-09-15T19:14:13.433624] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:14:13.456930] [DEBUG] [LOCAL ] LOB: Loaded 19624 existing records from primary storage. [2025-09-15T19:14:13.457115] [INFO ] [MAIN ] LOB: Loaded 19624 existing records. [2025-09-15T19:14:13.634767] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:14:13.635022] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-09-15T19:14:13.635077] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-09-15T19:14:13.635602] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-09-15T19:14:13.635676] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-09-15T19:14:13.988496] [INFO ] [REMOTE ] LOB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:14:14.057830] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-09-15T19:14:14.633559] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T19:14:14.857863] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-09-15T19:14:15.160091] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-15T19:14:15.657872] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-09-15T19:14:16.231137] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-15T19:14:16.457868] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-09-15T19:14:16.669021] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-15T19:14:17.257883] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-09-15T19:14:18.057918] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-09-15T19:14:18.308719] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-15T19:14:18.573358] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-15T19:14:18.857873] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-09-15T19:14:19.657874] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-09-15T19:14:19.731658] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T19:14:20.463914] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-09-15T19:14:20.486039] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-15T19:14:20.662320] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-15T19:14:21.257874] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-09-15T19:14:21.634575] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-15T19:14:22.057884] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-09-15T19:14:22.857866] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-09-15T19:14:23.072373] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-15T19:14:23.144706] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-15T19:14:23.657861] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-09-15T19:14:23.679468] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-15T19:14:24.457898] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-09-15T19:14:24.761475] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-15T19:14:25.099212] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-15T19:14:25.257891] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-09-15T19:14:26.057922] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-09-15T19:14:26.803162] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-15T19:14:26.857833] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-09-15T19:14:27.657879] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-09-15T19:14:27.939443] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-15T19:14:27.945176] [INFO ] [REMOTE ] LNG: Full fetch complete (56278 records). [2025-09-15T19:14:27.945295] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-09-15T19:14:28.347964] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-15T19:14:28.347450] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-09-15T19:14:28.352700] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-09-15T19:14:28.353765] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-09-15T19:14:28.353875] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-09-15T19:14:28.361357] [INFO ] [REMOTE ] LOAR: Full fetch complete (44297 records). [2025-09-15T19:14:28.362185] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-09-15T19:14:28.364224] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-15T19:14:28.365114] [DEBUG] [LOCAL ] LNG: Trimmed 56278 records to 37954 (keeping 150 days of data) [2025-09-15T19:14:28.506557] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-09-15T19:14:28.873907] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-09-15T19:14:28.874624] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-09-15T19:14:28.875746] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-09-15T19:14:28.876431] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-09-15T19:14:28.880128] [DEBUG] [LOCAL ] LOAR: Trimmed 44297 records to 32217 (keeping 150 days of data) [2025-09-15T19:14:29.183854] [DEBUG] [LOCAL ] LOAR: Primary data saved (32217 records). [2025-09-15T19:14:29.186414] [INFO ] [MAIN ] LOAR: Full history saved. [2025-09-15T19:14:29.186933] [INFO ] [MAIN ] Update Progress: 1267/2369 symbols completed. LOAR took 17.5s. Estimated remaining: 1h 56m 55s. Rate: 9.4 symbols/min [2025-09-15T19:14:29.260101] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-09-15T19:14:29.384384] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:14:29.389019] [DEBUG] [LOCAL ] LNG: Primary data saved (37954 records). [2025-09-15T19:14:29.389197] [INFO ] [MAIN ] LNG: Full history saved. [2025-09-15T19:14:29.390365] [INFO ] [MAIN ] Update Progress: 1268/2369 symbols completed. LNG took 27.9s. Estimated remaining: 1h 56m 44s. Rate: 9.4 symbols/min [2025-09-15T19:14:29.484375] [DEBUG] [LOCAL ] LOCL: Loaded 2141 existing records from primary storage. [2025-09-15T19:14:29.497123] [INFO ] [MAIN ] LOCL: Loaded 2141 existing records. [2025-09-15T19:14:29.678954] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:14:29.773833] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:14:29.776121] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-09-15T19:14:29.775830] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-15T19:14:29.776390] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-09-15T19:14:29.786937] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-09-15T19:14:29.787064] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-09-15T19:14:29.900199] [DEBUG] [LOCAL ] LOMA: Loaded 23254 existing records from primary storage. [2025-09-15T19:14:29.906031] [INFO ] [MAIN ] LOMA: Loaded 23254 existing records. [2025-09-15T19:14:30.060410] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-09-15T19:14:30.280579] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:14:30.359874] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-09-15T19:14:30.360089] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-09-15T19:14:30.359772] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:14:30.414821] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-09-15T19:14:30.415336] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-09-15T19:14:30.415832] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-15T19:14:30.774257] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:14:30.857829] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-09-15T19:14:30.902872] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-15T19:14:31.657904] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-09-15T19:14:31.910143] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-15T19:14:32.457862] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-09-15T19:14:32.494831] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-15T19:14:33.251611] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-15T19:14:33.253353] [INFO ] [REMOTE ] LNN: Full fetch complete (11921 records). [2025-09-15T19:14:33.253426] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-09-15T19:14:33.264509] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-09-15T19:14:33.623787] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-09-15T19:14:33.623874] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-09-15T19:14:33.624151] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-09-15T19:14:33.624213] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-09-15T19:14:33.624734] [DEBUG] [LOCAL ] LNN: Trimmed 11921 records to 8087 (keeping 150 days of data) [2025-09-15T19:14:33.681542] [DEBUG] [LOCAL ] LNN: Primary data saved (8087 records). [2025-09-15T19:14:33.681714] [INFO ] [MAIN ] LNN: Full history saved. [2025-09-15T19:14:33.681817] [INFO ] [MAIN ] Update Progress: 1269/2369 symbols completed. LNN took 23.4s. Estimated remaining: 1h 56m 36s. Rate: 9.4 symbols/min [2025-09-15T19:14:33.860498] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:14:33.906108] [DEBUG] [LOCAL ] LOW: Loaded 39883 existing records from primary storage. [2025-09-15T19:14:33.906278] [INFO ] [MAIN ] LOW: Loaded 39883 existing records. [2025-09-15T19:14:34.067915] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-09-15T19:14:34.090075] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:14:34.090331] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-09-15T19:14:34.090389] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-09-15T19:14:34.091499] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-09-15T19:14:34.091551] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-09-15T19:14:34.459931] [INFO ] [REMOTE ] LOW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:14:34.462339] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-15T19:14:34.485224] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-15T19:14:34.857888] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-09-15T19:14:35.657899] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-09-15T19:14:36.074812] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-15T19:14:36.457886] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-09-15T19:14:36.595635] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-15T19:14:37.067046] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-15T19:14:37.257898] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-09-15T19:14:38.057922] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-09-15T19:14:38.547475] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-15T19:14:38.692789] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-15T19:14:38.857896] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-09-15T19:14:39.657893] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-09-15T19:14:40.076285] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-15T19:14:40.457868] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-09-15T19:14:40.509633] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T19:14:41.257907] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-09-15T19:14:41.551391] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-15T19:14:41.615918] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-15T19:14:42.057882] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-09-15T19:14:42.857901] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-09-15T19:14:43.662985] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-09-15T19:14:43.692904] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-15T19:14:43.876992] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T19:14:43.880220] [INFO ] [REMOTE ] LOB: Full fetch complete (29361 records). [2025-09-15T19:14:43.880296] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-09-15T19:14:44.169046] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-15T19:14:44.265332] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-09-15T19:14:44.265470] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-09-15T19:14:44.266368] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-09-15T19:14:44.266442] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-09-15T19:14:44.267729] [DEBUG] [LOCAL ] LOB: Trimmed 29361 records to 19142 (keeping 150 days of data) [2025-09-15T19:14:44.394735] [DEBUG] [LOCAL ] LOB: Primary data saved (19142 records). [2025-09-15T19:14:44.394898] [INFO ] [MAIN ] LOB: Full history saved. [2025-09-15T19:14:44.394987] [INFO ] [MAIN ] Update Progress: 1270/2369 symbols completed. LOB took 31.1s. Estimated remaining: 1h 56m 33s. Rate: 9.4 symbols/min [2025-09-15T19:14:44.463127] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-09-15T19:14:44.568082] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:14:44.598949] [DEBUG] [LOCAL ] LPG: Loaded 30148 existing records from primary storage. [2025-09-15T19:14:44.599108] [INFO ] [MAIN ] LPG: Loaded 30148 existing records. [2025-09-15T19:14:44.778849] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:14:44.779127] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-09-15T19:14:44.779177] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-09-15T19:14:44.780143] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-09-15T19:14:44.780193] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-09-15T19:14:45.157998] [INFO ] [REMOTE ] LPG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:14:45.162416] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T19:14:45.164193] [INFO ] [REMOTE ] LOCL: Full fetch complete (3312 records). [2025-09-15T19:14:45.164276] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-09-15T19:14:45.263218] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-09-15T19:14:45.551388] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-09-15T19:14:45.551497] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-09-15T19:14:45.551713] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-09-15T19:14:45.551773] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-09-15T19:14:45.552209] [DEBUG] [LOCAL ] LOCL: Trimmed 3312 records to 1941 (keeping 150 days of data) [2025-09-15T19:14:45.565122] [DEBUG] [LOCAL ] LOCL: Primary data saved (1941 records). [2025-09-15T19:14:45.565259] [INFO ] [MAIN ] LOCL: Full history saved. [2025-09-15T19:14:45.565369] [INFO ] [MAIN ] Update Progress: 1271/2369 symbols completed. LOCL took 16.4s. Estimated remaining: 1h 56m 22s. Rate: 9.4 symbols/min [2025-09-15T19:14:45.754982] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:14:45.776932] [DEBUG] [LOCAL ] LPL: Loaded 19157 existing records from primary storage. [2025-09-15T19:14:45.777128] [INFO ] [MAIN ] LPL: Loaded 19157 existing records. [2025-09-15T19:14:45.973590] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:14:45.973942] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-09-15T19:14:45.973996] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-09-15T19:14:45.974750] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-09-15T19:14:45.974812] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-09-15T19:14:46.062993] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-09-15T19:14:46.352762] [INFO ] [REMOTE ] LPL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:14:46.534194] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-15T19:14:46.857873] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-09-15T19:14:47.657982] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-09-15T19:14:47.936268] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-15T19:14:47.973544] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-15T19:14:48.458131] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-09-15T19:14:48.627026] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-15T19:14:49.257964] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-09-15T19:14:49.385915] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-15T19:14:50.057884] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-09-15T19:14:50.109930] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-15T19:14:50.857884] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-09-15T19:14:51.010023] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-15T19:14:51.657898] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-09-15T19:14:52.457885] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-09-15T19:14:52.788456] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-15T19:14:53.025041] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-15T19:14:53.257878] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-09-15T19:14:53.321885] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-15T19:14:54.057885] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-09-15T19:14:54.857972] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-09-15T19:14:55.181291] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-15T19:14:55.210341] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-15T19:14:55.657945] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-09-15T19:14:56.415529] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-15T19:14:56.464163] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-09-15T19:14:56.468137] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-15T19:14:57.257890] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-09-15T19:14:58.057881] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-09-15T19:14:58.295087] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-15T19:14:58.301267] [INFO ] [REMOTE ] LOW: Full fetch complete (57586 records). [2025-09-15T19:14:58.301502] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-09-15T19:14:58.714468] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T19:14:58.738261] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-09-15T19:14:58.738436] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-09-15T19:14:58.739391] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-09-15T19:14:58.739464] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-09-15T19:14:58.740988] [DEBUG] [LOCAL ] LOW: Trimmed 57586 records to 39109 (keeping 150 days of data) [2025-09-15T19:14:58.858030] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-09-15T19:14:58.875528] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-15T19:14:59.025479] [DEBUG] [LOCAL ] LOW: Primary data saved (39109 records). [2025-09-15T19:14:59.025704] [INFO ] [MAIN ] LOW: Full history saved. [2025-09-15T19:14:59.026388] [INFO ] [MAIN ] Update Progress: 1272/2369 symbols completed. LOW took 25.3s. Estimated remaining: 1h 56m 22s. Rate: 9.4 symbols/min [2025-09-15T19:14:59.205804] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:14:59.239119] [DEBUG] [LOCAL ] LPX: Loaded 29818 existing records from primary storage. [2025-09-15T19:14:59.239301] [INFO ] [MAIN ] LPX: Loaded 29818 existing records. [2025-09-15T19:14:59.425432] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:14:59.425745] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-09-15T19:14:59.425801] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-09-15T19:14:59.426475] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-09-15T19:14:59.426534] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-09-15T19:14:59.662954] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-09-15T19:14:59.795404] [INFO ] [REMOTE ] LPX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:15:00.270379] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-15T19:15:00.457871] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-09-15T19:15:00.629477] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-15T19:15:01.257910] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-09-15T19:15:01.985999] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-15T19:15:02.057874] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-09-15T19:15:02.857894] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-09-15T19:15:02.930343] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-15T19:15:03.657901] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-09-15T19:15:04.457882] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-09-15T19:15:05.141744] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (3.08 seconds). [2025-09-15T19:15:05.257837] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-09-15T19:15:05.436074] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-15T19:15:05.442918] [INFO ] [REMOTE ] LPL: Full fetch complete (26236 records). [2025-09-15T19:15:05.443086] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-09-15T19:15:05.826488] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-09-15T19:15:05.826591] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-09-15T19:15:05.827262] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-09-15T19:15:05.827310] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-09-15T19:15:05.828352] [DEBUG] [LOCAL ] LPL: Trimmed 26236 records to 19036 (keeping 150 days of data) [2025-09-15T19:15:05.940300] [DEBUG] [LOCAL ] LPL: Primary data saved (19036 records). [2025-09-15T19:15:05.940484] [INFO ] [MAIN ] LPL: Full history saved. [2025-09-15T19:15:05.940675] [INFO ] [MAIN ] Update Progress: 1273/2369 symbols completed. LPL took 20.4s. Estimated remaining: 1h 56m 16s. Rate: 9.4 symbols/min [2025-09-15T19:15:06.145693] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:15:06.148951] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-15T19:15:06.158110] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-09-15T19:15:06.191661] [DEBUG] [LOCAL ] LRN: Loaded 29698 existing records from primary storage. [2025-09-15T19:15:06.191812] [INFO ] [MAIN ] LRN: Loaded 29698 existing records. [2025-09-15T19:15:06.378008] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:15:06.390459] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-09-15T19:15:06.391040] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-09-15T19:15:06.391606] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (3.53 seconds). [2025-09-15T19:15:06.395873] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-09-15T19:15:06.396324] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-09-15T19:15:06.428880] [INFO ] [REMOTE ] LOMA: Full fetch complete (34170 records). [2025-09-15T19:15:06.479380] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-09-15T19:15:07.075468] [INFO ] [REMOTE ] LRN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:15:07.091697] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-09-15T19:15:07.162689] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-09-15T19:15:07.162903] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-09-15T19:15:07.163736] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-09-15T19:15:07.163832] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-09-15T19:15:07.184124] [DEBUG] [LOCAL ] LOMA: Trimmed 34170 records to 22980 (keeping 150 days of data) [2025-09-15T19:15:07.189434] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-15T19:15:07.335944] [DEBUG] [LOCAL ] LOMA: Primary data saved (22980 records). [2025-09-15T19:15:07.336091] [INFO ] [MAIN ] LOMA: Full history saved. [2025-09-15T19:15:07.336179] [INFO ] [MAIN ] Update Progress: 1274/2369 symbols completed. LOMA took 37.9s. Estimated remaining: 1h 56m 5s. Rate: 9.4 symbols/min [2025-09-15T19:15:07.523797] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:15:07.551550] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-15T19:15:07.586437] [DEBUG] [LOCAL ] LSPD: Loaded 31705 existing records from primary storage. [2025-09-15T19:15:07.586594] [INFO ] [MAIN ] LSPD: Loaded 31705 existing records. [2025-09-15T19:15:07.663024] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-09-15T19:15:07.764199] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:15:07.764438] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-09-15T19:15:07.764492] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-09-15T19:15:07.765087] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-09-15T19:15:07.765136] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-09-15T19:15:08.118631] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:15:08.313421] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-15T19:15:08.457892] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-09-15T19:15:08.710831] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-15T19:15:08.715392] [INFO ] [REMOTE ] LPG: Full fetch complete (44533 records). [2025-09-15T19:15:08.715484] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-09-15T19:15:09.145364] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-09-15T19:15:09.145601] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-09-15T19:15:09.146700] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-09-15T19:15:09.146752] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-09-15T19:15:09.148043] [DEBUG] [LOCAL ] LPG: Trimmed 44533 records to 29546 (keeping 150 days of data) [2025-09-15T19:15:09.257910] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-09-15T19:15:09.343188] [DEBUG] [LOCAL ] LPG: Primary data saved (29546 records). [2025-09-15T19:15:09.343362] [INFO ] [MAIN ] LPG: Full history saved. [2025-09-15T19:15:09.343463] [INFO ] [MAIN ] Update Progress: 1275/2369 symbols completed. LPG took 24.9s. Estimated remaining: 1h 55m 55s. Rate: 9.4 symbols/min [2025-09-15T19:15:09.512379] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:15:09.534269] [DEBUG] [LOCAL ] LTC: Loaded 22507 existing records from primary storage. [2025-09-15T19:15:09.534424] [INFO ] [MAIN ] LTC: Loaded 22507 existing records. [2025-09-15T19:15:09.710713] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:15:09.710986] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-09-15T19:15:09.711031] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-09-15T19:15:09.711779] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-09-15T19:15:09.711830] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-09-15T19:15:10.078286] [INFO ] [REMOTE ] LTC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:15:10.073922] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-09-15T19:15:10.104669] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T19:15:10.776225] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T19:15:10.857876] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-09-15T19:15:11.302033] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-15T19:15:11.657921] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-09-15T19:15:11.997329] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-15T19:15:12.457892] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-09-15T19:15:13.250041] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-15T19:15:13.259696] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-09-15T19:15:13.656278] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-15T19:15:14.057929] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-09-15T19:15:14.150770] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-15T19:15:14.857870] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-09-15T19:15:15.657834] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-09-15T19:15:16.177364] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-15T19:15:16.457929] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-09-15T19:15:17.079932] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-15T19:15:17.257943] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-09-15T19:15:17.688498] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-15T19:15:17.879427] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T19:15:18.057868] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-09-15T19:15:18.641229] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-15T19:15:18.857897] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-09-15T19:15:19.263131] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T19:15:19.657883] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-09-15T19:15:20.136123] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-15T19:15:20.457888] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-09-15T19:15:21.153745] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-15T19:15:21.257776] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-09-15T19:15:21.592139] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-15T19:15:22.057918] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-09-15T19:15:22.494292] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T19:15:22.857856] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-09-15T19:15:23.448921] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-15T19:15:23.453181] [INFO ] [REMOTE ] LRN: Full fetch complete (43318 records). [2025-09-15T19:15:23.453279] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-09-15T19:15:23.662981] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-09-15T19:15:23.835255] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-09-15T19:15:23.835375] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-09-15T19:15:23.836159] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-09-15T19:15:23.836279] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-09-15T19:15:23.853442] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-15T19:15:23.852815] [DEBUG] [LOCAL ] LRN: Trimmed 43318 records to 29198 (keeping 150 days of data) [2025-09-15T19:15:24.040986] [DEBUG] [LOCAL ] LRN: Primary data saved (29198 records). [2025-09-15T19:15:24.041137] [INFO ] [MAIN ] LRN: Full history saved. [2025-09-15T19:15:24.041225] [INFO ] [MAIN ] Update Progress: 1276/2369 symbols completed. LRN took 18.1s. Estimated remaining: 1h 55m 56s. Rate: 9.4 symbols/min [2025-09-15T19:15:24.216040] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:15:24.253223] [DEBUG] [LOCAL ] LTH: Loaded 38977 existing records from primary storage. [2025-09-15T19:15:24.253371] [INFO ] [MAIN ] LTH: Loaded 38977 existing records. [2025-09-15T19:15:24.427971] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:15:24.428246] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-09-15T19:15:24.428302] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-09-15T19:15:24.429192] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-09-15T19:15:24.429243] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-09-15T19:15:24.462966] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-09-15T19:15:24.792777] [INFO ] [REMOTE ] LTH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:15:25.267830] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-09-15T19:15:25.272958] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-15T19:15:25.775241] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-15T19:15:26.057885] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-09-15T19:15:26.857899] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-09-15T19:15:27.119832] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-15T19:15:27.421018] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-15T19:15:27.657887] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-09-15T19:15:28.296720] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-15T19:15:28.457875] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-09-15T19:15:29.008086] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T19:15:29.257947] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-09-15T19:15:29.767215] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-15T19:15:30.057881] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-09-15T19:15:30.577204] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T19:15:30.857932] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-09-15T19:15:31.425261] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-15T19:15:31.657878] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-09-15T19:15:32.120909] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T19:15:32.457905] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-09-15T19:15:33.257885] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-09-15T19:15:33.349128] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-15T19:15:33.704932] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-15T19:15:33.708344] [INFO ] [REMOTE ] LTC: Full fetch complete (32476 records). [2025-09-15T19:15:33.708448] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-09-15T19:15:34.063049] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-09-15T19:15:34.099622] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-09-15T19:15:34.099741] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-09-15T19:15:34.100442] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-09-15T19:15:34.100493] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-09-15T19:15:34.101302] [DEBUG] [LOCAL ] LTC: Trimmed 32476 records to 22112 (keeping 150 days of data) [2025-09-15T19:15:34.238630] [DEBUG] [LOCAL ] LTC: Primary data saved (22112 records). [2025-09-15T19:15:34.238790] [INFO ] [MAIN ] LTC: Full history saved. [2025-09-15T19:15:34.238895] [INFO ] [MAIN ] Update Progress: 1277/2369 symbols completed. LTC took 24.9s. Estimated remaining: 1h 55m 53s. Rate: 9.4 symbols/min [2025-09-15T19:15:34.329841] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-15T19:15:34.335789] [INFO ] [REMOTE ] LSPD: Full fetch complete (47963 records). [2025-09-15T19:15:34.335934] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-09-15T19:15:34.710255] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-09-15T19:15:34.710340] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-09-15T19:15:34.711145] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-09-15T19:15:34.711190] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-09-15T19:15:34.712180] [DEBUG] [LOCAL ] LSPD: Trimmed 47963 records to 30931 (keeping 150 days of data) [2025-09-15T19:15:34.861663] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-09-15T19:15:34.902428] [DEBUG] [LOCAL ] LSPD: Primary data saved (30931 records). [2025-09-15T19:15:34.902550] [INFO ] [MAIN ] LSPD: Full history saved. [2025-09-15T19:15:34.902631] [INFO ] [MAIN ] Update Progress: 1278/2369 symbols completed. LSPD took 27.6s. Estimated remaining: 1h 55m 42s. Rate: 9.4 symbols/min [2025-09-15T19:15:35.688933] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-15T19:15:35.699516] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-09-15T19:15:36.181196] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T19:15:36.185590] [INFO ] [REMOTE ] LPX: Full fetch complete (43579 records). [2025-09-15T19:15:36.185791] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-09-15T19:15:36.552765] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-09-15T19:15:36.552844] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-09-15T19:15:36.553594] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-09-15T19:15:36.553655] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-09-15T19:15:36.554591] [DEBUG] [LOCAL ] LPX: Trimmed 43579 records to 29378 (keeping 150 days of data) [2025-09-15T19:15:36.741713] [DEBUG] [LOCAL ] LPX: Primary data saved (29378 records). [2025-09-15T19:15:36.741862] [INFO ] [MAIN ] LPX: Full history saved. [2025-09-15T19:15:36.741967] [INFO ] [MAIN ] Update Progress: 1279/2369 symbols completed. LPX took 37.7s. Estimated remaining: 1h 55m 32s. Rate: 9.4 symbols/min [2025-09-15T19:15:37.124196] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-15T19:15:37.136165] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-09-15T19:15:38.460807] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T19:15:38.472370] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-09-15T19:15:40.015064] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-15T19:15:40.020741] [INFO ] [REMOTE ] LTH: Full fetch complete (56359 records). [2025-09-15T19:15:40.020873] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-09-15T19:15:40.411426] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-09-15T19:15:40.411546] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-09-15T19:15:40.412578] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-09-15T19:15:40.412629] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-09-15T19:15:40.414037] [DEBUG] [LOCAL ] LTH: Trimmed 56359 records to 38227 (keeping 150 days of data) [2025-09-15T19:15:40.647058] [DEBUG] [LOCAL ] LTH: Primary data saved (38227 records). [2025-09-15T19:15:40.647222] [INFO ] [MAIN ] LTH: Full history saved. [2025-09-15T19:15:40.648684] [INFO ] [MAIN ] Update Progress: 1280/2369 symbols completed. LTH took 16.6s. Estimated remaining: 1h 55m 23s. Rate: 9.4 symbols/min [2025-09-15T19:15:41.296856] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:15:41.322666] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:15:41.373307] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:15:41.405490] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:15:41.440101] [DEBUG] [LOCAL ] LUCK: Loaded 17981 existing records from primary storage. [2025-09-15T19:15:41.440266] [INFO ] [MAIN ] LUCK: Loaded 17981 existing records. [2025-09-15T19:15:41.581744] [DEBUG] [LOCAL ] LU: Loaded 36936 existing records from primary storage. [2025-09-15T19:15:41.582355] [INFO ] [MAIN ] LU: Loaded 36936 existing records. [2025-09-15T19:15:41.644834] [DEBUG] [LOCAL ] LTM: Loaded 28107 existing records from primary storage. [2025-09-15T19:15:41.690399] [INFO ] [MAIN ] LTM: Loaded 28107 existing records. [2025-09-15T19:15:41.708600] [DEBUG] [LOCAL ] LUMN: Loaded 40397 existing records from primary storage. [2025-09-15T19:15:41.775513] [WARN ] [MAIN ] LUCK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:15:41.833185] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-09-15T19:15:41.775666] [INFO ] [MAIN ] LUMN: Loaded 40397 existing records. [2025-09-15T19:15:41.838560] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-15T19:15:41.990686] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:15:41.990484] [DEBUG] [LOCAL ] LUCK: Deleted primary data file. [2025-09-15T19:15:42.016473] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-09-15T19:15:42.124025] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-09-15T19:15:42.186402] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-09-15T19:15:42.298389] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-09-15T19:15:42.354935] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-09-15T19:15:42.670841] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:15:42.758924] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-09-15T19:15:42.726394] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:15:42.778215] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-09-15T19:15:42.817764] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-09-15T19:15:42.811180] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-09-15T19:15:42.838139] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-09-15T19:15:42.848978] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-09-15T19:15:42.977902] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-09-15T19:15:43.059149] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-09-15T19:15:43.608612] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:15:43.674073] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-09-15T19:15:43.817585] [INFO ] [REMOTE ] LU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:15:43.876695] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-09-15T19:15:44.122472] [INFO ] [REMOTE ] LTM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:15:44.126196] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:15:44.126749] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-09-15T19:15:44.126516] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-09-15T19:15:44.961942] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-15T19:15:44.967473] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-09-15T19:15:45.277138] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T19:15:45.284535] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-09-15T19:15:45.505214] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-15T19:15:45.514855] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-09-15T19:15:45.601406] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-15T19:15:45.611374] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-09-15T19:15:45.839537] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-15T19:15:45.845897] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-09-15T19:15:46.183750] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T19:15:46.190102] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-09-15T19:15:46.698170] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-15T19:15:46.704691] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-09-15T19:15:46.923729] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-15T19:15:46.934044] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-09-15T19:15:46.975883] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T19:15:47.482768] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-15T19:15:47.500495] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-15T19:15:47.657835] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-09-15T19:15:48.297555] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-15T19:15:48.457852] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-09-15T19:15:49.101499] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T19:15:49.257912] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-09-15T19:15:50.057898] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-09-15T19:15:50.091332] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-15T19:15:50.118884] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T19:15:50.857889] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-09-15T19:15:51.459000] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T19:15:51.657933] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-09-15T19:15:52.458822] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-15T19:15:52.458896] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-09-15T19:15:52.919301] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T19:15:53.257929] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-09-15T19:15:54.057937] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-09-15T19:15:54.154583] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T19:15:54.528138] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-15T19:15:54.857953] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-09-15T19:15:55.385773] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-15T19:15:55.391078] [INFO ] [REMOTE ] LTM: Full fetch complete (37589 records). [2025-09-15T19:15:55.391170] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-09-15T19:15:55.662942] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-09-15T19:15:55.766538] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-09-15T19:15:55.766632] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-09-15T19:15:55.767455] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-09-15T19:15:55.767497] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-09-15T19:15:55.768432] [DEBUG] [LOCAL ] LTM: Trimmed 37589 records to 27982 (keeping 150 days of data) [2025-09-15T19:15:55.937476] [DEBUG] [LOCAL ] LTM: Primary data saved (27982 records). [2025-09-15T19:15:55.937654] [INFO ] [MAIN ] LTM: Full history saved. [2025-09-15T19:15:55.937756] [INFO ] [MAIN ] Update Progress: 1281/2369 symbols completed. LTM took 15.3s. Estimated remaining: 1h 55m 24s. Rate: 9.4 symbols/min [2025-09-15T19:15:56.122814] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:15:56.162098] [DEBUG] [LOCAL ] LUV: Loaded 40429 existing records from primary storage. [2025-09-15T19:15:56.162264] [INFO ] [MAIN ] LUV: Loaded 40429 existing records. [2025-09-15T19:15:56.340057] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:15:56.340327] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-09-15T19:15:56.340374] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-09-15T19:15:56.341298] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-09-15T19:15:56.341355] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-09-15T19:15:56.464118] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-09-15T19:15:56.713528] [INFO ] [REMOTE ] LUV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:15:56.740402] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-15T19:15:57.143397] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T19:15:57.257861] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-09-15T19:15:57.708823] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-15T19:15:58.057914] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-09-15T19:15:58.857921] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-09-15T19:15:59.327290] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-15T19:15:59.605522] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-15T19:15:59.612491] [INFO ] [REMOTE ] LU: Full fetch complete (53156 records). [2025-09-15T19:15:59.612614] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-09-15T19:15:59.666896] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-09-15T19:15:59.993906] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-09-15T19:15:59.994042] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-09-15T19:15:59.994952] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-09-15T19:15:59.995018] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-09-15T19:16:00.010881] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-15T19:16:00.016415] [DEBUG] [LOCAL ] LU: Trimmed 53156 records to 36227 (keeping 150 days of data) [2025-09-15T19:16:00.228068] [DEBUG] [LOCAL ] LU: Primary data saved (36227 records). [2025-09-15T19:16:00.228208] [INFO ] [MAIN ] LU: Full history saved. [2025-09-15T19:16:00.228294] [INFO ] [MAIN ] Update Progress: 1282/2369 symbols completed. LU took 19.6s. Estimated remaining: 1h 55m 16s. Rate: 9.4 symbols/min [2025-09-15T19:16:00.395071] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:16:00.395262] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-09-15T19:16:00.395302] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-09-15T19:16:00.395421] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-09-15T19:16:00.395460] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-15T19:16:00.395501] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-15T19:16:00.395535] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-09-15T19:16:00.463067] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-09-15T19:16:00.789728] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:16:01.258038] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-09-15T19:16:01.464780] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-15T19:16:01.937020] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T19:16:02.057898] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-09-15T19:16:02.459485] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-15T19:16:02.857906] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-09-15T19:16:03.111360] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-15T19:16:03.114442] [INFO ] [REMOTE ] LUCK: Full fetch complete (28886 records). [2025-09-15T19:16:03.114535] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-09-15T19:16:03.473531] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present. [2025-09-15T19:16:03.473612] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed. [2025-09-15T19:16:03.474325] [INFO ] [MAIN ] LUCK: Fetched primary data is valid. [2025-09-15T19:16:03.474373] [DEBUG] [LOCAL ] LUCK: Saving primary data. [2025-09-15T19:16:03.475130] [DEBUG] [LOCAL ] LUCK: Trimmed 28886 records to 17494 (keeping 150 days of data) [2025-09-15T19:16:03.593214] [DEBUG] [LOCAL ] LUCK: Primary data saved (17494 records). [2025-09-15T19:16:03.593448] [INFO ] [MAIN ] LUCK: Full history saved. [2025-09-15T19:16:03.593620] [INFO ] [MAIN ] Update Progress: 1283/2369 symbols completed. LUCK took 22.9s. Estimated remaining: 1h 55m 7s. Rate: 9.4 symbols/min [2025-09-15T19:16:03.663078] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-02. [2025-09-15T19:16:03.783938] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:16:03.827569] [DEBUG] [LOCAL ] LVS: Loaded 40317 existing records from primary storage. [2025-09-15T19:16:03.827772] [INFO ] [MAIN ] LVS: Loaded 40317 existing records. [2025-09-15T19:16:04.005415] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:16:04.005213] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:16:04.005854] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-02 [2025-09-15T19:16:04.006113] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-09-15T19:16:04.006744] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-09-15T19:16:04.007582] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-09-15T19:16:04.007632] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-09-15T19:16:04.368687] [INFO ] [REMOTE ] LVS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:16:04.457871] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-03. [2025-09-15T19:16:04.652845] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:16:04.653183] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-03 [2025-09-15T19:16:04.920475] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-15T19:16:05.257893] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-09-15T19:16:06.057892] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-09-15T19:16:06.857879] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-09-15T19:16:07.149786] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-15T19:16:07.657897] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-09-15T19:16:07.768634] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-15T19:16:08.354797] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-15T19:16:08.457883] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-09-15T19:16:09.257893] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-09-15T19:16:09.738791] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-15T19:16:10.057884] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-04. [2025-09-15T19:16:10.166455] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-15T19:16:10.172874] [INFO ] [REMOTE ] LUMN: Full fetch complete (58306 records). [2025-09-15T19:16:10.173017] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-09-15T19:16:10.253670] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:16:10.280211] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-04 [2025-09-15T19:16:10.564589] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-09-15T19:16:10.564726] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-09-15T19:16:10.565735] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-09-15T19:16:10.565784] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-09-15T19:16:10.567257] [DEBUG] [LOCAL ] LUMN: Trimmed 58306 records to 39620 (keeping 150 days of data) [2025-09-15T19:16:10.805214] [DEBUG] [LOCAL ] LUMN: Primary data saved (39620 records). [2025-09-15T19:16:10.805392] [INFO ] [MAIN ] LUMN: Full history saved. [2025-09-15T19:16:10.806370] [INFO ] [MAIN ] Update Progress: 1284/2369 symbols completed. LUMN took 30.2s. Estimated remaining: 1h 55m 2s. Rate: 9.4 symbols/min [2025-09-15T19:16:10.863924] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-05. [2025-09-15T19:16:10.991786] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:16:11.012285] [DEBUG] [LOCAL ] LVWR: Loaded 15617 existing records from primary storage. [2025-09-15T19:16:11.012424] [INFO ] [MAIN ] LVWR: Loaded 15617 existing records. [2025-09-15T19:16:11.199694] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:16:11.200027] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-09-15T19:16:11.200090] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-09-15T19:16:11.200697] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-09-15T19:16:11.200750] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-09-15T19:16:11.416460] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-15T19:16:11.616855] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:16:11.630681] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-15T19:16:11.657824] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-06. [2025-09-15T19:16:12.295908] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-15T19:16:12.457949] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-07. [2025-09-15T19:16:13.212416] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-15T19:16:13.257911] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-08. [2025-09-15T19:16:13.926700] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-15T19:16:14.057931] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-09. [2025-09-15T19:16:14.857913] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-09-15T19:16:15.026990] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-15T19:16:15.029803] [INFO ] [REMOTE ] LUXE: Full fetch complete (11662 records). [2025-09-15T19:16:15.029881] [DEBUG] [VALIDATOR ] LUXE: Validating primary data. [2025-09-15T19:16:15.224516] [WARN ] [VALIDATOR ] LUXE: Validation failed - insufficient historical data. Have 94 unique days, need 150 days [2025-09-15T19:16:15.224880] [FATAL] [MAIN ] LUXE: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:16:15.224935] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:16:15.225017] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-15T19:16:15.225115] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-15T19:16:15.225155] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-09-15T19:16:15.225225] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-09-15T19:16:15.225297] [INFO ] [MAIN ] Update Progress: 1285/2369 symbols completed. LUXE took 15.0s. Estimated remaining: 1h 54m 54s. Rate: 9.4 symbols/min [2025-09-15T19:16:15.413022] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:16:15.465323] [DEBUG] [LOCAL ] LW: Loaded 38350 existing records from primary storage. [2025-09-15T19:16:15.465577] [INFO ] [MAIN ] LW: Loaded 38350 existing records. [2025-09-15T19:16:15.647409] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:16:15.647773] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-09-15T19:16:15.647841] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-09-15T19:16:15.648963] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-09-15T19:16:15.649024] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-09-15T19:16:15.663090] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-09-15T19:16:16.010506] [INFO ] [REMOTE ] LW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:16:16.457867] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-09-15T19:16:16.734119] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-15T19:16:17.257910] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-09-15T19:16:17.339912] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-15T19:16:17.820129] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-15T19:16:17.867995] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T19:16:18.057870] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-09-15T19:16:18.524565] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-15T19:16:18.857873] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-09-15T19:16:19.657896] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-09-15T19:16:20.353295] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T19:16:20.457868] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-09-15T19:16:21.065356] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-15T19:16:21.257881] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-09-15T19:16:22.057874] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-09-15T19:16:22.249290] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-15T19:16:22.657008] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-15T19:16:22.657331] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-15T19:16:22.857873] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-09-15T19:16:23.657876] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-09-15T19:16:24.418887] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T19:16:24.457835] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-09-15T19:16:25.257936] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-09-15T19:16:25.540536] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-15T19:16:26.057861] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-09-15T19:16:26.136077] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-15T19:16:26.857890] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-09-15T19:16:26.899147] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T19:16:26.906616] [INFO ] [REMOTE ] LUV: Full fetch complete (58368 records). [2025-09-15T19:16:26.906793] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-09-15T19:16:27.285374] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-09-15T19:16:27.285457] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-09-15T19:16:27.286327] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-09-15T19:16:27.286388] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-09-15T19:16:27.287678] [DEBUG] [LOCAL ] LUV: Trimmed 58368 records to 39649 (keeping 150 days of data) [2025-09-15T19:16:27.549173] [DEBUG] [LOCAL ] LUV: Primary data saved (39649 records). [2025-09-15T19:16:27.549339] [INFO ] [MAIN ] LUV: Full history saved. [2025-09-15T19:16:27.549437] [INFO ] [MAIN ] Update Progress: 1286/2369 symbols completed. LUV took 31.6s. Estimated remaining: 1h 54m 52s. Rate: 9.4 symbols/min [2025-09-15T19:16:27.662964] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-09-15T19:16:27.732974] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:16:27.746659] [DEBUG] [LOCAL ] LXFR: Loaded 12577 existing records from primary storage. [2025-09-15T19:16:27.746773] [INFO ] [MAIN ] LXFR: Loaded 12577 existing records. [2025-09-15T19:16:27.926998] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-15T19:16:27.971558] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:16:27.972138] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-09-15T19:16:27.972470] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-09-15T19:16:27.972953] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-09-15T19:16:27.973013] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-09-15T19:16:28.328200] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:16:28.357583] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-15T19:16:28.457869] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-09-15T19:16:28.703400] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-15T19:16:29.140226] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-15T19:16:29.257932] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-09-15T19:16:30.057889] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-09-15T19:16:30.515636] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-15T19:16:30.854473] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-15T19:16:30.860169] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-09-15T19:16:31.657917] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-09-15T19:16:32.457871] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-09-15T19:16:32.831839] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-15T19:16:33.018337] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-15T19:16:33.024269] [INFO ] [REMOTE ] LVS: Full fetch complete (58244 records). [2025-09-15T19:16:33.024449] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-09-15T19:16:33.268047] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-09-15T19:16:33.405717] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-09-15T19:16:33.405822] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-09-15T19:16:33.406752] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-09-15T19:16:33.406800] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-09-15T19:16:33.408182] [DEBUG] [LOCAL ] LVS: Trimmed 58244 records to 39539 (keeping 150 days of data) [2025-09-15T19:16:33.659120] [DEBUG] [LOCAL ] LVS: Primary data saved (39539 records). [2025-09-15T19:16:33.659311] [INFO ] [MAIN ] LVS: Full history saved. [2025-09-15T19:16:33.660468] [INFO ] [MAIN ] Update Progress: 1287/2369 symbols completed. LVS took 30.1s. Estimated remaining: 1h 54m 46s. Rate: 9.4 symbols/min [2025-09-15T19:16:33.832220] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:16:33.872237] [DEBUG] [LOCAL ] LXP: Loaded 38192 existing records from primary storage. [2025-09-15T19:16:33.872383] [INFO ] [MAIN ] LXP: Loaded 38192 existing records. [2025-09-15T19:16:34.053246] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:16:34.053527] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-09-15T19:16:34.053912] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-09-15T19:16:34.054930] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-09-15T19:16:34.054994] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-09-15T19:16:34.085357] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-09-15T19:16:34.261348] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-15T19:16:34.440400] [INFO ] [REMOTE ] LXP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:16:34.452724] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-15T19:16:34.857913] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-09-15T19:16:35.668327] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-09-15T19:16:35.673901] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-15T19:16:35.699716] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-15T19:16:36.457943] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-09-15T19:16:36.731481] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-15T19:16:37.028124] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-15T19:16:37.257932] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-09-15T19:16:38.057979] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-09-15T19:16:38.108832] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-15T19:16:38.112788] [INFO ] [REMOTE ] LVWR: Full fetch complete (17178 records). [2025-09-15T19:16:38.112935] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-09-15T19:16:38.494860] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-09-15T19:16:38.494939] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-09-15T19:16:38.495323] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-09-15T19:16:38.495363] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-09-15T19:16:38.495956] [DEBUG] [LOCAL ] LVWR: Trimmed 17178 records to 15660 (keeping 150 days of data) [2025-09-15T19:16:38.590123] [DEBUG] [LOCAL ] LVWR: Primary data saved (15660 records). [2025-09-15T19:16:38.590278] [INFO ] [MAIN ] LVWR: Full history saved. [2025-09-15T19:16:38.590377] [INFO ] [MAIN ] Update Progress: 1288/2369 symbols completed. LVWR took 27.8s. Estimated remaining: 1h 54m 38s. Rate: 9.4 symbols/min [2025-09-15T19:16:38.760512] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:16:38.783502] [DEBUG] [LOCAL ] LXU: Loaded 24142 existing records from primary storage. [2025-09-15T19:16:38.783678] [INFO ] [MAIN ] LXU: Loaded 24142 existing records. [2025-09-15T19:16:38.863055] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-09-15T19:16:38.970542] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:16:38.971215] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-09-15T19:16:38.971305] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-09-15T19:16:38.971990] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-09-15T19:16:38.972044] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-09-15T19:16:39.344809] [INFO ] [REMOTE ] LXU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:16:39.347847] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-15T19:16:39.657945] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-09-15T19:16:40.472431] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-09-15T19:16:40.475518] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T19:16:40.718846] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-15T19:16:41.257912] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-09-15T19:16:42.065275] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-09-15T19:16:42.067493] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-15T19:16:42.230361] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-15T19:16:42.236008] [INFO ] [REMOTE ] LW: Full fetch complete (55909 records). [2025-09-15T19:16:42.236108] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-09-15T19:16:42.618478] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-09-15T19:16:42.618568] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-09-15T19:16:42.619436] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-09-15T19:16:42.619491] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-09-15T19:16:42.620689] [DEBUG] [LOCAL ] LW: Trimmed 55909 records to 37616 (keeping 150 days of data) [2025-09-15T19:16:42.855037] [DEBUG] [LOCAL ] LW: Primary data saved (37616 records). [2025-09-15T19:16:42.855189] [INFO ] [MAIN ] LW: Full history saved. [2025-09-15T19:16:42.856401] [INFO ] [MAIN ] Update Progress: 1289/2369 symbols completed. LW took 27.6s. Estimated remaining: 1h 54m 30s. Rate: 9.4 symbols/min [2025-09-15T19:16:42.867960] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-09-15T19:16:43.026804] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:16:43.067378] [DEBUG] [LOCAL ] LYB: Loaded 40365 existing records from primary storage. [2025-09-15T19:16:43.067518] [INFO ] [MAIN ] LYB: Loaded 40365 existing records. [2025-09-15T19:16:43.258112] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:16:43.258513] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-09-15T19:16:43.258570] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-09-15T19:16:43.259628] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-09-15T19:16:43.259746] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-09-15T19:16:43.641767] [INFO ] [REMOTE ] LYB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:16:43.669183] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-09-15T19:16:43.677272] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-15T19:16:43.802527] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-15T19:16:44.457878] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-09-15T19:16:45.140154] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T19:16:45.257835] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-09-15T19:16:45.312945] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-15T19:16:46.057872] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-09-15T19:16:46.472030] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-15T19:16:46.857881] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-09-15T19:16:47.579906] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T19:16:47.657900] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-09-15T19:16:48.441339] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T19:16:48.457821] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-09-15T19:16:49.257852] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-09-15T19:16:49.518665] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-15T19:16:49.587971] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-15T19:16:50.057882] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-09-15T19:16:50.244480] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-15T19:16:50.791105] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-15T19:16:50.793139] [INFO ] [REMOTE ] LXFR: Full fetch complete (18877 records). [2025-09-15T19:16:50.793215] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-09-15T19:16:50.863196] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-09-15T19:16:51.194839] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-09-15T19:16:51.194995] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-09-15T19:16:51.195811] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-09-15T19:16:51.195872] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-09-15T19:16:51.196761] [DEBUG] [LOCAL ] LXFR: Trimmed 18877 records to 12308 (keeping 150 days of data) [2025-09-15T19:16:51.274054] [DEBUG] [LOCAL ] LXFR: Primary data saved (12308 records). [2025-09-15T19:16:51.274230] [INFO ] [MAIN ] LXFR: Full history saved. [2025-09-15T19:16:51.274319] [INFO ] [MAIN ] Update Progress: 1290/2369 symbols completed. LXFR took 23.7s. Estimated remaining: 1h 54m 25s. Rate: 9.4 symbols/min [2025-09-15T19:16:51.440621] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:16:51.478761] [DEBUG] [LOCAL ] LYG: Loaded 39753 existing records from primary storage. [2025-09-15T19:16:51.478909] [INFO ] [MAIN ] LYG: Loaded 39753 existing records. [2025-09-15T19:16:51.652087] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:16:51.652371] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-09-15T19:16:51.652416] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-09-15T19:16:51.653323] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-09-15T19:16:51.653375] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-09-15T19:16:51.668534] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-09-15T19:16:52.008478] [INFO ] [REMOTE ] LYG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:16:52.457843] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-09-15T19:16:52.614670] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-15T19:16:53.056487] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-15T19:16:53.257823] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-09-15T19:16:53.745502] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-15T19:16:54.057902] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-09-15T19:16:54.468206] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T19:16:54.863976] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-09-15T19:16:54.881465] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-15T19:16:55.657928] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-09-15T19:16:56.457906] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-09-15T19:16:56.585209] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-15T19:16:56.713724] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-15T19:16:57.257933] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-09-15T19:16:57.528580] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-15T19:16:57.534192] [INFO ] [REMOTE ] LXP: Full fetch complete (54709 records). [2025-09-15T19:16:57.534294] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-09-15T19:16:57.907281] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-09-15T19:16:57.907374] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-09-15T19:16:57.908166] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-09-15T19:16:57.908215] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-09-15T19:16:57.909393] [DEBUG] [LOCAL ] LXP: Trimmed 54709 records to 37393 (keeping 150 days of data) [2025-09-15T19:16:58.072610] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-09-15T19:16:58.132972] [DEBUG] [LOCAL ] LXP: Primary data saved (37393 records). [2025-09-15T19:16:58.133089] [INFO ] [MAIN ] LXP: Full history saved. [2025-09-15T19:16:58.133574] [INFO ] [MAIN ] Update Progress: 1291/2369 symbols completed. LXP took 24.5s. Estimated remaining: 1h 54m 19s. Rate: 9.4 symbols/min [2025-09-15T19:16:58.301070] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:16:58.343407] [DEBUG] [LOCAL ] LYV: Loaded 38333 existing records from primary storage. [2025-09-15T19:16:58.343553] [INFO ] [MAIN ] LYV: Loaded 38333 existing records. [2025-09-15T19:16:58.517005] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:16:58.517250] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-09-15T19:16:58.517296] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-09-15T19:16:58.518173] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-09-15T19:16:58.518226] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-09-15T19:16:58.873915] [INFO ] [REMOTE ] LYV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:16:58.874096] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-09-15T19:16:58.908400] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-15T19:16:58.993811] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-15T19:16:59.657895] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-09-15T19:17:00.330070] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-15T19:17:00.457831] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-09-15T19:17:01.257950] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-09-15T19:17:01.364115] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-15T19:17:02.057882] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-09-15T19:17:02.389570] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-15T19:17:02.643114] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-15T19:17:02.857894] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-09-15T19:17:03.555606] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-15T19:17:03.657879] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-09-15T19:17:04.470203] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-09-15T19:17:04.499156] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-15T19:17:05.257871] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-09-15T19:17:05.329102] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-15T19:17:06.057907] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-09-15T19:17:06.343620] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-15T19:17:06.694347] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-15T19:17:06.700168] [INFO ] [REMOTE ] LYB: Full fetch complete (58191 records). [2025-09-15T19:17:06.700271] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-09-15T19:17:06.859744] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-09-15T19:17:07.116785] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-09-15T19:17:07.116917] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-09-15T19:17:07.118475] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-09-15T19:17:07.118560] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-09-15T19:17:07.120468] [DEBUG] [LOCAL ] LYB: Trimmed 58191 records to 39585 (keeping 150 days of data) [2025-09-15T19:17:07.392683] [DEBUG] [LOCAL ] LYB: Primary data saved (39585 records). [2025-09-15T19:17:07.392948] [INFO ] [MAIN ] LYB: Full history saved. [2025-09-15T19:17:07.394735] [INFO ] [MAIN ] Update Progress: 1292/2369 symbols completed. LYB took 24.5s. Estimated remaining: 1h 54m 16s. Rate: 9.4 symbols/min [2025-09-15T19:17:07.595038] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:17:07.628925] [DEBUG] [LOCAL ] LZB: Loaded 26397 existing records from primary storage. [2025-09-15T19:17:07.629115] [INFO ] [MAIN ] LZB: Loaded 26397 existing records. [2025-09-15T19:17:07.666427] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-09-15T19:17:07.815801] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:17:07.816223] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-09-15T19:17:07.816315] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-09-15T19:17:07.817221] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-09-15T19:17:07.817281] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-09-15T19:17:08.011266] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-15T19:17:08.219529] [INFO ] [REMOTE ] LZB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:17:08.397018] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-15T19:17:08.457875] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-09-15T19:17:08.616058] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T19:17:09.257922] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-09-15T19:17:10.057878] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-09-15T19:17:10.265797] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-15T19:17:10.399008] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-15T19:17:10.402253] [INFO ] [REMOTE ] LXU: Full fetch complete (34680 records). [2025-09-15T19:17:10.402362] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-09-15T19:17:10.773374] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-09-15T19:17:10.773465] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-09-15T19:17:10.774286] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-09-15T19:17:10.774363] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-09-15T19:17:10.775237] [DEBUG] [LOCAL ] LXU: Trimmed 34680 records to 23480 (keeping 150 days of data) [2025-09-15T19:17:10.860215] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-09-15T19:17:10.913587] [DEBUG] [LOCAL ] LXU: Primary data saved (23480 records). [2025-09-15T19:17:10.913738] [INFO ] [MAIN ] LXU: Full history saved. [2025-09-15T19:17:10.913869] [INFO ] [MAIN ] Update Progress: 1293/2369 symbols completed. LXU took 32.3s. Estimated remaining: 1h 54m 7s. Rate: 9.4 symbols/min [2025-09-15T19:17:11.085457] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:17:11.095913] [DEBUG] [LOCAL ] LZM: Loaded 9361 existing records from primary storage. [2025-09-15T19:17:11.096035] [INFO ] [MAIN ] LZM: Loaded 9361 existing records. [2025-09-15T19:17:11.278851] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:17:11.279094] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-09-15T19:17:11.279144] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-09-15T19:17:11.279448] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-09-15T19:17:11.279502] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-09-15T19:17:11.640935] [INFO ] [REMOTE ] LZM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:17:11.657817] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-09-15T19:17:11.708366] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-15T19:17:12.151826] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-15T19:17:12.178586] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T19:17:12.457873] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-09-15T19:17:13.257881] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-09-15T19:17:13.638953] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-15T19:17:14.057875] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-09-15T19:17:14.857858] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-09-15T19:17:14.969226] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-15T19:17:14.975183] [INFO ] [REMOTE ] LYG: Full fetch complete (57505 records). [2025-09-15T19:17:14.975304] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-09-15T19:17:15.361583] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-09-15T19:17:15.361769] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-09-15T19:17:15.362784] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-09-15T19:17:15.362873] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-09-15T19:17:15.384099] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-15T19:17:15.391572] [DEBUG] [LOCAL ] LYG: Trimmed 57505 records to 38981 (keeping 150 days of data) [2025-09-15T19:17:15.461176] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-15T19:17:15.647505] [DEBUG] [LOCAL ] LYG: Primary data saved (38981 records). [2025-09-15T19:17:15.647682] [INFO ] [MAIN ] LYG: Full history saved. [2025-09-15T19:17:15.647785] [INFO ] [MAIN ] Update Progress: 1294/2369 symbols completed. LYG took 24.4s. Estimated remaining: 1h 53m 59s. Rate: 9.4 symbols/min [2025-09-15T19:17:15.662921] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-09-15T19:17:15.822942] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:17:15.861764] [DEBUG] [LOCAL ] M: Loaded 40298 existing records from primary storage. [2025-09-15T19:17:15.861918] [INFO ] [MAIN ] M: Loaded 40298 existing records. [2025-09-15T19:17:16.043281] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:17:16.043594] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-09-15T19:17:16.043662] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-09-15T19:17:16.044493] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-09-15T19:17:16.044550] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-09-15T19:17:16.408309] [INFO ] [REMOTE ] M: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:17:16.457881] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-09-15T19:17:17.003780] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-15T19:17:17.257878] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-09-15T19:17:17.774239] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-15T19:17:18.057874] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-09-15T19:17:18.245893] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-15T19:17:18.857874] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-09-15T19:17:19.482468] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-15T19:17:19.526433] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-15T19:17:19.657867] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-09-15T19:17:20.457885] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-09-15T19:17:21.017807] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-15T19:17:21.023475] [INFO ] [REMOTE ] LYV: Full fetch complete (55908 records). [2025-09-15T19:17:21.023593] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-09-15T19:17:21.275258] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-09-15T19:17:21.339742] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-15T19:17:21.416942] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-09-15T19:17:21.417029] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-09-15T19:17:21.418050] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-09-15T19:17:21.418098] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-09-15T19:17:21.419369] [DEBUG] [LOCAL ] LYV: Trimmed 55908 records to 37576 (keeping 150 days of data) [2025-09-15T19:17:21.651102] [DEBUG] [LOCAL ] LYV: Primary data saved (37576 records). [2025-09-15T19:17:21.651270] [INFO ] [MAIN ] LYV: Full history saved. [2025-09-15T19:17:21.651812] [INFO ] [MAIN ] Update Progress: 1295/2369 symbols completed. LYV took 23.5s. Estimated remaining: 1h 53m 52s. Rate: 9.4 symbols/min [2025-09-15T19:17:21.820061] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:17:21.858462] [DEBUG] [LOCAL ] MA: Loaded 39448 existing records from primary storage. [2025-09-15T19:17:21.858608] [INFO ] [MAIN ] MA: Loaded 39448 existing records. [2025-09-15T19:17:22.031639] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:17:22.031909] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-09-15T19:17:22.031954] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-09-15T19:17:22.032876] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-09-15T19:17:22.032937] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-09-15T19:17:22.063236] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-09-15T19:17:22.392029] [INFO ] [REMOTE ] MA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:17:22.680576] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T19:17:22.857867] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-09-15T19:17:22.992273] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-15T19:17:23.657902] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-09-15T19:17:24.457897] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-09-15T19:17:24.496871] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T19:17:25.244739] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-15T19:17:25.257815] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-09-15T19:17:25.496696] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-15T19:17:25.768584] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-15T19:17:26.057886] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-09-15T19:17:26.857917] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-09-15T19:17:27.307301] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-15T19:17:27.494972] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-15T19:17:27.497339] [INFO ] [REMOTE ] LZM: Full fetch complete (14140 records). [2025-09-15T19:17:27.497411] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-09-15T19:17:27.668636] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-09-15T19:17:27.858351] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-09-15T19:17:27.858479] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-09-15T19:17:27.858863] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-09-15T19:17:27.858908] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-09-15T19:17:27.859673] [DEBUG] [LOCAL ] LZM: Trimmed 14140 records to 8818 (keeping 150 days of data) [2025-09-15T19:17:27.910125] [DEBUG] [LOCAL ] LZM: Primary data saved (8818 records). [2025-09-15T19:17:27.910265] [INFO ] [MAIN ] LZM: Full history saved. [2025-09-15T19:17:27.910363] [INFO ] [MAIN ] Update Progress: 1296/2369 symbols completed. LZM took 17.0s. Estimated remaining: 1h 53m 46s. Rate: 9.4 symbols/min [2025-09-15T19:17:28.078244] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:17:28.116488] [DEBUG] [LOCAL ] MAA: Loaded 32420 existing records from primary storage. [2025-09-15T19:17:28.116619] [INFO ] [MAIN ] MAA: Loaded 32420 existing records. [2025-09-15T19:17:28.294027] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:17:28.294341] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-09-15T19:17:28.294394] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-09-15T19:17:28.295144] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-09-15T19:17:28.295196] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-09-15T19:17:28.462734] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-09-15T19:17:28.675932] [INFO ] [REMOTE ] MAA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:17:29.104552] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-15T19:17:29.257899] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-09-15T19:17:30.057955] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-09-15T19:17:30.207041] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-15T19:17:30.605556] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T19:17:30.609849] [INFO ] [REMOTE ] LZB: Full fetch complete (38884 records). [2025-09-15T19:17:30.609938] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-09-15T19:17:30.866056] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-09-15T19:17:30.993373] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-09-15T19:17:30.993458] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-09-15T19:17:30.994311] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-09-15T19:17:30.994373] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-09-15T19:17:30.995338] [DEBUG] [LOCAL ] LZB: Trimmed 38884 records to 26036 (keeping 150 days of data) [2025-09-15T19:17:31.168987] [DEBUG] [LOCAL ] LZB: Primary data saved (26036 records). [2025-09-15T19:17:31.169135] [INFO ] [MAIN ] LZB: Full history saved. [2025-09-15T19:17:31.169234] [INFO ] [MAIN ] Update Progress: 1297/2369 symbols completed. LZB took 23.8s. Estimated remaining: 1h 53m 37s. Rate: 9.4 symbols/min [2025-09-15T19:17:31.339798] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:17:31.365056] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-15T19:17:31.407339] [DEBUG] [LOCAL ] MAC: Loaded 37163 existing records from primary storage. [2025-09-15T19:17:31.407496] [INFO ] [MAIN ] MAC: Loaded 37163 existing records. [2025-09-15T19:17:31.592550] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:17:31.592899] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-09-15T19:17:31.592948] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-09-15T19:17:31.593861] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-09-15T19:17:31.593921] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-09-15T19:17:31.666728] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-09-15T19:17:31.960394] [INFO ] [REMOTE ] MAC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:17:32.457893] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-09-15T19:17:32.715817] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-15T19:17:33.257945] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-09-15T19:17:33.585031] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-15T19:17:33.640760] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-15T19:17:34.057893] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-09-15T19:17:34.857928] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-09-15T19:17:34.969155] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-15T19:17:35.533993] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-15T19:17:35.657833] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-09-15T19:17:36.455684] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-15T19:17:36.466326] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-09-15T19:17:37.002692] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T19:17:37.257897] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-09-15T19:17:38.057900] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-09-15T19:17:38.210436] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-15T19:17:38.858755] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-09-15T19:17:38.866072] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-15T19:17:39.657834] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-09-15T19:17:39.747789] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-15T19:17:40.330551] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-15T19:17:40.457836] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-09-15T19:17:41.148180] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-15T19:17:41.257841] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-09-15T19:17:42.026681] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-15T19:17:42.057831] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-09-15T19:17:42.857886] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-09-15T19:17:43.103845] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-15T19:17:43.657883] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-09-15T19:17:43.690512] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-15T19:17:44.138698] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T19:17:44.457873] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-09-15T19:17:45.229214] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-15T19:17:45.235067] [INFO ] [REMOTE ] MA: Full fetch complete (57192 records). [2025-09-15T19:17:45.235236] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-09-15T19:17:45.266590] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-09-15T19:17:45.621330] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-09-15T19:17:45.621436] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-09-15T19:17:45.622459] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-09-15T19:17:45.622525] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-09-15T19:17:45.623982] [DEBUG] [LOCAL ] MA: Trimmed 57192 records to 38662 (keeping 150 days of data) [2025-09-15T19:17:45.772661] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-15T19:17:45.921254] [DEBUG] [LOCAL ] MA: Primary data saved (38662 records). [2025-09-15T19:17:45.921441] [INFO ] [MAIN ] MA: Full history saved. [2025-09-15T19:17:45.922062] [INFO ] [MAIN ] Update Progress: 1298/2369 symbols completed. MA took 24.3s. Estimated remaining: 1h 53m 38s. Rate: 9.4 symbols/min [2025-09-15T19:17:46.067064] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-09-15T19:17:46.091394] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:17:46.123401] [DEBUG] [LOCAL ] MAGN: Loaded 26412 existing records from primary storage. [2025-09-15T19:17:46.123556] [INFO ] [MAIN ] MAGN: Loaded 26412 existing records. [2025-09-15T19:17:46.304141] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:17:46.304389] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-09-15T19:17:46.304436] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-09-15T19:17:46.305023] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-09-15T19:17:46.305074] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-09-15T19:17:46.668816] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:17:46.726031] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T19:17:46.857850] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-09-15T19:17:47.659730] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-15T19:17:47.659843] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-09-15T19:17:48.099496] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-15T19:17:48.457943] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-09-15T19:17:49.064418] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-15T19:17:49.073096] [INFO ] [REMOTE ] M: Full fetch complete (58189 records). [2025-09-15T19:17:49.073275] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-09-15T19:17:49.269117] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-09-15T19:17:49.510872] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-09-15T19:17:49.510962] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-09-15T19:17:49.511898] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-09-15T19:17:49.511943] [DEBUG] [LOCAL ] M: Saving primary data. [2025-09-15T19:17:49.513236] [DEBUG] [LOCAL ] M: Trimmed 58189 records to 39519 (keeping 150 days of data) [2025-09-15T19:17:49.772500] [DEBUG] [LOCAL ] M: Primary data saved (39519 records). [2025-09-15T19:17:49.772774] [INFO ] [MAIN ] M: Full history saved. [2025-09-15T19:17:49.772885] [INFO ] [MAIN ] Update Progress: 1299/2369 symbols completed. M took 34.1s. Estimated remaining: 1h 53m 29s. Rate: 9.4 symbols/min [2025-09-15T19:17:49.945625] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-15T19:17:50.003130] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:17:50.040330] [DEBUG] [LOCAL ] MAIN: Loaded 30873 existing records from primary storage. [2025-09-15T19:17:50.040488] [INFO ] [MAIN ] MAIN: Loaded 30873 existing records. [2025-09-15T19:17:50.065236] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-09-15T19:17:50.226850] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:17:50.227097] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-09-15T19:17:50.227146] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-09-15T19:17:50.227901] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-09-15T19:17:50.227955] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-09-15T19:17:50.576787] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:17:50.857867] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-09-15T19:17:51.042414] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-15T19:17:51.376923] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-15T19:17:51.657893] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-09-15T19:17:52.198199] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-15T19:17:52.457882] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-09-15T19:17:53.192256] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-15T19:17:53.257885] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-09-15T19:17:53.495272] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T19:17:53.500557] [INFO ] [REMOTE ] MAA: Full fetch complete (46691 records). [2025-09-15T19:17:53.500754] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-09-15T19:17:53.913099] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-09-15T19:17:53.913226] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-09-15T19:17:53.914204] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-09-15T19:17:53.914254] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-09-15T19:17:53.915453] [DEBUG] [LOCAL ] MAA: Trimmed 46691 records to 31623 (keeping 150 days of data) [2025-09-15T19:17:54.083052] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-09-15T19:17:54.126817] [DEBUG] [LOCAL ] MAA: Primary data saved (31623 records). [2025-09-15T19:17:54.127005] [INFO ] [MAIN ] MAA: Full history saved. [2025-09-15T19:17:54.128028] [INFO ] [MAIN ] Update Progress: 1300/2369 symbols completed. MAA took 26.2s. Estimated remaining: 1h 53m 21s. Rate: 9.4 symbols/min [2025-09-15T19:17:54.308821] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:17:54.352507] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-15T19:17:54.371251] [DEBUG] [LOCAL ] MAN: Loaded 33038 existing records from primary storage. [2025-09-15T19:17:54.371398] [INFO ] [MAIN ] MAN: Loaded 33038 existing records. [2025-09-15T19:17:54.554477] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:17:54.554784] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-09-15T19:17:54.554840] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-09-15T19:17:54.555580] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-09-15T19:17:54.555631] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-09-15T19:17:54.863089] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-09-15T19:17:54.943612] [INFO ] [REMOTE ] MAN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:17:55.296275] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-15T19:17:55.657880] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-09-15T19:17:56.457918] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-09-15T19:17:56.601709] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-15T19:17:56.743930] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-15T19:17:57.257881] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-09-15T19:17:57.901217] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-15T19:17:58.057864] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-09-15T19:17:58.842343] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T19:17:58.857822] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-09-15T19:17:59.248456] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-15T19:17:59.657886] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-09-15T19:18:00.375821] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-15T19:18:00.457826] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-09-15T19:18:00.987167] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-15T19:18:01.257966] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-09-15T19:18:01.812310] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T19:18:02.057901] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-09-15T19:18:02.748716] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-15T19:18:02.857892] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-09-15T19:18:03.657910] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-09-15T19:18:03.744911] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-15T19:18:03.862576] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-15T19:18:04.457905] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-09-15T19:18:05.008423] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T19:18:05.257902] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-09-15T19:18:05.740474] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T19:18:06.057866] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-09-15T19:18:06.576263] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T19:18:06.857887] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-09-15T19:18:07.659425] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-09-15T19:18:07.663882] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-15T19:18:07.669023] [INFO ] [REMOTE ] MAIN: Full fetch complete (45036 records). [2025-09-15T19:18:07.669107] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-09-15T19:18:08.051815] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-09-15T19:18:08.051916] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-09-15T19:18:08.052712] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-09-15T19:18:08.052767] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-09-15T19:18:08.053826] [DEBUG] [LOCAL ] MAIN: Trimmed 45036 records to 30333 (keeping 150 days of data) [2025-09-15T19:18:08.244886] [DEBUG] [LOCAL ] MAIN: Primary data saved (30333 records). [2025-09-15T19:18:08.245030] [INFO ] [MAIN ] MAIN: Full history saved. [2025-09-15T19:18:08.245149] [INFO ] [MAIN ] Update Progress: 1301/2369 symbols completed. MAIN took 18.5s. Estimated remaining: 1h 53m 21s. Rate: 9.4 symbols/min [2025-09-15T19:18:08.416778] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:18:08.436548] [DEBUG] [LOCAL ] MANU: Loaded 19444 existing records from primary storage. [2025-09-15T19:18:08.436782] [INFO ] [MAIN ] MANU: Loaded 19444 existing records. [2025-09-15T19:18:08.467310] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-09-15T19:18:08.639365] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:18:08.650184] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-15T19:18:08.650571] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-09-15T19:18:08.650987] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-09-15T19:18:08.656236] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-15T19:18:08.659825] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-09-15T19:18:08.659913] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-09-15T19:18:08.681001] [INFO ] [REMOTE ] MAC: Full fetch complete (53938 records). [2025-09-15T19:18:08.723322] [INFO ] [REMOTE ] MAGN: Full fetch complete (38331 records). [2025-09-15T19:18:08.723235] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-09-15T19:18:08.745136] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-09-15T19:18:09.677009] [INFO ] [REMOTE ] MANU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:18:09.750921] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-09-15T19:18:09.781074] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-09-15T19:18:09.784263] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-09-15T19:18:09.784479] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-09-15T19:18:09.784528] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-09-15T19:18:09.785545] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-09-15T19:18:09.786138] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-09-15T19:18:09.786043] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-09-15T19:18:09.786619] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-09-15T19:18:09.788435] [DEBUG] [LOCAL ] MAGN: Trimmed 38331 records to 26043 (keeping 150 days of data) [2025-09-15T19:18:09.788546] [DEBUG] [LOCAL ] MAC: Trimmed 53938 records to 36424 (keeping 150 days of data) [2025-09-15T19:18:09.995833] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-15T19:18:10.059078] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-09-15T19:18:10.100397] [DEBUG] [LOCAL ] MAGN: Primary data saved (26043 records). [2025-09-15T19:18:10.102033] [INFO ] [MAIN ] MAGN: Full history saved. [2025-09-15T19:18:10.104194] [INFO ] [MAIN ] Update Progress: 1302/2369 symbols completed. MAGN took 24.2s. Estimated remaining: 1h 53m 11s. Rate: 9.4 symbols/min [2025-09-15T19:18:10.376137] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:18:10.400206] [DEBUG] [LOCAL ] MAC: Primary data saved (36424 records). [2025-09-15T19:18:10.400444] [INFO ] [MAIN ] MAC: Full history saved. [2025-09-15T19:18:10.401720] [INFO ] [MAIN ] Update Progress: 1303/2369 symbols completed. MAC took 39.2s. Estimated remaining: 1h 52m 60s. Rate: 9.4 symbols/min [2025-09-15T19:18:10.590484] [DEBUG] [LOCAL ] MAS: Loaded 39365 existing records from primary storage. [2025-09-15T19:18:10.610050] [INFO ] [MAIN ] MAS: Loaded 39365 existing records. [2025-09-15T19:18:10.609911] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:18:10.807534] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:18:10.807877] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-09-15T19:18:10.807930] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-09-15T19:18:10.808967] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-09-15T19:18:10.809026] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-09-15T19:18:10.918371] [DEBUG] [LOCAL ] MATV: Loaded 27232 existing records from primary storage. [2025-09-15T19:18:10.924048] [INFO ] [MAIN ] MATV: Loaded 27232 existing records. [2025-09-15T19:18:11.259853] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:18:11.277408] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-09-15T19:18:11.282724] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-09-15T19:18:11.303524] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-09-15T19:18:11.317242] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-09-15T19:18:11.414674] [INFO ] [REMOTE ] MAS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:18:11.468542] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-15T19:18:11.458976] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-09-15T19:18:11.662506] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-09-15T19:18:11.758850] [INFO ] [REMOTE ] MATV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:18:11.763391] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-15T19:18:12.457922] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-09-15T19:18:12.602031] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-15T19:18:12.774022] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-15T19:18:13.257875] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-09-15T19:18:13.664478] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T19:18:14.057887] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-09-15T19:18:14.104816] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-15T19:18:14.857892] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-09-15T19:18:15.642537] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-15T19:18:15.657824] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-09-15T19:18:16.133379] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T19:18:16.457879] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-09-15T19:18:17.124537] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-15T19:18:17.257871] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-09-15T19:18:17.859919] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-15T19:18:18.057867] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-09-15T19:18:18.506552] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-15T19:18:18.857828] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-09-15T19:18:19.248920] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-15T19:18:19.657926] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-09-15T19:18:20.463010] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-09-15T19:18:20.481391] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-15T19:18:20.543558] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-15T19:18:21.257883] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-09-15T19:18:21.744843] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-15T19:18:22.057877] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-09-15T19:18:22.748226] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-15T19:18:22.857876] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-09-15T19:18:23.345739] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-15T19:18:23.657956] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-09-15T19:18:23.777550] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-15T19:18:24.457889] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-09-15T19:18:25.116952] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T19:18:25.257834] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-09-15T19:18:25.638344] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-15T19:18:26.057922] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-09-15T19:18:26.857878] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-09-15T19:18:26.915719] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-15T19:18:27.077857] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-15T19:18:27.657883] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-09-15T19:18:28.048994] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-15T19:18:28.052837] [INFO ] [REMOTE ] MATV: Full fetch complete (41384 records). [2025-09-15T19:18:28.052958] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-09-15T19:18:28.421600] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-09-15T19:18:28.421696] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-09-15T19:18:28.422414] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-09-15T19:18:28.422454] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-09-15T19:18:28.423340] [DEBUG] [LOCAL ] MATV: Trimmed 41384 records to 26656 (keeping 150 days of data) [2025-09-15T19:18:28.476597] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-09-15T19:18:28.590285] [DEBUG] [LOCAL ] MATV: Primary data saved (26656 records). [2025-09-15T19:18:28.590418] [INFO ] [MAIN ] MATV: Full history saved. [2025-09-15T19:18:28.590504] [INFO ] [MAIN ] Update Progress: 1304/2369 symbols completed. MATV took 18.2s. Estimated remaining: 1h 53m 3s. Rate: 9.4 symbols/min [2025-09-15T19:18:28.761537] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:18:28.785586] [DEBUG] [LOCAL ] MATX: Loaded 24183 existing records from primary storage. [2025-09-15T19:18:28.785762] [INFO ] [MAIN ] MATX: Loaded 24183 existing records. [2025-09-15T19:18:28.961968] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:18:28.962217] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-09-15T19:18:28.962273] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-09-15T19:18:28.962855] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-09-15T19:18:28.962906] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-09-15T19:18:29.258416] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-09-15T19:18:29.327424] [INFO ] [REMOTE ] MATX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:18:29.342590] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-15T19:18:29.347856] [INFO ] [REMOTE ] MAN: Full fetch complete (47040 records). [2025-09-15T19:18:29.347954] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-09-15T19:18:29.743799] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-09-15T19:18:29.743992] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-09-15T19:18:29.745007] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-09-15T19:18:29.745230] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-09-15T19:18:29.756538] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-15T19:18:29.760704] [DEBUG] [LOCAL ] MAN: Trimmed 47040 records to 32327 (keeping 150 days of data) [2025-09-15T19:18:29.761136] [INFO ] [REMOTE ] MANU: Full fetch complete (29475 records). [2025-09-15T19:18:29.762165] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-09-15T19:18:30.098350] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-09-15T19:18:30.240679] [DEBUG] [LOCAL ] MAN: Primary data saved (32327 records). [2025-09-15T19:18:30.258392] [INFO ] [MAIN ] MAN: Full history saved. [2025-09-15T19:18:30.267378] [INFO ] [MAIN ] Update Progress: 1305/2369 symbols completed. MAN took 36.1s. Estimated remaining: 1h 52m 53s. Rate: 9.4 symbols/min [2025-09-15T19:18:30.494209] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-09-15T19:18:30.508730] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-09-15T19:18:30.518576] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-09-15T19:18:30.524065] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-09-15T19:18:30.544561] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:18:30.545732] [DEBUG] [LOCAL ] MANU: Trimmed 29475 records to 19151 (keeping 150 days of data) [2025-09-15T19:18:30.670678] [DEBUG] [LOCAL ] MANU: Primary data saved (19151 records). [2025-09-15T19:18:30.671023] [INFO ] [MAIN ] MANU: Full history saved. [2025-09-15T19:18:30.671395] [INFO ] [MAIN ] Update Progress: 1306/2369 symbols completed. MANU took 22.4s. Estimated remaining: 1h 52m 42s. Rate: 9.4 symbols/min [2025-09-15T19:18:30.802832] [DEBUG] [LOCAL ] MAX: Loaded 22509 existing records from primary storage. [2025-09-15T19:18:30.803543] [INFO ] [MAIN ] MAX: Loaded 22509 existing records. [2025-09-15T19:18:30.946507] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:18:31.065916] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:18:31.066297] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-09-15T19:18:31.066398] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-09-15T19:18:31.067025] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-09-15T19:18:31.083987] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-09-15T19:18:31.196141] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-15T19:18:31.286998] [DEBUG] [LOCAL ] MBC: Loaded 32070 existing records from primary storage. [2025-09-15T19:18:31.319778] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-09-15T19:18:31.344453] [INFO ] [MAIN ] MBC: Loaded 32070 existing records. [2025-09-15T19:18:31.647613] [INFO ] [REMOTE ] MAX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:18:31.711686] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:18:31.711541] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-09-15T19:18:31.712933] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-09-15T19:18:31.712992] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-09-15T19:18:31.719055] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-09-15T19:18:31.728672] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-09-15T19:18:31.735078] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-15T19:18:32.097853] [INFO ] [REMOTE ] MBC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:18:32.457900] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-09-15T19:18:32.768815] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-15T19:18:32.793497] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T19:18:32.799414] [INFO ] [REMOTE ] MAS: Full fetch complete (56781 records). [2025-09-15T19:18:32.799536] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-09-15T19:18:33.170858] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-09-15T19:18:33.170950] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-09-15T19:18:33.171868] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-09-15T19:18:33.171914] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-09-15T19:18:33.173141] [DEBUG] [LOCAL ] MAS: Trimmed 56781 records to 38615 (keeping 150 days of data) [2025-09-15T19:18:33.267011] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-09-15T19:18:33.418602] [DEBUG] [LOCAL ] MAS: Primary data saved (38615 records). [2025-09-15T19:18:33.418765] [INFO ] [MAIN ] MAS: Full history saved. [2025-09-15T19:18:33.419422] [INFO ] [MAIN ] Update Progress: 1307/2369 symbols completed. MAS took 23.3s. Estimated remaining: 1h 52m 32s. Rate: 9.4 symbols/min [2025-09-15T19:18:33.595238] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:18:33.614245] [DEBUG] [LOCAL ] MBI: Loaded 17956 existing records from primary storage. [2025-09-15T19:18:33.614384] [INFO ] [MAIN ] MBI: Loaded 17956 existing records. [2025-09-15T19:18:33.793079] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:18:33.793481] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-09-15T19:18:33.793542] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-09-15T19:18:33.794146] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-09-15T19:18:33.794266] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-09-15T19:18:33.910355] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-15T19:18:34.065489] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-09-15T19:18:34.174664] [INFO ] [REMOTE ] MBI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:18:34.203044] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-15T19:18:34.857937] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-09-15T19:18:35.419373] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T19:18:35.657852] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-09-15T19:18:36.206434] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-15T19:18:36.457900] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-09-15T19:18:36.729669] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T19:18:37.257889] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-09-15T19:18:37.322133] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T19:18:38.057903] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-09-15T19:18:38.482563] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-15T19:18:38.857893] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-09-15T19:18:39.151821] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-15T19:18:39.657873] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-09-15T19:18:40.023667] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-15T19:18:40.457904] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-09-15T19:18:40.766763] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-15T19:18:41.257947] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-09-15T19:18:41.461639] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-15T19:18:42.057882] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-09-15T19:18:42.712627] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-15T19:18:42.857868] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-09-15T19:18:43.446181] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-15T19:18:43.657831] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-09-15T19:18:43.689859] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-15T19:18:44.457900] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-09-15T19:18:44.773961] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-15T19:18:45.219467] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-15T19:18:45.257882] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-09-15T19:18:46.057931] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-09-15T19:18:46.716134] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-15T19:18:46.857834] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-09-15T19:18:47.069951] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T19:18:47.657883] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-09-15T19:18:48.394522] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-15T19:18:48.457839] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-09-15T19:18:48.521954] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-15T19:18:49.257879] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-09-15T19:18:49.913993] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-15T19:18:49.919092] [INFO ] [REMOTE ] MBC: Full fetch complete (46820 records). [2025-09-15T19:18:49.919218] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-09-15T19:18:50.063064] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-09-15T19:18:50.300462] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-09-15T19:18:50.300549] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-09-15T19:18:50.301357] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-09-15T19:18:50.301409] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-09-15T19:18:50.302447] [DEBUG] [LOCAL ] MBC: Trimmed 46820 records to 31444 (keeping 150 days of data) [2025-09-15T19:18:50.502529] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-15T19:18:50.522312] [DEBUG] [LOCAL ] MBC: Primary data saved (31444 records). [2025-09-15T19:18:50.522471] [INFO ] [MAIN ] MBC: Full history saved. [2025-09-15T19:18:50.522559] [INFO ] [MAIN ] Update Progress: 1308/2369 symbols completed. MBC took 19.8s. Estimated remaining: 1h 52m 35s. Rate: 9.4 symbols/min [2025-09-15T19:18:50.697624] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:18:50.732955] [DEBUG] [LOCAL ] MC: Loaded 33022 existing records from primary storage. [2025-09-15T19:18:50.733159] [INFO ] [MAIN ] MC: Loaded 33022 existing records. [2025-09-15T19:18:50.863108] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-09-15T19:18:50.918154] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:18:50.918449] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-09-15T19:18:50.918498] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-09-15T19:18:50.919838] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-09-15T19:18:50.920243] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-09-15T19:18:51.301190] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-15T19:18:51.322362] [INFO ] [REMOTE ] MAX: Full fetch complete (33939 records). [2025-09-15T19:18:51.327950] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-09-15T19:18:51.327819] [INFO ] [REMOTE ] MC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:18:51.663090] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-09-15T19:18:51.706681] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-09-15T19:18:51.706766] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-09-15T19:18:51.707494] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-09-15T19:18:51.707536] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-09-15T19:18:51.708306] [DEBUG] [LOCAL ] MAX: Trimmed 33939 records to 22023 (keeping 150 days of data) [2025-09-15T19:18:51.858266] [DEBUG] [LOCAL ] MAX: Primary data saved (22023 records). [2025-09-15T19:18:51.858480] [INFO ] [MAIN ] MAX: Full history saved. [2025-09-15T19:18:51.858668] [INFO ] [MAIN ] Update Progress: 1309/2369 symbols completed. MAX took 21.6s. Estimated remaining: 1h 52m 24s. Rate: 9.4 symbols/min [2025-09-15T19:18:52.037524] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:18:52.048453] [DEBUG] [LOCAL ] MCB: Loaded 8245 existing records from primary storage. [2025-09-15T19:18:52.048622] [INFO ] [MAIN ] MCB: Loaded 8245 existing records. [2025-09-15T19:18:52.233725] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:18:52.242744] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-09-15T19:18:52.243404] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-09-15T19:18:52.243788] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-15T19:18:52.246869] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-09-15T19:18:52.247205] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-09-15T19:18:52.291397] [INFO ] [REMOTE ] MATX: Full fetch complete (34373 records). [2025-09-15T19:18:52.324148] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-09-15T19:18:52.463349] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-09-15T19:18:52.911370] [INFO ] [REMOTE ] MCB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:18:53.052251] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-15T19:18:53.052390] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-09-15T19:18:53.058876] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-09-15T19:18:53.060187] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-09-15T19:18:53.060781] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-09-15T19:18:53.062550] [DEBUG] [LOCAL ] MATX: Trimmed 34373 records to 23548 (keeping 150 days of data) [2025-09-15T19:18:53.223505] [DEBUG] [LOCAL ] MATX: Primary data saved (23548 records). [2025-09-15T19:18:53.223736] [INFO ] [MAIN ] MATX: Full history saved. [2025-09-15T19:18:53.223916] [INFO ] [MAIN ] Update Progress: 1310/2369 symbols completed. MATX took 24.6s. Estimated remaining: 1h 52m 14s. Rate: 9.4 symbols/min [2025-09-15T19:18:53.262996] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-09-15T19:18:53.399262] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:18:53.441968] [DEBUG] [LOCAL ] MCD: Loaded 40241 existing records from primary storage. [2025-09-15T19:18:53.442212] [INFO ] [MAIN ] MCD: Loaded 40241 existing records. [2025-09-15T19:18:53.634766] [WARN ] [MAIN ] MCD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:18:53.635037] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-09-15T19:18:53.635089] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-15T19:18:53.636055] [DEBUG] [LOCAL ] MCD: Deleted primary data file. [2025-09-15T19:18:53.636106] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-09-15T19:18:54.004110] [INFO ] [REMOTE ] MCD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:18:54.057902] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-09-15T19:18:54.111206] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T19:18:54.252926] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T19:18:54.857893] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-09-15T19:18:55.552853] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-15T19:18:55.668471] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-09-15T19:18:55.673891] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T19:18:56.389867] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-15T19:18:56.457896] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-09-15T19:18:57.201417] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-15T19:18:57.257839] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-09-15T19:18:58.057846] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-09-15T19:18:58.099435] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-15T19:18:58.857906] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-09-15T19:18:59.510983] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-15T19:18:59.603826] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T19:18:59.657890] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-09-15T19:19:00.457958] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-09-15T19:19:01.246666] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-15T19:19:01.257817] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-09-15T19:19:01.292050] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-15T19:19:02.057879] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-09-15T19:19:02.616823] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-15T19:19:02.857905] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-09-15T19:19:03.277437] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-15T19:19:03.657911] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-09-15T19:19:04.372148] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-15T19:19:04.457883] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-09-15T19:19:05.164783] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-15T19:19:05.257870] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-09-15T19:19:06.057882] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-09-15T19:19:06.542295] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T19:19:06.683006] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-15T19:19:06.760767] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-15T19:19:06.763626] [INFO ] [REMOTE ] MBI: Full fetch complete (27185 records). [2025-09-15T19:19:06.763737] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-09-15T19:19:06.862732] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-09-15T19:19:07.132851] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-09-15T19:19:07.132966] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-09-15T19:19:07.133607] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-09-15T19:19:07.133672] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-09-15T19:19:07.134772] [DEBUG] [LOCAL ] MBI: Trimmed 27185 records to 17482 (keeping 150 days of data) [2025-09-15T19:19:07.234530] [DEBUG] [LOCAL ] MBI: Primary data saved (17482 records). [2025-09-15T19:19:07.234720] [INFO ] [MAIN ] MBI: Full history saved. [2025-09-15T19:19:07.234832] [INFO ] [MAIN ] Update Progress: 1311/2369 symbols completed. MBI took 33.8s. Estimated remaining: 1h 52m 14s. Rate: 9.4 symbols/min [2025-09-15T19:19:07.404695] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:19:07.410940] [DEBUG] [LOCAL ] MCI: Loaded 4648 existing records from primary storage. [2025-09-15T19:19:07.411035] [INFO ] [MAIN ] MCI: Loaded 4648 existing records. [2025-09-15T19:19:07.588756] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:19:07.589015] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-09-15T19:19:07.589102] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-09-15T19:19:07.589341] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-09-15T19:19:07.589385] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-09-15T19:19:07.664626] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-09-15T19:19:07.956537] [INFO ] [REMOTE ] MCI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:19:08.457854] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-09-15T19:19:08.534933] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-15T19:19:08.864525] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-15T19:19:09.155823] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-15T19:19:09.257939] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-09-15T19:19:10.057918] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-09-15T19:19:10.800208] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-15T19:19:10.857885] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-09-15T19:19:11.183318] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-15T19:19:11.406619] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-15T19:19:11.657914] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-09-15T19:19:12.457930] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-09-15T19:19:13.260112] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-09-15T19:19:13.261365] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T19:19:13.266727] [INFO ] [REMOTE ] MC: Full fetch complete (48320 records). [2025-09-15T19:19:13.266843] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-09-15T19:19:13.639656] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-09-15T19:19:13.639738] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-09-15T19:19:13.640458] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-09-15T19:19:13.640542] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-09-15T19:19:13.641604] [DEBUG] [LOCAL ] MC: Trimmed 48320 records to 32268 (keeping 150 days of data) [2025-09-15T19:19:13.843590] [DEBUG] [LOCAL ] MC: Primary data saved (32268 records). [2025-09-15T19:19:13.843745] [INFO ] [MAIN ] MC: Full history saved. [2025-09-15T19:19:13.843841] [INFO ] [MAIN ] Update Progress: 1312/2369 symbols completed. MC took 23.3s. Estimated remaining: 1h 52m 8s. Rate: 9.4 symbols/min [2025-09-15T19:19:14.020724] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:19:14.048311] [DEBUG] [LOCAL ] MCK: Loaded 28906 existing records from primary storage. [2025-09-15T19:19:14.048440] [INFO ] [MAIN ] MCK: Loaded 28906 existing records. [2025-09-15T19:19:14.062916] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-09-15T19:19:14.177933] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-15T19:19:14.243237] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:19:14.243615] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-09-15T19:19:14.243726] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-09-15T19:19:14.244668] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-09-15T19:19:14.244731] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-09-15T19:19:14.626072] [INFO ] [REMOTE ] MCK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:19:14.631377] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-15T19:19:14.789098] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-15T19:19:14.790813] [INFO ] [REMOTE ] MCB: Full fetch complete (12515 records). [2025-09-15T19:19:14.790881] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-09-15T19:19:14.863049] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-09-15T19:19:15.145764] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-09-15T19:19:15.145842] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-09-15T19:19:15.146123] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-09-15T19:19:15.146163] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-09-15T19:19:15.146623] [DEBUG] [LOCAL ] MCB: Trimmed 12515 records to 8093 (keeping 150 days of data) [2025-09-15T19:19:15.200665] [DEBUG] [LOCAL ] MCB: Primary data saved (8093 records). [2025-09-15T19:19:15.200831] [INFO ] [MAIN ] MCB: Full history saved. [2025-09-15T19:19:15.200940] [INFO ] [MAIN ] Update Progress: 1313/2369 symbols completed. MCB took 23.3s. Estimated remaining: 1h 51m 57s. Rate: 9.4 symbols/min [2025-09-15T19:19:15.400160] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:19:15.407328] [DEBUG] [LOCAL ] MCN: Loaded 6090 existing records from primary storage. [2025-09-15T19:19:15.407418] [INFO ] [MAIN ] MCN: Loaded 6090 existing records. [2025-09-15T19:19:15.583001] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:19:15.583272] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-09-15T19:19:15.583319] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-09-15T19:19:15.583721] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-09-15T19:19:15.583769] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-09-15T19:19:15.663091] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-09-15T19:19:15.948818] [INFO ] [REMOTE ] MCN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:19:16.457924] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-09-15T19:19:16.626820] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-15T19:19:17.087572] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-15T19:19:17.099947] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-15T19:19:17.257858] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-09-15T19:19:18.057879] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-09-15T19:19:18.680532] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-15T19:19:18.829502] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-15T19:19:18.857830] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-09-15T19:19:19.460820] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-15T19:19:19.657884] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-09-15T19:19:20.193958] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-15T19:19:20.457884] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-09-15T19:19:21.045564] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-15T19:19:21.257905] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-09-15T19:19:21.934953] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-15T19:19:22.057823] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-09-15T19:19:22.671966] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-15T19:19:22.857878] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-09-15T19:19:23.586534] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-15T19:19:23.657899] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-09-15T19:19:24.227366] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-15T19:19:24.457919] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-09-15T19:19:25.060797] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-15T19:19:25.257879] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-09-15T19:19:25.875226] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-15T19:19:25.876567] [INFO ] [REMOTE ] MCN: Full fetch complete (8896 records). [2025-09-15T19:19:25.876675] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-09-15T19:19:26.065864] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-09-15T19:19:26.257637] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-09-15T19:19:26.257737] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-09-15T19:19:26.257968] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-09-15T19:19:26.258007] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-09-15T19:19:26.258432] [DEBUG] [LOCAL ] MCN: Trimmed 8896 records to 5926 (keeping 150 days of data) [2025-09-15T19:19:26.293610] [DEBUG] [LOCAL ] MCN: Primary data saved (5926 records). [2025-09-15T19:19:26.293726] [INFO ] [MAIN ] MCN: Full history saved. [2025-09-15T19:19:26.293822] [INFO ] [MAIN ] Update Progress: 1314/2369 symbols completed. MCN took 11.1s. Estimated remaining: 1h 51m 55s. Rate: 9.4 symbols/min [2025-09-15T19:19:26.476941] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:19:26.509169] [DEBUG] [LOCAL ] MCO: Loaded 28401 existing records from primary storage. [2025-09-15T19:19:26.509393] [INFO ] [MAIN ] MCO: Loaded 28401 existing records. [2025-09-15T19:19:26.696115] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:19:26.696507] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-09-15T19:19:26.696559] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-09-15T19:19:26.697275] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-09-15T19:19:26.697340] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-09-15T19:19:26.858959] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-09-15T19:19:27.064755] [INFO ] [REMOTE ] MCO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:19:27.664678] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-09-15T19:19:27.673340] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-15T19:19:28.457854] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-09-15T19:19:28.563457] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-15T19:19:28.569955] [INFO ] [REMOTE ] MCD: Full fetch complete (58137 records). [2025-09-15T19:19:28.570168] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-09-15T19:19:28.996066] [DEBUG] [VALIDATOR ] MCD: All expected trading days are present. [2025-09-15T19:19:28.996207] [DEBUG] [VALIDATOR ] MCD: Primary data validation passed. [2025-09-15T19:19:28.997577] [INFO ] [MAIN ] MCD: Fetched primary data is valid. [2025-09-15T19:19:28.997661] [DEBUG] [LOCAL ] MCD: Saving primary data. [2025-09-15T19:19:28.999945] [DEBUG] [LOCAL ] MCD: Trimmed 58137 records to 39466 (keeping 150 days of data) [2025-09-15T19:19:29.246628] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-15T19:19:29.264754] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-09-15T19:19:29.282510] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-15T19:19:29.319076] [DEBUG] [LOCAL ] MCD: Primary data saved (39466 records). [2025-09-15T19:19:29.319262] [INFO ] [MAIN ] MCD: Full history saved. [2025-09-15T19:19:29.321097] [INFO ] [MAIN ] Update Progress: 1315/2369 symbols completed. MCD took 36.1s. Estimated remaining: 1h 51m 46s. Rate: 9.4 symbols/min [2025-09-15T19:19:29.489411] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:19:29.499000] [DEBUG] [LOCAL ] MCR: Loaded 6717 existing records from primary storage. [2025-09-15T19:19:29.499142] [INFO ] [MAIN ] MCR: Loaded 6717 existing records. [2025-09-15T19:19:29.684660] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:19:29.684955] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-09-15T19:19:29.685023] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-09-15T19:19:29.685407] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-09-15T19:19:29.685487] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-09-15T19:19:30.010888] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-15T19:19:30.062940] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-09-15T19:19:30.101035] [INFO ] [REMOTE ] MCR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:19:30.596835] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-15T19:19:30.857868] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-09-15T19:19:31.653967] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-15T19:19:31.655334] [INFO ] [REMOTE ] MCI: Full fetch complete (7538 records). [2025-09-15T19:19:31.655405] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-09-15T19:19:31.666678] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-09-15T19:19:32.024508] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-09-15T19:19:32.024588] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-09-15T19:19:32.024795] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-09-15T19:19:32.024844] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-09-15T19:19:32.025270] [DEBUG] [LOCAL ] MCI: Trimmed 7538 records to 4602 (keeping 150 days of data) [2025-09-15T19:19:32.054523] [DEBUG] [LOCAL ] MCI: Primary data saved (4602 records). [2025-09-15T19:19:32.054601] [INFO ] [MAIN ] MCI: Full history saved. [2025-09-15T19:19:32.054724] [INFO ] [MAIN ] Update Progress: 1316/2369 symbols completed. MCI took 24.8s. Estimated remaining: 1h 51m 36s. Rate: 9.4 symbols/min [2025-09-15T19:19:32.225783] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:19:32.243477] [DEBUG] [LOCAL ] MCS: Loaded 15625 existing records from primary storage. [2025-09-15T19:19:32.243624] [INFO ] [MAIN ] MCS: Loaded 15625 existing records. [2025-09-15T19:19:32.422352] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:19:32.422620] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-09-15T19:19:32.422686] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-09-15T19:19:32.423188] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-09-15T19:19:32.423233] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-09-15T19:19:32.463001] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-09-15T19:19:32.794162] [INFO ] [REMOTE ] MCS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:19:33.219956] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-15T19:19:33.236186] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T19:19:33.257893] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-09-15T19:19:33.789229] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-15T19:19:34.057956] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-09-15T19:19:34.857880] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-09-15T19:19:35.353840] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-15T19:19:35.657917] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-09-15T19:19:36.318633] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-15T19:19:36.457856] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-09-15T19:19:36.932487] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-15T19:19:37.046526] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-15T19:19:37.257925] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-09-15T19:19:38.057983] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-09-15T19:19:38.486043] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-15T19:19:38.565111] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-15T19:19:38.857847] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-09-15T19:19:39.523566] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-15T19:19:39.657867] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-09-15T19:19:40.457944] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-09-15T19:19:40.661837] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-15T19:19:41.257869] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-09-15T19:19:41.471512] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-15T19:19:42.057894] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-09-15T19:19:42.440812] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-15T19:19:42.857886] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-09-15T19:19:43.013324] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-15T19:19:43.657893] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-09-15T19:19:43.967752] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-15T19:19:44.457894] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-09-15T19:19:44.968143] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-15T19:19:45.257965] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-09-15T19:19:45.661380] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-15T19:19:45.666508] [INFO ] [REMOTE ] MCO: Full fetch complete (43634 records). [2025-09-15T19:19:45.666626] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-09-15T19:19:46.055147] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-09-15T19:19:46.055230] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-09-15T19:19:46.056115] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-09-15T19:19:46.056171] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-09-15T19:19:46.057166] [DEBUG] [LOCAL ] MCO: Trimmed 43634 records to 27717 (keeping 150 days of data) [2025-09-15T19:19:46.057938] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-09-15T19:19:46.244563] [DEBUG] [LOCAL ] MCO: Primary data saved (27717 records). [2025-09-15T19:19:46.244732] [INFO ] [MAIN ] MCO: Full history saved. [2025-09-15T19:19:46.244848] [INFO ] [MAIN ] Update Progress: 1317/2369 symbols completed. MCO took 20.0s. Estimated remaining: 1h 51m 36s. Rate: 9.4 symbols/min [2025-09-15T19:19:46.372083] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-15T19:19:46.376418] [INFO ] [REMOTE ] MCK: Full fetch complete (43192 records). [2025-09-15T19:19:46.376533] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-09-15T19:19:46.746441] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-09-15T19:19:46.746531] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-09-15T19:19:46.747304] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-09-15T19:19:46.747349] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-09-15T19:19:46.748279] [DEBUG] [LOCAL ] MCK: Trimmed 43192 records to 28290 (keeping 150 days of data) [2025-09-15T19:19:46.858785] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-09-15T19:19:46.952130] [DEBUG] [LOCAL ] MCK: Primary data saved (28290 records). [2025-09-15T19:19:46.952271] [INFO ] [MAIN ] MCK: Full history saved. [2025-09-15T19:19:46.952375] [INFO ] [MAIN ] Update Progress: 1318/2369 symbols completed. MCK took 33.1s. Estimated remaining: 1h 51m 25s. Rate: 9.4 symbols/min [2025-09-15T19:19:46.998709] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-15T19:19:47.534938] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-15T19:19:47.657922] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-09-15T19:19:48.457947] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-09-15T19:19:48.651737] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-15T19:19:49.211504] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-15T19:19:49.257875] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-09-15T19:19:50.015944] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-15T19:19:50.017432] [INFO ] [REMOTE ] MCR: Full fetch complete (9811 records). [2025-09-15T19:19:50.017502] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-09-15T19:19:50.080120] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-09-15T19:19:50.373215] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-09-15T19:19:50.373315] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-09-15T19:19:50.373595] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-09-15T19:19:50.373636] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-09-15T19:19:50.374119] [DEBUG] [LOCAL ] MCR: Trimmed 9811 records to 6518 (keeping 150 days of data) [2025-09-15T19:19:50.414800] [DEBUG] [LOCAL ] MCR: Primary data saved (6518 records). [2025-09-15T19:19:50.414914] [INFO ] [MAIN ] MCR: Full history saved. [2025-09-15T19:19:50.415027] [INFO ] [MAIN ] Update Progress: 1319/2369 symbols completed. MCR took 21.1s. Estimated remaining: 1h 51m 17s. Rate: 9.4 symbols/min [2025-09-15T19:19:51.153106] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-15T19:19:51.159637] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-09-15T19:19:52.086513] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-15T19:19:52.092618] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-09-15T19:19:53.215485] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-15T19:19:53.221010] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-09-15T19:19:54.299895] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-15T19:19:54.306730] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-09-15T19:19:55.261809] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-15T19:19:55.265352] [INFO ] [REMOTE ] MCS: Full fetch complete (23342 records). [2025-09-15T19:19:55.265691] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-09-15T19:19:55.632029] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-09-15T19:19:55.632265] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-09-15T19:19:55.632841] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-09-15T19:19:55.632895] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-09-15T19:19:55.633720] [DEBUG] [LOCAL ] MCS: Trimmed 23342 records to 15437 (keeping 150 days of data) [2025-09-15T19:19:55.738838] [DEBUG] [LOCAL ] MCS: Primary data saved (15437 records). [2025-09-15T19:19:55.738995] [INFO ] [MAIN ] MCS: Full history saved. [2025-09-15T19:19:55.739094] [INFO ] [MAIN ] Update Progress: 1320/2369 symbols completed. MCS took 23.7s. Estimated remaining: 1h 51m 9s. Rate: 9.4 symbols/min [2025-09-15T19:19:56.359804] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:19:56.318033] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:19:56.402940] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:19:56.472720] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:19:56.481823] [DEBUG] [LOCAL ] MDST: Loaded 4014 existing records from primary storage. [2025-09-15T19:19:56.482252] [INFO ] [MAIN ] MDST: Loaded 4014 existing records. [2025-09-15T19:19:56.590927] [DEBUG] [LOCAL ] MCY: Loaded 17957 existing records from primary storage. [2025-09-15T19:19:56.601467] [INFO ] [MAIN ] MCY: Loaded 17957 existing records. [2025-09-15T19:19:56.776044] [DEBUG] [LOCAL ] MD: Loaded 29282 existing records from primary storage. [2025-09-15T19:19:56.809330] [INFO ] [MAIN ] MD: Loaded 29282 existing records. [2025-09-15T19:19:56.808782] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:19:56.951487] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:19:56.961139] [DEBUG] [LOCAL ] MDT: Loaded 40418 existing records from primary storage. [2025-09-15T19:19:56.951617] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-09-15T19:19:56.992136] [INFO ] [MAIN ] MDT: Loaded 40418 existing records. [2025-09-15T19:19:57.000893] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-09-15T19:19:57.001041] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-09-15T19:19:57.021227] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-09-15T19:19:57.035605] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-09-15T19:19:57.051613] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-09-15T19:19:57.051481] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-09-15T19:19:57.142693] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-09-15T19:19:57.203696] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:19:57.334688] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-09-15T19:19:57.381146] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-09-15T19:19:57.452550] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-09-15T19:19:57.490596] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-09-15T19:19:57.500045] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:19:57.643161] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-09-15T19:19:57.706904] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-09-15T19:19:57.747452] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-09-15T19:19:57.769453] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-09-15T19:19:58.345553] [INFO ] [REMOTE ] MCY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:19:58.375310] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-09-15T19:19:58.577286] [INFO ] [REMOTE ] MDST: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:19:58.615938] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-09-15T19:19:58.822915] [INFO ] [REMOTE ] MD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:19:58.838496] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-09-15T19:19:58.861637] [INFO ] [REMOTE ] MDT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:19:58.862015] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-09-15T19:19:59.292758] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-15T19:19:59.296367] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-09-15T19:19:59.685206] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-15T19:19:59.687283] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-09-15T19:19:59.744867] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-15T19:19:59.756587] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-09-15T19:20:00.088336] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-15T19:20:00.089984] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-09-15T19:20:00.214655] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-15T19:20:00.441262] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-15T19:20:00.457813] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-09-15T19:20:00.585728] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-15T19:20:00.685534] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-15T19:20:01.257881] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-09-15T19:20:01.681690] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-15T19:20:01.955468] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-15T19:20:02.057884] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-09-15T19:20:02.857904] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-09-15T19:20:03.657913] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-09-15T19:20:03.885038] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-15T19:20:04.031379] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-15T19:20:04.457890] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-09-15T19:20:04.536273] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-15T19:20:04.979513] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-15T19:20:05.257883] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-09-15T19:20:06.057901] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-09-15T19:20:06.568942] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-15T19:20:06.857928] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-09-15T19:20:07.614893] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T19:20:07.657869] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-09-15T19:20:08.041605] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-15T19:20:08.457925] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-09-15T19:20:09.075343] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-15T19:20:09.257939] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-09-15T19:20:09.831903] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-15T19:20:09.914304] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T19:20:10.057891] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-09-15T19:20:10.857872] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-09-15T19:20:11.267612] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-15T19:20:11.657977] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-09-15T19:20:11.879065] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-15T19:20:12.223926] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-15T19:20:12.457894] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-09-15T19:20:13.065116] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-15T19:20:13.066559] [INFO ] [REMOTE ] MDST: Full fetch complete (5995 records). [2025-09-15T19:20:13.066629] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-09-15T19:20:13.263284] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-09-15T19:20:13.463284] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-09-15T19:20:13.463370] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-09-15T19:20:13.463560] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-09-15T19:20:13.463601] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-09-15T19:20:13.464032] [DEBUG] [LOCAL ] MDST: Trimmed 5995 records to 4046 (keeping 150 days of data) [2025-09-15T19:20:13.490862] [DEBUG] [LOCAL ] MDST: Primary data saved (4046 records). [2025-09-15T19:20:13.490967] [INFO ] [MAIN ] MDST: Full history saved. [2025-09-15T19:20:13.491056] [INFO ] [MAIN ] Update Progress: 1321/2369 symbols completed. MDST took 17.7s. Estimated remaining: 1h 51m 12s. Rate: 9.4 symbols/min [2025-09-15T19:20:13.681538] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:20:13.747262] [DEBUG] [LOCAL ] MDU: Loaded 35398 existing records from primary storage. [2025-09-15T19:20:13.747581] [INFO ] [MAIN ] MDU: Loaded 35398 existing records. [2025-09-15T19:20:13.936047] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:20:13.936435] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-09-15T19:20:13.936486] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-09-15T19:20:13.937551] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-09-15T19:20:13.937607] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-09-15T19:20:14.062948] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-09-15T19:20:14.305232] [INFO ] [REMOTE ] MDU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:20:14.387239] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-15T19:20:14.857863] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-09-15T19:20:15.657907] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-09-15T19:20:15.921193] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-15T19:20:15.942024] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-15T19:20:15.944893] [INFO ] [REMOTE ] MCY: Full fetch complete (29606 records). [2025-09-15T19:20:15.944998] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-09-15T19:20:16.306804] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-09-15T19:20:16.306887] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-09-15T19:20:16.307520] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-09-15T19:20:16.307562] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-09-15T19:20:16.308264] [DEBUG] [LOCAL ] MCY: Trimmed 29606 records to 17493 (keeping 150 days of data) [2025-09-15T19:20:16.419267] [DEBUG] [LOCAL ] MCY: Primary data saved (17493 records). [2025-09-15T19:20:16.419408] [INFO ] [MAIN ] MCY: Full history saved. [2025-09-15T19:20:16.419759] [INFO ] [MAIN ] Update Progress: 1322/2369 symbols completed. MCY took 20.7s. Estimated remaining: 1h 51m 3s. Rate: 9.4 symbols/min [2025-09-15T19:20:16.462965] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-09-15T19:20:16.596566] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:20:16.605128] [DEBUG] [LOCAL ] MDV: Loaded 6596 existing records from primary storage. [2025-09-15T19:20:16.605236] [INFO ] [MAIN ] MDV: Loaded 6596 existing records. [2025-09-15T19:20:16.779711] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:20:16.780082] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-09-15T19:20:16.780164] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-09-15T19:20:16.780621] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-09-15T19:20:16.780717] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-09-15T19:20:17.036915] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-15T19:20:17.178235] [INFO ] [REMOTE ] MDV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:20:17.257827] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-09-15T19:20:17.644770] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-15T19:20:17.740121] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-15T19:20:18.057887] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-09-15T19:20:18.857911] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-09-15T19:20:19.097600] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-15T19:20:19.657914] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-09-15T19:20:20.457927] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-09-15T19:20:21.257931] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-09-15T19:20:21.371713] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-15T19:20:21.629466] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-09-15T19:20:21.990786] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-15T19:20:22.057889] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-09-15T19:20:22.545926] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-15T19:20:22.857894] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-09-15T19:20:23.317002] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T19:20:23.321592] [INFO ] [REMOTE ] MD: Full fetch complete (42172 records). [2025-09-15T19:20:23.321722] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-09-15T19:20:23.667022] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-09-15T19:20:23.707495] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-09-15T19:20:23.707588] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-09-15T19:20:23.708388] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-09-15T19:20:23.708435] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-09-15T19:20:23.709782] [DEBUG] [LOCAL ] MD: Trimmed 42172 records to 28839 (keeping 150 days of data) [2025-09-15T19:20:23.886717] [DEBUG] [LOCAL ] MD: Primary data saved (28839 records). [2025-09-15T19:20:23.886878] [INFO ] [MAIN ] MD: Full history saved. [2025-09-15T19:20:23.886978] [INFO ] [MAIN ] Update Progress: 1323/2369 symbols completed. MD took 28.1s. Estimated remaining: 1h 50m 58s. Rate: 9.4 symbols/min [2025-09-15T19:20:24.055293] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:20:24.068038] [DEBUG] [LOCAL ] MEC: Loaded 12468 existing records from primary storage. [2025-09-15T19:20:24.068155] [INFO ] [MAIN ] MEC: Loaded 12468 existing records. [2025-09-15T19:20:24.245412] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:20:24.245685] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-09-15T19:20:24.245732] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-09-15T19:20:24.246150] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-09-15T19:20:24.246198] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-09-15T19:20:24.467750] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-09-15T19:20:24.647296] [INFO ] [REMOTE ] MEC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:20:24.656480] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-15T19:20:24.662486] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-15T19:20:24.668747] [INFO ] [REMOTE ] MDT: Full fetch complete (58358 records). [2025-09-15T19:20:24.668890] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-09-15T19:20:25.074440] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-09-15T19:20:25.074572] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-09-15T19:20:25.076378] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-09-15T19:20:25.076452] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-09-15T19:20:25.078350] [DEBUG] [LOCAL ] MDT: Trimmed 58358 records to 39638 (keeping 150 days of data) [2025-09-15T19:20:25.272551] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-09-15T19:20:25.353955] [DEBUG] [LOCAL ] MDT: Primary data saved (39638 records). [2025-09-15T19:20:25.354243] [INFO ] [MAIN ] MDT: Full history saved. [2025-09-15T19:20:25.354412] [INFO ] [MAIN ] Update Progress: 1324/2369 symbols completed. MDT took 29.6s. Estimated remaining: 1h 50m 47s. Rate: 9.4 symbols/min [2025-09-15T19:20:25.539303] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:20:25.559298] [DEBUG] [LOCAL ] MED: Loaded 16010 existing records from primary storage. [2025-09-15T19:20:25.559476] [INFO ] [MAIN ] MED: Loaded 16010 existing records. [2025-09-15T19:20:25.741452] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:20:25.741944] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-09-15T19:20:25.742001] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-09-15T19:20:25.742518] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-09-15T19:20:25.742577] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-09-15T19:20:26.065320] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-09-15T19:20:26.106110] [INFO ] [REMOTE ] MED: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:20:26.115439] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-15T19:20:26.169903] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-15T19:20:26.776142] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-15T19:20:26.857908] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-09-15T19:20:27.657884] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-09-15T19:20:28.133763] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-15T19:20:28.457917] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-09-15T19:20:28.639853] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-15T19:20:29.057944] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-15T19:20:29.257926] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-09-15T19:20:29.991786] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-15T19:20:30.057906] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-09-15T19:20:30.857930] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-09-15T19:20:31.048796] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-15T19:20:31.429542] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-15T19:20:31.657867] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-09-15T19:20:32.228357] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-15T19:20:32.229485] [INFO ] [REMOTE ] MDV: Full fetch complete (9375 records). [2025-09-15T19:20:32.229556] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-09-15T19:20:32.468142] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-09-15T19:20:32.601362] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-09-15T19:20:32.601542] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-09-15T19:20:32.601919] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-09-15T19:20:32.601969] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-09-15T19:20:32.602486] [DEBUG] [LOCAL ] MDV: Trimmed 9375 records to 6491 (keeping 150 days of data) [2025-09-15T19:20:32.644787] [DEBUG] [LOCAL ] MDV: Primary data saved (6491 records). [2025-09-15T19:20:32.644944] [INFO ] [MAIN ] MDV: Full history saved. [2025-09-15T19:20:32.645047] [INFO ] [MAIN ] Update Progress: 1325/2369 symbols completed. MDV took 16.2s. Estimated remaining: 1h 50m 42s. Rate: 9.4 symbols/min [2025-09-15T19:20:32.816344] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:20:32.816541] [DEBUG] [LOCAL ] MEG: No existing data file found in primary storage. [2025-09-15T19:20:32.816579] [WARN ] [MAIN ] MEG: No existing data found, performing full refresh instead. [2025-09-15T19:20:32.816734] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-09-15T19:20:32.816781] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-09-15T19:20:32.816826] [DEBUG] [LOCAL ] MEG: No primary data file found to delete. [2025-09-15T19:20:32.816861] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-09-15T19:20:33.183277] [INFO ] [REMOTE ] MEG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:20:33.193420] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-15T19:20:33.257873] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-09-15T19:20:34.057932] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-09-15T19:20:34.285497] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-15T19:20:34.857942] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-09-15T19:20:35.511699] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T19:20:35.609842] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-15T19:20:35.657912] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-09-15T19:20:36.457933] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-09-15T19:20:36.540098] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-15T19:20:37.257943] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-09-15T19:20:38.057930] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-09-15T19:20:38.832130] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-15T19:20:38.857875] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-09-15T19:20:38.933596] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-15T19:20:39.022000] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-15T19:20:39.657891] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-09-15T19:20:40.295038] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-15T19:20:40.457905] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-09-15T19:20:40.573894] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-15T19:20:41.257901] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-09-15T19:20:41.821925] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-15T19:20:42.057871] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-09-15T19:20:42.577223] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T19:20:42.585680] [INFO ] [REMOTE ] MDU: Full fetch complete (52251 records). [2025-09-15T19:20:42.585910] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-09-15T19:20:42.865105] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-09-15T19:20:43.011472] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-09-15T19:20:43.011613] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-09-15T19:20:43.013186] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-09-15T19:20:43.013260] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-09-15T19:20:43.015001] [DEBUG] [LOCAL ] MDU: Trimmed 52251 records to 34744 (keeping 150 days of data) [2025-09-15T19:20:43.271882] [DEBUG] [LOCAL ] MDU: Primary data saved (34744 records). [2025-09-15T19:20:43.272189] [INFO ] [MAIN ] MDU: Full history saved. [2025-09-15T19:20:43.272310] [INFO ] [MAIN ] Update Progress: 1326/2369 symbols completed. MDU took 29.8s. Estimated remaining: 1h 50m 39s. Rate: 9.4 symbols/min [2025-09-15T19:20:43.457588] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:20:43.483662] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-15T19:20:43.508050] [DEBUG] [LOCAL ] MEGI: Loaded 14929 existing records from primary storage. [2025-09-15T19:20:43.508277] [INFO ] [MAIN ] MEGI: Loaded 14929 existing records. [2025-09-15T19:20:43.662845] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-09-15T19:20:43.698729] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:20:43.699096] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-09-15T19:20:43.699276] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-09-15T19:20:43.705154] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-09-15T19:20:43.714634] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-09-15T19:20:43.728813] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-15T19:20:44.076978] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:20:44.457927] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-09-15T19:20:44.803416] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-15T19:20:45.257855] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-09-15T19:20:45.411155] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-15T19:20:46.057940] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-09-15T19:20:46.272458] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-15T19:20:46.857928] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-09-15T19:20:47.657961] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-09-15T19:20:47.958535] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-15T19:20:48.457891] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-09-15T19:20:48.611910] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-15T19:20:49.257846] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-09-15T19:20:49.548148] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-15T19:20:50.049725] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (3.99 seconds). [2025-09-15T19:20:50.051790] [INFO ] [REMOTE ] MEC: Full fetch complete (17463 records). [2025-09-15T19:20:50.051863] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-09-15T19:20:50.063032] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-09-15T19:20:50.345597] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-15T19:20:50.454156] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-09-15T19:20:50.454276] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-09-15T19:20:50.454800] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-09-15T19:20:50.454851] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-09-15T19:20:50.455504] [DEBUG] [LOCAL ] MEC: Trimmed 17463 records to 12261 (keeping 150 days of data) [2025-09-15T19:20:50.537830] [DEBUG] [LOCAL ] MEC: Primary data saved (12261 records). [2025-09-15T19:20:50.538223] [INFO ] [MAIN ] MEC: Full history saved. [2025-09-15T19:20:50.538399] [INFO ] [MAIN ] Update Progress: 1327/2369 symbols completed. MEC took 26.7s. Estimated remaining: 1h 50m 33s. Rate: 9.4 symbols/min [2025-09-15T19:20:50.711146] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:20:50.732790] [DEBUG] [LOCAL ] MEI: Loaded 23507 existing records from primary storage. [2025-09-15T19:20:50.732948] [INFO ] [MAIN ] MEI: Loaded 23507 existing records. [2025-09-15T19:20:50.873441] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-09-15T19:20:50.913490] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:20:50.913847] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-09-15T19:20:50.913897] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-09-15T19:20:50.914666] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-09-15T19:20:50.914732] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-09-15T19:20:51.279077] [INFO ] [REMOTE ] MEI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:20:51.459459] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-15T19:20:51.657840] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-09-15T19:20:52.021666] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-15T19:20:52.457935] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-09-15T19:20:52.935886] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T19:20:53.257866] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-09-15T19:20:53.606633] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-15T19:20:54.057876] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-09-15T19:20:54.526854] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T19:20:54.531542] [INFO ] [REMOTE ] MEG: Full fetch complete (34846 records). [2025-09-15T19:20:54.531685] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-09-15T19:20:54.863109] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-09-15T19:20:54.913715] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-09-15T19:20:54.913816] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-09-15T19:20:54.914878] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-09-15T19:20:54.914959] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-09-15T19:20:54.916519] [DEBUG] [LOCAL ] MEG: Trimmed 34846 records to 22278 (keeping 150 days of data) [2025-09-15T19:20:55.056659] [DEBUG] [LOCAL ] MEG: Primary data saved (22278 records). [2025-09-15T19:20:55.056827] [INFO ] [MAIN ] MEG: Full history saved. [2025-09-15T19:20:55.056910] [INFO ] [MAIN ] Update Progress: 1328/2369 symbols completed. MEG took 22.4s. Estimated remaining: 1h 50m 25s. Rate: 9.4 symbols/min [2025-09-15T19:20:55.232455] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:20:55.273569] [DEBUG] [LOCAL ] MET: Loaded 40097 existing records from primary storage. [2025-09-15T19:20:55.273742] [INFO ] [MAIN ] MET: Loaded 40097 existing records. [2025-09-15T19:20:55.477033] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-15T19:20:55.475044] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:20:55.485679] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-09-15T19:20:55.485756] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-09-15T19:20:55.487160] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-09-15T19:20:55.487219] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-09-15T19:20:55.662101] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-09-15T19:20:55.853629] [INFO ] [REMOTE ] MET: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:20:55.865501] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-15T19:20:56.457899] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-09-15T19:20:57.242848] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T19:20:57.257826] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-09-15T19:20:57.771092] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-15T19:20:58.057861] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-09-15T19:20:58.463109] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-15T19:20:58.857917] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-09-15T19:20:59.662946] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-09-15T19:20:59.682703] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-15T19:20:59.759879] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-15T19:21:00.457829] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-09-15T19:21:00.608554] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-15T19:21:01.257871] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-09-15T19:21:01.493395] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-15T19:21:02.057928] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-09-15T19:21:02.777834] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-15T19:21:02.857884] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-09-15T19:21:03.559508] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-15T19:21:03.657889] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-09-15T19:21:03.957488] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-15T19:21:04.457893] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-09-15T19:21:04.714143] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-15T19:21:05.257874] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-09-15T19:21:06.021713] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T19:21:06.057822] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-09-15T19:21:06.525697] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-15T19:21:06.529852] [INFO ] [REMOTE ] MEI: Full fetch complete (34663 records). [2025-09-15T19:21:06.529939] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-09-15T19:21:06.866390] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-09-15T19:21:06.907563] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-09-15T19:21:06.907679] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-09-15T19:21:06.908529] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-09-15T19:21:06.908574] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-09-15T19:21:06.909492] [DEBUG] [LOCAL ] MEI: Trimmed 34663 records to 23106 (keeping 150 days of data) [2025-09-15T19:21:07.043961] [DEBUG] [LOCAL ] MEI: Primary data saved (23106 records). [2025-09-15T19:21:07.044094] [INFO ] [MAIN ] MEI: Full history saved. [2025-09-15T19:21:07.044201] [INFO ] [MAIN ] Update Progress: 1329/2369 symbols completed. MEI took 16.5s. Estimated remaining: 1h 50m 23s. Rate: 9.4 symbols/min [2025-09-15T19:21:07.218068] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:21:07.250122] [DEBUG] [LOCAL ] MFA: Loaded 33621 existing records from primary storage. [2025-09-15T19:21:07.250250] [INFO ] [MAIN ] MFA: Loaded 33621 existing records. [2025-09-15T19:21:07.451950] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:21:07.452376] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-09-15T19:21:07.452479] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-09-15T19:21:07.453359] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-09-15T19:21:07.453417] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-09-15T19:21:07.676145] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-09-15T19:21:07.788029] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-15T19:21:07.876243] [INFO ] [REMOTE ] MFA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:21:07.904053] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-15T19:21:07.906460] [INFO ] [REMOTE ] MEGI: Full fetch complete (21983 records). [2025-09-15T19:21:07.906547] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-09-15T19:21:08.275022] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-09-15T19:21:08.275114] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-09-15T19:21:08.275717] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-09-15T19:21:08.275762] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-09-15T19:21:08.276431] [DEBUG] [LOCAL ] MEGI: Trimmed 21983 records to 14795 (keeping 150 days of data) [2025-09-15T19:21:08.368693] [DEBUG] [LOCAL ] MEGI: Primary data saved (14795 records). [2025-09-15T19:21:08.368854] [INFO ] [MAIN ] MEGI: Full history saved. [2025-09-15T19:21:08.368961] [INFO ] [MAIN ] Update Progress: 1330/2369 symbols completed. MEGI took 25.1s. Estimated remaining: 1h 50m 13s. Rate: 9.4 symbols/min [2025-09-15T19:21:08.466730] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-09-15T19:21:08.540280] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:21:08.544956] [DEBUG] [LOCAL ] MFAN: Loaded 3076 existing records from primary storage. [2025-09-15T19:21:08.545042] [INFO ] [MAIN ] MFAN: Loaded 3076 existing records. [2025-09-15T19:21:08.723051] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:21:08.723499] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-09-15T19:21:08.723560] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-09-15T19:21:08.729607] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-15T19:21:08.729658] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-09-15T19:21:08.731898] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-09-15T19:21:08.763532] [INFO ] [REMOTE ] MED: Full fetch complete (24462 records). [2025-09-15T19:21:08.800833] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-09-15T19:21:09.261034] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-09-15T19:21:09.409957] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:21:09.494985] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-09-15T19:21:09.495074] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-09-15T19:21:09.495657] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-09-15T19:21:09.495702] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-09-15T19:21:09.496472] [DEBUG] [LOCAL ] MED: Trimmed 24462 records to 15589 (keeping 150 days of data) [2025-09-15T19:21:09.594444] [DEBUG] [LOCAL ] MED: Primary data saved (15589 records). [2025-09-15T19:21:09.594609] [INFO ] [MAIN ] MED: Full history saved. [2025-09-15T19:21:09.594745] [INFO ] [MAIN ] Update Progress: 1331/2369 symbols completed. MED took 44.2s. Estimated remaining: 1h 50m 3s. Rate: 9.4 symbols/min [2025-09-15T19:21:09.774815] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:21:09.779328] [DEBUG] [LOCAL ] MFAO: Loaded 2960 existing records from primary storage. [2025-09-15T19:21:09.779409] [INFO ] [MAIN ] MFAO: Loaded 2960 existing records. [2025-09-15T19:21:09.958666] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:21:09.958918] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-09-15T19:21:09.958967] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-09-15T19:21:09.959191] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-09-15T19:21:09.959239] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-09-15T19:21:10.062092] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-09-15T19:21:10.325928] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:21:10.857949] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-09-15T19:21:11.021121] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-09-15T19:21:11.657938] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-09-15T19:21:11.902130] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-15T19:21:11.996041] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-15T19:21:12.457873] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-09-15T19:21:12.565543] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (3.30 seconds). [2025-09-15T19:21:12.769713] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-15T19:21:13.126111] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-15T19:21:13.257875] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-09-15T19:21:14.057869] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-09-15T19:21:14.857856] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-09-15T19:21:14.931475] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-15T19:21:15.426824] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-15T19:21:15.429486] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-15T19:21:15.657878] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-09-15T19:21:16.036817] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-15T19:21:16.457873] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-09-15T19:21:16.913009] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-15T19:21:17.257873] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-09-15T19:21:17.907458] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-15T19:21:18.057866] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-09-15T19:21:18.857873] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-09-15T19:21:19.657892] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-09-15T19:21:19.707224] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-15T19:21:20.065794] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-15T19:21:20.071664] [INFO ] [REMOTE ] MET: Full fetch complete (57955 records). [2025-09-15T19:21:20.071807] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-09-15T19:21:20.179128] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-15T19:21:20.460429] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-09-15T19:21:20.460782] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-09-15T19:21:20.461720] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-09-15T19:21:20.462677] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-09-15T19:21:20.462731] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-09-15T19:21:20.464006] [DEBUG] [LOCAL ] MET: Trimmed 57955 records to 39323 (keeping 150 days of data) [2025-09-15T19:21:20.716442] [DEBUG] [LOCAL ] MET: Primary data saved (39323 records). [2025-09-15T19:21:20.716587] [INFO ] [MAIN ] MET: Full history saved. [2025-09-15T19:21:20.717340] [INFO ] [MAIN ] Update Progress: 1332/2369 symbols completed. MET took 25.7s. Estimated remaining: 1h 49m 60s. Rate: 9.4 symbols/min [2025-09-15T19:21:20.884628] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:21:20.923062] [DEBUG] [LOCAL ] MFC: Loaded 38397 existing records from primary storage. [2025-09-15T19:21:20.923232] [INFO ] [MAIN ] MFC: Loaded 38397 existing records. [2025-09-15T19:21:21.120564] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:21:21.120980] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-09-15T19:21:21.121036] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-09-15T19:21:21.122358] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-09-15T19:21:21.122617] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-09-15T19:21:21.269963] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-09-15T19:21:21.496350] [INFO ] [REMOTE ] MFC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:21:21.818152] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-15T19:21:21.834455] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-15T19:21:22.057878] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-09-15T19:21:22.857893] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-09-15T19:21:23.287625] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-15T19:21:23.453710] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T19:21:23.657922] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-09-15T19:21:24.457897] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-09-15T19:21:25.180036] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-15T19:21:25.257862] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-09-15T19:21:26.057888] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-09-15T19:21:26.104486] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T19:21:26.524870] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-15T19:21:26.857872] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-09-15T19:21:27.013768] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-15T19:21:27.381432] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-15T19:21:27.657882] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-09-15T19:21:28.245472] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-15T19:21:28.457914] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-09-15T19:21:28.809626] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-15T19:21:29.257893] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-09-15T19:21:30.057883] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-09-15T19:21:30.670841] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-15T19:21:30.671888] [INFO ] [REMOTE ] MFAN: Full fetch complete (4537 records). [2025-09-15T19:21:30.671957] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-09-15T19:21:30.867933] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-09-15T19:21:31.031165] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-09-15T19:21:31.031341] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-09-15T19:21:31.031513] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-09-15T19:21:31.031565] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-09-15T19:21:31.032090] [DEBUG] [LOCAL ] MFAN: Trimmed 4537 records to 3011 (keeping 150 days of data) [2025-09-15T19:21:31.051434] [DEBUG] [LOCAL ] MFAN: Primary data saved (3011 records). [2025-09-15T19:21:31.051592] [INFO ] [MAIN ] MFAN: Full history saved. [2025-09-15T19:21:31.051713] [INFO ] [MAIN ] Update Progress: 1333/2369 symbols completed. MFAN took 22.7s. Estimated remaining: 1h 49m 57s. Rate: 9.4 symbols/min [2025-09-15T19:21:31.210168] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-15T19:21:31.277196] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:21:31.312842] [DEBUG] [LOCAL ] MFG: Loaded 37293 existing records from primary storage. [2025-09-15T19:21:31.313013] [INFO ] [MAIN ] MFG: Loaded 37293 existing records. [2025-09-15T19:21:31.498578] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:21:31.498920] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-09-15T19:21:31.499015] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-09-15T19:21:31.499866] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-09-15T19:21:31.499930] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-09-15T19:21:31.663391] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-09-15T19:21:31.878061] [INFO ] [REMOTE ] MFG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:21:32.311470] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-15T19:21:32.457830] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-09-15T19:21:33.032702] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T19:21:33.257939] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-09-15T19:21:33.918760] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-15T19:21:33.919842] [INFO ] [REMOTE ] MFAO: Full fetch complete (4186 records). [2025-09-15T19:21:33.919929] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-09-15T19:21:34.075310] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-09-15T19:21:34.160909] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-15T19:21:34.226045] [INFO ] [REMOTE ] MFA: Full fetch complete (48952 records). [2025-09-15T19:21:34.232074] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-09-15T19:21:34.424198] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-09-15T19:21:34.424352] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-09-15T19:21:34.425136] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-09-15T19:21:34.440742] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-09-15T19:21:34.485874] [DEBUG] [LOCAL ] MFAO: Trimmed 4186 records to 2818 (keeping 150 days of data) [2025-09-15T19:21:34.665317] [DEBUG] [LOCAL ] MFAO: Primary data saved (2818 records). [2025-09-15T19:21:34.695278] [INFO ] [MAIN ] MFAO: Full history saved. [2025-09-15T19:21:34.706593] [INFO ] [MAIN ] Update Progress: 1334/2369 symbols completed. MFAO took 25.1s. Estimated remaining: 1h 49m 48s. Rate: 9.4 symbols/min [2025-09-15T19:21:34.846779] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-09-15T19:21:34.849407] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-09-15T19:21:34.851138] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-09-15T19:21:34.856660] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-09-15T19:21:34.861913] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-09-15T19:21:34.922666] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:21:34.923308] [DEBUG] [LOCAL ] MFA: Trimmed 48952 records to 32905 (keeping 150 days of data) [2025-09-15T19:21:35.030997] [DEBUG] [LOCAL ] MFM: Loaded 10158 existing records from primary storage. [2025-09-15T19:21:35.035149] [INFO ] [MAIN ] MFM: Loaded 10158 existing records. [2025-09-15T19:21:35.234896] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:21:35.235189] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-09-15T19:21:35.235240] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-09-15T19:21:35.267270] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-09-15T19:21:35.273470] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-09-15T19:21:35.662605] [INFO ] [REMOTE ] MFM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:21:35.665095] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-09-15T19:21:35.672941] [DEBUG] [LOCAL ] MFA: Primary data saved (32905 records). [2025-09-15T19:21:35.673077] [INFO ] [MAIN ] MFA: Full history saved. [2025-09-15T19:21:35.673167] [INFO ] [MAIN ] Update Progress: 1335/2369 symbols completed. MFA took 28.6s. Estimated remaining: 1h 49m 38s. Rate: 9.4 symbols/min [2025-09-15T19:21:35.846857] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:21:35.847074] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-09-15T19:21:35.847189] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-09-15T19:21:35.847353] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-09-15T19:21:35.847402] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-15T19:21:35.847514] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-15T19:21:35.847559] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-09-15T19:21:36.005840] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-15T19:21:36.247010] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:21:36.459763] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-09-15T19:21:36.464545] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-15T19:21:36.484132] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-15T19:21:37.257872] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-09-15T19:21:37.748382] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T19:21:38.057943] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-09-15T19:21:38.826685] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-15T19:21:38.857827] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-09-15T19:21:39.360668] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-15T19:21:39.366331] [INFO ] [REMOTE ] MFC: Full fetch complete (55967 records). [2025-09-15T19:21:39.366451] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-09-15T19:21:39.659778] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-09-15T19:21:39.751993] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-09-15T19:21:39.752082] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-09-15T19:21:39.753030] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-09-15T19:21:39.753076] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-09-15T19:21:39.754429] [DEBUG] [LOCAL ] MFC: Trimmed 55967 records to 37624 (keeping 150 days of data) [2025-09-15T19:21:39.986290] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-15T19:21:40.025312] [DEBUG] [LOCAL ] MFC: Primary data saved (37624 records). [2025-09-15T19:21:40.025476] [INFO ] [MAIN ] MFC: Full history saved. [2025-09-15T19:21:40.026138] [INFO ] [MAIN ] Update Progress: 1336/2369 symbols completed. MFC took 19.3s. Estimated remaining: 1h 49m 30s. Rate: 9.4 symbols/min [2025-09-15T19:21:40.212312] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:21:40.220749] [DEBUG] [LOCAL ] MFSG: Loaded 3948 existing records from primary storage. [2025-09-15T19:21:40.220890] [INFO ] [MAIN ] MFSG: Loaded 3948 existing records. [2025-09-15T19:21:40.431934] [WARN ] [MAIN ] MFSG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:21:40.432231] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-09-15T19:21:40.432347] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-09-15T19:21:40.432603] [DEBUG] [LOCAL ] MFSG: Deleted primary data file. [2025-09-15T19:21:40.432700] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-09-15T19:21:40.469125] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-09-15T19:21:40.882628] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-15T19:21:40.922190] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-15T19:21:41.071180] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:21:41.257938] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-09-15T19:21:41.676883] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-15T19:21:42.057934] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-09-15T19:21:42.826521] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-15T19:21:42.857877] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-09-15T19:21:43.657880] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-09-15T19:21:44.457858] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-09-15T19:21:44.599715] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-15T19:21:44.756804] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-15T19:21:44.822594] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-15T19:21:45.257871] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-09-15T19:21:45.622325] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-15T19:21:46.057892] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-09-15T19:21:46.857896] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-09-15T19:21:47.439515] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-15T19:21:47.467794] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-15T19:21:47.657905] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-09-15T19:21:48.457922] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-09-15T19:21:48.485521] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-15T19:21:48.839301] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-15T19:21:49.257895] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-09-15T19:21:49.525808] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-15T19:21:50.057911] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-09-15T19:21:50.857900] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-09-15T19:21:51.177066] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-15T19:21:51.657904] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-09-15T19:21:51.704200] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T19:21:52.136582] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-15T19:21:52.457876] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-09-15T19:21:53.257912] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-09-15T19:21:53.913627] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T19:21:53.996251] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-15T19:21:54.057841] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-09-15T19:21:54.857896] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-09-15T19:21:55.110717] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-09-15T19:21:55.389905] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-15T19:21:55.399044] [INFO ] [REMOTE ] MFG: Full fetch complete (52780 records). [2025-09-15T19:21:55.399325] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-09-15T19:21:55.663099] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-09-15T19:21:55.809130] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-09-15T19:21:55.809288] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-09-15T19:21:55.810247] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-09-15T19:21:55.810296] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-09-15T19:21:55.813071] [DEBUG] [LOCAL ] MFG: Trimmed 52780 records to 36559 (keeping 150 days of data) [2025-09-15T19:21:56.034051] [DEBUG] [LOCAL ] MFG: Primary data saved (36559 records). [2025-09-15T19:21:56.034232] [INFO ] [MAIN ] MFG: Full history saved. [2025-09-15T19:21:56.034360] [INFO ] [MAIN ] Update Progress: 1337/2369 symbols completed. MFG took 25.0s. Estimated remaining: 1h 49m 31s. Rate: 9.4 symbols/min [2025-09-15T19:21:56.206609] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:21:56.217119] [DEBUG] [LOCAL ] MFSI: Loaded 8941 existing records from primary storage. [2025-09-15T19:21:56.217233] [INFO ] [MAIN ] MFSI: Loaded 8941 existing records. [2025-09-15T19:21:56.413240] [WARN ] [MAIN ] MFSI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:21:56.413571] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-09-15T19:21:56.413623] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-09-15T19:21:56.414048] [DEBUG] [LOCAL ] MFSI: Deleted primary data file. [2025-09-15T19:21:56.414097] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-09-15T19:21:56.462955] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-09-15T19:21:56.693716] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-15T19:21:56.809886] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:21:57.085598] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-15T19:21:57.258070] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-09-15T19:21:57.774903] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-15T19:21:58.057879] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-09-15T19:21:58.600272] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-15T19:21:58.857906] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-09-15T19:21:59.456445] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-15T19:21:59.457398] [INFO ] [REMOTE ] MFSB: Full fetch complete (1100 records). [2025-09-15T19:21:59.457470] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-09-15T19:21:59.635390] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 132 unique days, need 150 days [2025-09-15T19:21:59.635564] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:21:59.635631] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:21:59.635699] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-15T19:21:59.635763] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-15T19:21:59.635839] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-09-15T19:21:59.635895] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-09-15T19:21:59.635978] [INFO ] [MAIN ] Update Progress: 1338/2369 symbols completed. MFSB took 24.0s. Estimated remaining: 1h 49m 22s. Rate: 9.4 symbols/min [2025-09-15T19:21:59.665818] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-09-15T19:21:59.813405] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:21:59.817547] [DEBUG] [LOCAL ] MFSV: Loaded 1655 existing records from primary storage. [2025-09-15T19:21:59.817691] [INFO ] [MAIN ] MFSV: Loaded 1655 existing records. [2025-09-15T19:21:59.996835] [WARN ] [MAIN ] MFSV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:21:59.997110] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-09-15T19:21:59.997156] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-09-15T19:21:59.997355] [DEBUG] [LOCAL ] MFSV: Deleted primary data file. [2025-09-15T19:21:59.997400] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-09-15T19:22:00.365913] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:22:00.428896] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-15T19:22:00.430269] [INFO ] [REMOTE ] MFSG: Full fetch complete (4893 records). [2025-09-15T19:22:00.430345] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-09-15T19:22:00.462964] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-09-15T19:22:00.797401] [DEBUG] [VALIDATOR ] MFSG: All expected trading days are present. [2025-09-15T19:22:00.797505] [DEBUG] [VALIDATOR ] MFSG: Primary data validation passed. [2025-09-15T19:22:00.797676] [INFO ] [MAIN ] MFSG: Fetched primary data is valid. [2025-09-15T19:22:00.797726] [DEBUG] [LOCAL ] MFSG: Saving primary data. [2025-09-15T19:22:00.798126] [DEBUG] [LOCAL ] MFSG: Trimmed 4893 records to 3906 (keeping 150 days of data) [2025-09-15T19:22:00.822219] [DEBUG] [LOCAL ] MFSG: Primary data saved (3906 records). [2025-09-15T19:22:00.822303] [INFO ] [MAIN ] MFSG: Full history saved. [2025-09-15T19:22:00.822392] [INFO ] [MAIN ] Update Progress: 1339/2369 symbols completed. MFSG took 20.8s. Estimated remaining: 1h 49m 12s. Rate: 9.4 symbols/min [2025-09-15T19:22:00.998825] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:22:01.013440] [DEBUG] [LOCAL ] MG: Loaded 11650 existing records from primary storage. [2025-09-15T19:22:01.013577] [INFO ] [MAIN ] MG: Loaded 11650 existing records. [2025-09-15T19:22:01.191538] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:22:01.191833] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-09-15T19:22:01.191894] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-09-15T19:22:01.192241] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-09-15T19:22:01.192285] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-09-15T19:22:01.266166] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-09-15T19:22:01.486213] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-15T19:22:01.565884] [INFO ] [REMOTE ] MG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:22:01.673161] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-15T19:22:02.057905] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-09-15T19:22:02.423211] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-15T19:22:02.857864] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-09-15T19:22:03.316812] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-15T19:22:03.657873] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-09-15T19:22:04.062920] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-15T19:22:04.457901] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-09-15T19:22:04.762328] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-15T19:22:05.257861] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-09-15T19:22:06.057888] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-09-15T19:22:06.153707] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T19:22:06.155776] [INFO ] [REMOTE ] MFM: Full fetch complete (15242 records). [2025-09-15T19:22:06.155848] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-09-15T19:22:06.556767] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-09-15T19:22:06.556885] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-09-15T19:22:06.557275] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-09-15T19:22:06.557328] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-09-15T19:22:06.557972] [DEBUG] [LOCAL ] MFM: Trimmed 15242 records to 9588 (keeping 150 days of data) [2025-09-15T19:22:06.588257] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-15T19:22:06.625073] [DEBUG] [LOCAL ] MFM: Primary data saved (9588 records). [2025-09-15T19:22:06.625232] [INFO ] [MAIN ] MFM: Full history saved. [2025-09-15T19:22:06.625363] [INFO ] [MAIN ] Update Progress: 1340/2369 symbols completed. MFM took 31.9s. Estimated remaining: 1h 49m 5s. Rate: 9.4 symbols/min [2025-09-15T19:22:06.802475] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:22:06.846980] [DEBUG] [LOCAL ] MGA: Loaded 37796 existing records from primary storage. [2025-09-15T19:22:06.847130] [INFO ] [MAIN ] MGA: Loaded 37796 existing records. [2025-09-15T19:22:06.867752] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-09-15T19:22:07.033793] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:22:07.034138] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-09-15T19:22:07.034213] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-09-15T19:22:07.035354] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-09-15T19:22:07.035416] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-09-15T19:22:07.367090] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-15T19:22:07.400515] [INFO ] [REMOTE ] MGA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:22:07.657871] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-09-15T19:22:08.456868] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-15T19:22:08.459860] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-09-15T19:22:09.257881] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-09-15T19:22:09.508596] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-15T19:22:09.845783] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-15T19:22:10.057871] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-09-15T19:22:10.738194] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-15T19:22:10.857869] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-09-15T19:22:11.657866] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-09-15T19:22:11.905381] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-15T19:22:12.457878] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-09-15T19:22:12.845601] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-15T19:22:12.886720] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-15T19:22:13.257875] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-09-15T19:22:13.987982] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-15T19:22:14.057868] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-09-15T19:22:14.857869] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-09-15T19:22:15.058988] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-15T19:22:15.657875] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-09-15T19:22:15.687276] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-15T19:22:16.457875] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-09-15T19:22:16.632434] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-15T19:22:17.257865] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-09-15T19:22:18.032533] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-15T19:22:18.053779] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-15T19:22:18.057808] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-09-15T19:22:18.857874] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-09-15T19:22:18.970422] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-15T19:22:18.986893] [DEBUG] [REMOTE ] MGA: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-15T19:22:18.987367] [WARN ] [REMOTE ] MGA: No data returned for month 2025-04 [2025-09-15T19:22:19.657887] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-09-15T19:22:20.458052] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-09-15T19:22:20.560755] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T19:22:20.562658] [INFO ] [REMOTE ] MG: Full fetch complete (18035 records). [2025-09-15T19:22:20.562728] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-09-15T19:22:20.956836] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-09-15T19:22:20.956916] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-09-15T19:22:20.957375] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-09-15T19:22:20.957427] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-09-15T19:22:20.958105] [DEBUG] [LOCAL ] MG: Trimmed 18035 records to 11429 (keeping 150 days of data) [2025-09-15T19:22:21.032845] [DEBUG] [LOCAL ] MG: Primary data saved (11429 records). [2025-09-15T19:22:21.032991] [INFO ] [MAIN ] MG: Full history saved. [2025-09-15T19:22:21.033101] [INFO ] [MAIN ] Update Progress: 1341/2369 symbols completed. MG took 20.2s. Estimated remaining: 1h 49m 5s. Rate: 9.4 symbols/min [2025-09-15T19:22:21.213837] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:22:21.224124] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-15T19:22:21.234112] [DEBUG] [LOCAL ] MGF: Loaded 3212 existing records from primary storage. [2025-09-15T19:22:21.234285] [INFO ] [MAIN ] MGF: Loaded 3212 existing records. [2025-09-15T19:22:21.264560] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-09-15T19:22:21.422543] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:22:21.422819] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-09-15T19:22:21.422885] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-09-15T19:22:21.423152] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-09-15T19:22:21.423199] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-09-15T19:22:21.809405] [INFO ] [REMOTE ] MGF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:22:22.057937] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-09-15T19:22:22.486319] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-15T19:22:22.869836] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-09-15T19:22:22.877476] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-15T19:22:23.645457] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-15T19:22:23.657813] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-09-15T19:22:24.292042] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-15T19:22:24.294226] [INFO ] [REMOTE ] MFSI: Full fetch complete (10875 records). [2025-09-15T19:22:24.294298] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-09-15T19:22:24.469248] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-09-15T19:22:24.655972] [DEBUG] [VALIDATOR ] MFSI: All expected trading days are present. [2025-09-15T19:22:24.656050] [DEBUG] [VALIDATOR ] MFSI: Primary data validation passed. [2025-09-15T19:22:24.656334] [INFO ] [MAIN ] MFSI: Fetched primary data is valid. [2025-09-15T19:22:24.656373] [DEBUG] [LOCAL ] MFSI: Saving primary data. [2025-09-15T19:22:24.656888] [DEBUG] [LOCAL ] MFSI: Trimmed 10875 records to 8872 (keeping 150 days of data) [2025-09-15T19:22:24.713497] [DEBUG] [LOCAL ] MFSI: Primary data saved (8872 records). [2025-09-15T19:22:24.713636] [INFO ] [MAIN ] MFSI: Full history saved. [2025-09-15T19:22:24.713739] [INFO ] [MAIN ] Update Progress: 1342/2369 symbols completed. MFSI took 28.7s. Estimated remaining: 1h 48m 57s. Rate: 9.4 symbols/min [2025-09-15T19:22:24.888821] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:22:24.930310] [DEBUG] [LOCAL ] MGM: Loaded 40354 existing records from primary storage. [2025-09-15T19:22:24.930457] [INFO ] [MAIN ] MGM: Loaded 40354 existing records. [2025-09-15T19:22:25.109944] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:22:25.110241] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-09-15T19:22:25.110292] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-09-15T19:22:25.111325] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-09-15T19:22:25.111387] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-09-15T19:22:25.264621] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-09-15T19:22:25.479892] [INFO ] [REMOTE ] MGM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:22:25.862836] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-15T19:22:25.863937] [INFO ] [REMOTE ] MFSV: Full fetch complete (2369 records). [2025-09-15T19:22:25.864009] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-09-15T19:22:26.065065] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-09-15T19:22:26.231833] [DEBUG] [VALIDATOR ] MFSV: All expected trading days are present. [2025-09-15T19:22:26.232026] [DEBUG] [VALIDATOR ] MFSV: Primary data validation passed. [2025-09-15T19:22:26.232143] [INFO ] [MAIN ] MFSV: Fetched primary data is valid. [2025-09-15T19:22:26.232195] [DEBUG] [LOCAL ] MFSV: Saving primary data. [2025-09-15T19:22:26.232575] [DEBUG] [LOCAL ] MFSV: Trimmed 2369 records to 1681 (keeping 150 days of data) [2025-09-15T19:22:26.269733] [DEBUG] [LOCAL ] MFSV: Primary data saved (1681 records). [2025-09-15T19:22:26.270104] [INFO ] [MAIN ] MFSV: Full history saved. [2025-09-15T19:22:26.270460] [INFO ] [MAIN ] Update Progress: 1343/2369 symbols completed. MFSV took 26.6s. Estimated remaining: 1h 48m 46s. Rate: 9.4 symbols/min [2025-09-15T19:22:26.271368] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-15T19:22:26.453976] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:22:26.462473] [DEBUG] [LOCAL ] MGR: Loaded 4180 existing records from primary storage. [2025-09-15T19:22:26.462610] [INFO ] [MAIN ] MGR: Loaded 4180 existing records. [2025-09-15T19:22:26.639388] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:22:26.639668] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-09-15T19:22:26.639717] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-09-15T19:22:26.639964] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-09-15T19:22:26.640008] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-09-15T19:22:26.757470] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-15T19:22:26.862956] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-09-15T19:22:27.005139] [INFO ] [REMOTE ] MGR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:22:27.657879] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-09-15T19:22:28.458752] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-09-15T19:22:28.468134] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-15T19:22:28.879199] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T19:22:29.065798] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-15T19:22:29.257882] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-09-15T19:22:30.057883] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-09-15T19:22:30.857886] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-09-15T19:22:31.057028] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-15T19:22:31.258403] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-15T19:22:31.588450] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-15T19:22:31.657907] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-09-15T19:22:32.457880] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-09-15T19:22:32.992406] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-15T19:22:33.257918] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-09-15T19:22:33.600835] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-15T19:22:33.708253] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-15T19:22:34.057935] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-09-15T19:22:34.684403] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-15T19:22:34.857920] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-09-15T19:22:35.657904] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-09-15T19:22:36.457889] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-09-15T19:22:36.589255] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-15T19:22:36.595622] [INFO ] [REMOTE ] MGA: Full fetch complete (47161 records). [2025-09-15T19:22:36.595866] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-09-15T19:22:36.798899] [WARN ] [VALIDATOR ] MGA: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-15T19:22:36.799607] [FATAL] [MAIN ] MGA: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:22:36.799699] [WARN ] [MAIN ] MGA: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:22:36.799775] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-09-15T19:22:36.799843] [DEBUG] [LOCAL ] MGA: No primary data file found to delete. [2025-09-15T19:22:36.799883] [INFO ] [LOCAL ] MGA: Starting deletion of derivative data. [2025-09-15T19:22:36.800242] [DEBUG] [LOCAL ] MGA: Deleted derivative data file. [2025-09-15T19:22:36.801612] [INFO ] [MAIN ] Update Progress: 1344/2369 symbols completed. MGA took 30.2s. Estimated remaining: 1h 48m 43s. Rate: 9.4 symbols/min [2025-09-15T19:22:36.983054] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:22:36.990855] [DEBUG] [LOCAL ] MGRB: Loaded 3220 existing records from primary storage. [2025-09-15T19:22:36.990980] [INFO ] [MAIN ] MGRB: Loaded 3220 existing records. [2025-09-15T19:22:37.177706] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:22:37.183942] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-09-15T19:22:37.183858] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T19:22:37.184046] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-09-15T19:22:37.186965] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-09-15T19:22:37.187069] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-09-15T19:22:37.263236] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-09-15T19:22:37.575109] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:22:37.599907] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-15T19:22:37.990497] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-15T19:22:37.992018] [INFO ] [REMOTE ] MGF: Full fetch complete (4461 records). [2025-09-15T19:22:37.992097] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-09-15T19:22:38.064030] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-09-15T19:22:38.364746] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-09-15T19:22:38.364827] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-09-15T19:22:38.364980] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-09-15T19:22:38.365021] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-09-15T19:22:38.365409] [DEBUG] [LOCAL ] MGF: Trimmed 4461 records to 3170 (keeping 150 days of data) [2025-09-15T19:22:38.384571] [DEBUG] [LOCAL ] MGF: Primary data saved (3170 records). [2025-09-15T19:22:38.384732] [INFO ] [MAIN ] MGF: Full history saved. [2025-09-15T19:22:38.384831] [INFO ] [MAIN ] Update Progress: 1345/2369 symbols completed. MGF took 17.4s. Estimated remaining: 1h 48m 33s. Rate: 9.4 symbols/min [2025-09-15T19:22:38.554705] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:22:38.558101] [DEBUG] [LOCAL ] MGRD: Loaded 1695 existing records from primary storage. [2025-09-15T19:22:38.558192] [INFO ] [MAIN ] MGRD: Loaded 1695 existing records. [2025-09-15T19:22:38.748921] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:22:38.749160] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-09-15T19:22:38.749205] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-09-15T19:22:38.749405] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-09-15T19:22:38.749450] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-09-15T19:22:38.863002] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-09-15T19:22:39.109463] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:22:39.403731] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-15T19:22:39.657915] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-09-15T19:22:39.819049] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-15T19:22:40.080358] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-15T19:22:40.457885] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-09-15T19:22:41.257913] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-09-15T19:22:41.790315] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-15T19:22:42.057880] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-09-15T19:22:42.352099] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-15T19:22:42.426313] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-15T19:22:42.857870] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-09-15T19:22:43.398506] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-15T19:22:43.657888] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-09-15T19:22:44.457905] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-09-15T19:22:44.861533] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-15T19:22:45.257889] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-09-15T19:22:45.346142] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-15T19:22:45.849513] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-15T19:22:46.057881] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-09-15T19:22:46.673083] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-15T19:22:46.857888] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-09-15T19:22:47.409615] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-15T19:22:47.657886] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-09-15T19:22:48.081453] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-15T19:22:48.457902] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-09-15T19:22:48.995077] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-15T19:22:49.257860] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-09-15T19:22:49.695845] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-15T19:22:50.057881] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-09-15T19:22:50.467430] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-15T19:22:50.857904] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-09-15T19:22:51.345742] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-15T19:22:51.657890] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-09-15T19:22:52.222748] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-15T19:22:52.457889] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-09-15T19:22:52.890729] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-15T19:22:53.257895] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-09-15T19:22:53.707849] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-15T19:22:54.057879] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-09-15T19:22:54.522547] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-15T19:22:54.857886] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-09-15T19:22:55.402937] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-15T19:22:55.403845] [INFO ] [REMOTE ] MGRB: Full fetch complete (4551 records). [2025-09-15T19:22:55.403915] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-09-15T19:22:55.663079] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-09-15T19:22:55.768668] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-09-15T19:22:55.768756] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-09-15T19:22:55.768940] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-09-15T19:22:55.768982] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-09-15T19:22:55.769350] [DEBUG] [LOCAL ] MGRB: Trimmed 4551 records to 3036 (keeping 150 days of data) [2025-09-15T19:22:55.788284] [DEBUG] [LOCAL ] MGRB: Primary data saved (3036 records). [2025-09-15T19:22:55.788351] [INFO ] [MAIN ] MGRB: Full history saved. [2025-09-15T19:22:55.788425] [INFO ] [MAIN ] Update Progress: 1346/2369 symbols completed. MGRB took 19.0s. Estimated remaining: 1h 48m 35s. Rate: 9.4 symbols/min [2025-09-15T19:22:55.955832] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:22:55.963294] [DEBUG] [LOCAL ] MGRE: Loaded 4935 existing records from primary storage. [2025-09-15T19:22:55.963430] [INFO ] [MAIN ] MGRE: Loaded 4935 existing records. [2025-09-15T19:22:56.148403] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:22:56.148834] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-09-15T19:22:56.148888] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-09-15T19:22:56.149320] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-09-15T19:22:56.149371] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-09-15T19:22:56.401555] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-15T19:22:56.462971] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-09-15T19:22:56.522250] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:22:56.882379] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-15T19:22:57.257898] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-09-15T19:22:57.787305] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-15T19:22:58.057936] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-09-15T19:22:58.857880] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-09-15T19:22:59.657914] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-09-15T19:23:00.457969] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-09-15T19:23:00.999231] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-15T19:23:01.000376] [INFO ] [REMOTE ] MGR: Full fetch complete (6008 records). [2025-09-15T19:23:01.000448] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-09-15T19:23:01.431635] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-09-15T19:23:01.431743] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-09-15T19:23:01.431991] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-09-15T19:23:01.432031] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-09-15T19:23:01.432464] [DEBUG] [LOCAL ] MGR: Trimmed 6008 records to 4099 (keeping 150 days of data) [2025-09-15T19:23:01.458708] [DEBUG] [LOCAL ] MGR: Primary data saved (4099 records). [2025-09-15T19:23:01.458836] [INFO ] [MAIN ] MGR: Full history saved. [2025-09-15T19:23:01.458954] [INFO ] [MAIN ] Update Progress: 1347/2369 symbols completed. MGR took 35.2s. Estimated remaining: 1h 48m 28s. Rate: 9.4 symbols/min [2025-09-15T19:23:01.630515] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:23:01.672098] [DEBUG] [LOCAL ] MGY: Loaded 39371 existing records from primary storage. [2025-09-15T19:23:01.672272] [INFO ] [MAIN ] MGY: Loaded 39371 existing records. [2025-09-15T19:23:01.851901] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:23:01.852150] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-09-15T19:23:01.852196] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-09-15T19:23:01.853156] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-09-15T19:23:01.853209] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-09-15T19:23:02.226944] [INFO ] [REMOTE ] MGY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:23:02.227606] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-09-15T19:23:03.878438] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (4.22 seconds). [2025-09-15T19:23:03.880286] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-09-15T19:23:04.148214] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (5.29 seconds). [2025-09-15T19:23:04.149049] [INFO ] [REMOTE ] MGRD: Full fetch complete (2511 records). [2025-09-15T19:23:04.149117] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-09-15T19:23:04.518463] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-09-15T19:23:04.518854] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-09-15T19:23:04.519008] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-09-15T19:23:04.518785] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-15T19:23:04.520924] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-09-15T19:23:04.521506] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-09-15T19:23:04.522110] [DEBUG] [LOCAL ] MGRD: Trimmed 2511 records to 1640 (keeping 150 days of data) [2025-09-15T19:23:04.534476] [DEBUG] [LOCAL ] MGRD: Primary data saved (1640 records). [2025-09-15T19:23:04.534537] [INFO ] [MAIN ] MGRD: Full history saved. [2025-09-15T19:23:04.534619] [INFO ] [MAIN ] Update Progress: 1348/2369 symbols completed. MGRD took 26.1s. Estimated remaining: 1h 48m 20s. Rate: 9.4 symbols/min [2025-09-15T19:23:04.706862] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:23:04.707076] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-09-15T19:23:04.707118] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-09-15T19:23:04.707277] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-09-15T19:23:04.707320] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-15T19:23:04.707363] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-15T19:23:04.707397] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-09-15T19:23:05.077577] [INFO ] [REMOTE ] MH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:23:05.078033] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-02. [2025-09-15T19:23:05.102494] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (7.04 seconds). [2025-09-15T19:23:05.109324] [INFO ] [REMOTE ] MGM: Full fetch complete (58281 records). [2025-09-15T19:23:05.109503] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-09-15T19:23:05.334615] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:23:05.354790] [WARN ] [REMOTE ] MH: No data returned for month 2025-02 [2025-09-15T19:23:05.360758] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-03. [2025-09-15T19:23:05.424967] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-15T19:23:05.437327] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-09-15T19:23:05.528187] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-09-15T19:23:05.528343] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-09-15T19:23:05.529440] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-09-15T19:23:05.529512] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-09-15T19:23:05.541747] [DEBUG] [LOCAL ] MGM: Trimmed 58281 records to 39574 (keeping 150 days of data) [2025-09-15T19:23:05.561061] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (3.33 seconds). [2025-09-15T19:23:05.661212] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:23:05.664445] [WARN ] [REMOTE ] MH: No data returned for month 2025-03 [2025-09-15T19:23:05.819728] [DEBUG] [LOCAL ] MGM: Primary data saved (39574 records). [2025-09-15T19:23:05.819896] [INFO ] [MAIN ] MGM: Full history saved. [2025-09-15T19:23:05.821453] [INFO ] [MAIN ] Update Progress: 1349/2369 symbols completed. MGM took 41.1s. Estimated remaining: 1h 48m 9s. Rate: 9.4 symbols/min [2025-09-15T19:23:05.982376] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-15T19:23:06.008122] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:23:06.019426] [DEBUG] [LOCAL ] MHD: Loaded 8816 existing records from primary storage. [2025-09-15T19:23:06.019549] [INFO ] [MAIN ] MHD: Loaded 8816 existing records. [2025-09-15T19:23:06.063413] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-09-15T19:23:06.197327] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:23:06.197550] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-09-15T19:23:06.197604] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-09-15T19:23:06.198099] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-09-15T19:23:06.198148] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-09-15T19:23:06.548880] [INFO ] [REMOTE ] MHD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:23:06.579114] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-15T19:23:06.857883] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-09-15T19:23:07.515272] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-15T19:23:07.657889] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-04. [2025-09-15T19:23:07.873814] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:23:07.874137] [WARN ] [REMOTE ] MH: No data returned for month 2025-04 [2025-09-15T19:23:08.457880] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-09-15T19:23:09.257866] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-09-15T19:23:09.732040] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-15T19:23:09.752883] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-15T19:23:09.754315] [INFO ] [REMOTE ] MGRE: Full fetch complete (7090 records). [2025-09-15T19:23:09.754394] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-09-15T19:23:10.072242] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-09-15T19:23:10.120759] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-09-15T19:23:10.120843] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-09-15T19:23:10.121058] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-09-15T19:23:10.121102] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-09-15T19:23:10.121544] [DEBUG] [LOCAL ] MGRE: Trimmed 7090 records to 4814 (keeping 150 days of data) [2025-09-15T19:23:10.152227] [DEBUG] [LOCAL ] MGRE: Primary data saved (4814 records). [2025-09-15T19:23:10.152389] [INFO ] [MAIN ] MGRE: Full history saved. [2025-09-15T19:23:10.152512] [INFO ] [MAIN ] Update Progress: 1350/2369 symbols completed. MGRE took 14.4s. Estimated remaining: 1h 48m 1s. Rate: 9.4 symbols/min [2025-09-15T19:23:10.327798] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:23:10.337924] [DEBUG] [LOCAL ] MHF: Loaded 6860 existing records from primary storage. [2025-09-15T19:23:10.338071] [INFO ] [MAIN ] MHF: Loaded 6860 existing records. [2025-09-15T19:23:10.517250] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:23:10.517615] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-09-15T19:23:10.517685] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-09-15T19:23:10.518061] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-09-15T19:23:10.518121] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-09-15T19:23:10.863061] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-05. [2025-09-15T19:23:10.891901] [INFO ] [REMOTE ] MHF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:23:11.103140] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:23:11.103514] [WARN ] [REMOTE ] MH: No data returned for month 2025-05 [2025-09-15T19:23:11.657891] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-09-15T19:23:11.936366] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-15T19:23:12.214996] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-15T19:23:12.457928] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-09-15T19:23:13.257880] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-09-15T19:23:13.345264] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-15T19:23:14.057932] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-09-15T19:23:14.677286] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-15T19:23:14.713537] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T19:23:14.857833] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-09-15T19:23:15.657921] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-06. [2025-09-15T19:23:15.838147] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:23:15.838450] [WARN ] [REMOTE ] MH: No data returned for month 2025-06 [2025-09-15T19:23:16.238154] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-15T19:23:16.457895] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-07. [2025-09-15T19:23:17.257906] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-09-15T19:23:17.325667] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-15T19:23:17.834049] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-15T19:23:18.057933] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-08. [2025-09-15T19:23:18.857892] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-09-15T19:23:19.346197] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-15T19:23:19.657914] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-09. [2025-09-15T19:23:20.136866] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-15T19:23:20.457915] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-09-15T19:23:20.545112] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-15T19:23:20.549075] [INFO ] [REMOTE ] MH: Full fetch complete (10504 records). [2025-09-15T19:23:20.549149] [DEBUG] [VALIDATOR ] MH: Validating primary data. [2025-09-15T19:23:20.733279] [WARN ] [VALIDATOR ] MH: Validation failed - insufficient historical data. Have 37 unique days, need 150 days [2025-09-15T19:23:20.733595] [FATAL] [MAIN ] MH: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:23:20.733666] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:23:20.733732] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-15T19:23:20.733801] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-15T19:23:20.733847] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-09-15T19:23:20.733889] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-09-15T19:23:20.733963] [INFO ] [MAIN ] Update Progress: 1351/2369 symbols completed. MH took 16.2s. Estimated remaining: 1h 47m 58s. Rate: 9.4 symbols/min [2025-09-15T19:23:20.912061] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:23:20.945320] [DEBUG] [LOCAL ] MHK: Loaded 31851 existing records from primary storage. [2025-09-15T19:23:20.945466] [INFO ] [MAIN ] MHK: Loaded 31851 existing records. [2025-09-15T19:23:21.121243] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:23:21.121497] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-09-15T19:23:21.121543] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-09-15T19:23:21.122253] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-09-15T19:23:21.122301] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-09-15T19:23:21.265742] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-09-15T19:23:21.488684] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-15T19:23:21.492987] [INFO ] [REMOTE ] MHK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:23:22.057874] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-09-15T19:23:22.502276] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-15T19:23:22.648011] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-15T19:23:22.857870] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-09-15T19:23:23.366318] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-15T19:23:23.657893] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-09-15T19:23:24.457883] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-09-15T19:23:25.134980] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-15T19:23:25.257891] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-09-15T19:23:25.285317] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-15T19:23:25.291351] [INFO ] [REMOTE ] MGY: Full fetch complete (56982 records). [2025-09-15T19:23:25.291468] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-09-15T19:23:25.679700] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-09-15T19:23:25.679817] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-09-15T19:23:25.681034] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-09-15T19:23:25.681089] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-09-15T19:23:25.682775] [DEBUG] [LOCAL ] MGY: Trimmed 56982 records to 38628 (keeping 150 days of data) [2025-09-15T19:23:25.924524] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-15T19:23:25.957443] [DEBUG] [LOCAL ] MGY: Primary data saved (38628 records). [2025-09-15T19:23:25.957712] [INFO ] [MAIN ] MGY: Full history saved. [2025-09-15T19:23:25.957854] [INFO ] [MAIN ] Update Progress: 1352/2369 symbols completed. MGY took 24.5s. Estimated remaining: 1h 47m 51s. Rate: 9.4 symbols/min [2025-09-15T19:23:26.063539] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-09-15T19:23:26.143111] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:23:26.143384] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-09-15T19:23:26.143426] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-09-15T19:23:26.143609] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-09-15T19:23:26.143679] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-15T19:23:26.143727] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-15T19:23:26.143764] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-09-15T19:23:26.578155] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:23:26.765373] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-15T19:23:26.857946] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-09-15T19:23:27.333636] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-15T19:23:27.657923] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-09-15T19:23:28.255265] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-15T19:23:28.457882] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-09-15T19:23:28.762730] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-15T19:23:29.257886] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-09-15T19:23:29.501750] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-09-15T19:23:30.057871] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-09-15T19:23:30.461307] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-15T19:23:30.857874] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-09-15T19:23:31.588497] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-15T19:23:31.657890] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-09-15T19:23:32.342433] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T19:23:32.457879] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-09-15T19:23:33.258232] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-09-15T19:23:33.259441] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-15T19:23:33.262992] [INFO ] [REMOTE ] MHF: Full fetch complete (9333 records). [2025-09-15T19:23:33.263152] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-09-15T19:23:33.616989] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-09-15T19:23:33.617079] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-09-15T19:23:33.617301] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-09-15T19:23:33.617339] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-09-15T19:23:33.617780] [DEBUG] [LOCAL ] MHF: Trimmed 9333 records to 6816 (keeping 150 days of data) [2025-09-15T19:23:33.657904] [DEBUG] [LOCAL ] MHF: Primary data saved (6816 records). [2025-09-15T19:23:33.658020] [INFO ] [MAIN ] MHF: Full history saved. [2025-09-15T19:23:33.658110] [INFO ] [MAIN ] Update Progress: 1353/2369 symbols completed. MHF took 23.5s. Estimated remaining: 1h 47m 46s. Rate: 9.4 symbols/min [2025-09-15T19:23:33.829698] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:23:33.837102] [DEBUG] [LOCAL ] MHN: Loaded 5568 existing records from primary storage. [2025-09-15T19:23:33.837228] [INFO ] [MAIN ] MHN: Loaded 5568 existing records. [2025-09-15T19:23:34.014012] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:23:34.014340] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-09-15T19:23:34.014402] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-09-15T19:23:34.014834] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-09-15T19:23:34.014906] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-09-15T19:23:34.069588] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-09-15T19:23:34.313900] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T19:23:34.371762] [INFO ] [REMOTE ] MHD: Full fetch complete (13251 records). [2025-09-15T19:23:34.375830] [INFO ] [REMOTE ] MHN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:23:34.376165] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-09-15T19:23:34.629946] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-15T19:23:34.751318] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-09-15T19:23:34.751408] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-09-15T19:23:34.751742] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-09-15T19:23:34.751786] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-09-15T19:23:34.752293] [DEBUG] [LOCAL ] MHD: Trimmed 13251 records to 8707 (keeping 150 days of data) [2025-09-15T19:23:34.806408] [DEBUG] [LOCAL ] MHD: Primary data saved (8707 records). [2025-09-15T19:23:34.806526] [INFO ] [MAIN ] MHD: Full history saved. [2025-09-15T19:23:34.806608] [INFO ] [MAIN ] Update Progress: 1354/2369 symbols completed. MHD took 29.0s. Estimated remaining: 1h 47m 35s. Rate: 9.4 symbols/min [2025-09-15T19:23:34.863022] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-09-15T19:23:34.981430] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:23:35.000614] [DEBUG] [LOCAL ] MHO: Loaded 17950 existing records from primary storage. [2025-09-15T19:23:35.000761] [INFO ] [MAIN ] MHO: Loaded 17950 existing records. [2025-09-15T19:23:35.177967] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:23:35.178212] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-09-15T19:23:35.178258] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-09-15T19:23:35.178774] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-09-15T19:23:35.178837] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-09-15T19:23:35.280305] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-15T19:23:35.549118] [INFO ] [REMOTE ] MHO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:23:35.657901] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-09-15T19:23:36.234782] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-15T19:23:36.457910] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-09-15T19:23:37.257906] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-09-15T19:23:37.591343] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-15T19:23:37.923097] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-15T19:23:38.057851] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-09-15T19:23:38.857865] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-09-15T19:23:39.046940] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-15T19:23:39.079719] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-09-15T19:23:39.657919] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-09-15T19:23:39.961393] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-15T19:23:40.457916] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-09-15T19:23:41.257924] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-09-15T19:23:41.619354] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-15T19:23:41.620242] [INFO ] [REMOTE ] MHLA: Full fetch complete (1152 records). [2025-09-15T19:23:41.621382] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-15T19:23:41.621450] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-09-15T19:23:41.812637] [WARN ] [VALIDATOR ] MHLA: Validation failed - insufficient historical data. Have 133 unique days, need 150 days [2025-09-15T19:23:41.812881] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:23:41.812931] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:23:41.812975] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-15T19:23:41.813033] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-15T19:23:41.813077] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-09-15T19:23:41.813120] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-09-15T19:23:41.813177] [INFO ] [MAIN ] Update Progress: 1355/2369 symbols completed. MHLA took 15.9s. Estimated remaining: 1h 47m 30s. Rate: 9.4 symbols/min [2025-09-15T19:23:41.979857] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:23:41.980012] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-09-15T19:23:41.980057] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-09-15T19:23:41.980175] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-09-15T19:23:41.980215] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-15T19:23:41.980256] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-15T19:23:41.980289] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-09-15T19:23:42.063026] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-09-15T19:23:42.340556] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:23:42.844552] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-15T19:23:42.857828] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-09-15T19:23:43.573901] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-15T19:23:43.657892] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-09-15T19:23:44.457900] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-09-15T19:23:45.004681] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-15T19:23:45.255956] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-15T19:23:45.259272] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-09-15T19:23:46.057890] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-02. [2025-09-15T19:23:46.248885] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:23:46.249189] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-02 [2025-09-15T19:23:46.301573] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-15T19:23:46.857863] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-09-15T19:23:47.657879] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-09-15T19:23:47.988963] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-15T19:23:48.107369] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-15T19:23:48.457924] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-09-15T19:23:49.257951] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-03. [2025-09-15T19:23:49.440377] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:23:49.440722] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-03 [2025-09-15T19:23:49.637850] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-15T19:23:50.057888] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-04. [2025-09-15T19:23:50.236071] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:23:50.236443] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-04 [2025-09-15T19:23:50.857868] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-05. [2025-09-15T19:23:51.067137] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:23:51.067496] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-05 [2025-09-15T19:23:51.657881] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-09-15T19:23:52.457876] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-09-15T19:23:52.888791] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-15T19:23:52.944505] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-15T19:23:53.257916] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-06. [2025-09-15T19:23:53.460802] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:23:53.461200] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-06 [2025-09-15T19:23:54.057896] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-09-15T19:23:54.857872] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-09-15T19:23:55.658522] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-09-15T19:23:55.664800] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T19:23:55.897965] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-15T19:23:56.429821] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-15T19:23:56.431381] [INFO ] [REMOTE ] MHN: Full fetch complete (8329 records). [2025-09-15T19:23:56.431451] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-09-15T19:23:56.463092] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-07. [2025-09-15T19:23:56.763957] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:23:56.787660] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-07 [2025-09-15T19:23:56.794293] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-09-15T19:23:56.794854] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-09-15T19:23:56.795089] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-09-15T19:23:56.795139] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-09-15T19:23:56.795582] [DEBUG] [LOCAL ] MHN: Trimmed 8329 records to 5513 (keeping 150 days of data) [2025-09-15T19:23:56.829679] [DEBUG] [LOCAL ] MHN: Primary data saved (5513 records). [2025-09-15T19:23:56.829758] [INFO ] [MAIN ] MHN: Full history saved. [2025-09-15T19:23:56.829836] [INFO ] [MAIN ] Update Progress: 1356/2369 symbols completed. MHN took 23.2s. Estimated remaining: 1h 47m 30s. Rate: 9.4 symbols/min [2025-09-15T19:23:57.011348] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:23:57.026425] [DEBUG] [LOCAL ] MIN: Loaded 10736 existing records from primary storage. [2025-09-15T19:23:57.026541] [INFO ] [MAIN ] MIN: Loaded 10736 existing records. [2025-09-15T19:23:57.199521] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:23:57.199766] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-09-15T19:23:57.199813] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-09-15T19:23:57.200296] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-09-15T19:23:57.200344] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-09-15T19:23:57.263023] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-09-15T19:23:57.548445] [INFO ] [REMOTE ] MIN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:23:58.057905] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-09-15T19:23:58.114718] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-15T19:23:58.662454] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-15T19:23:58.857878] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-09-15T19:23:59.657868] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-08. [2025-09-15T19:24:00.114286] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T19:24:00.457876] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-09-15T19:24:00.604572] [INFO ] [REMOTE ] MIAX: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-15T19:24:01.257834] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-09-15T19:24:01.677975] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T19:24:01.901759] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-15T19:24:02.057880] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-09-15T19:24:02.857887] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-09. [2025-09-15T19:24:03.096581] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-15T19:24:03.657922] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-09-15T19:24:04.457874] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-09-15T19:24:04.967231] [INFO ] [REMOTE ] MIAX: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-15T19:24:04.972692] [INFO ] [REMOTE ] MIAX: Full fetch complete (6886 records). [2025-09-15T19:24:04.972863] [DEBUG] [VALIDATOR ] MIAX: Validating primary data. [2025-09-15T19:24:05.162244] [WARN ] [VALIDATOR ] MIAX: Validation failed - insufficient historical data. Have 22 unique days, need 150 days [2025-09-15T19:24:05.162539] [FATAL] [MAIN ] MIAX: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:24:05.162669] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:24:05.162843] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-15T19:24:05.162935] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-15T19:24:05.163018] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-09-15T19:24:05.163495] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-09-15T19:24:05.163657] [INFO ] [MAIN ] Update Progress: 1357/2369 symbols completed. MIAX took 23.4s. Estimated remaining: 1h 47m 25s. Rate: 9.4 symbols/min [2025-09-15T19:24:05.172390] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-15T19:24:05.191609] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-15T19:24:05.257814] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-09-15T19:24:06.057831] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-09-15T19:24:06.368079] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-15T19:24:06.370998] [INFO ] [REMOTE ] MHO: Full fetch complete (27018 records). [2025-09-15T19:24:06.371085] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-09-15T19:24:06.744996] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-09-15T19:24:06.745087] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-09-15T19:24:06.745966] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-09-15T19:24:06.746025] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-09-15T19:24:06.746795] [DEBUG] [LOCAL ] MHO: Trimmed 27018 records to 17637 (keeping 150 days of data) [2025-09-15T19:24:06.861208] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-09-15T19:24:06.866526] [DEBUG] [LOCAL ] MHO: Primary data saved (17637 records). [2025-09-15T19:24:06.866669] [INFO ] [MAIN ] MHO: Full history saved. [2025-09-15T19:24:06.866782] [INFO ] [MAIN ] Update Progress: 1358/2369 symbols completed. MHO took 32.1s. Estimated remaining: 1h 47m 15s. Rate: 9.4 symbols/min [2025-09-15T19:24:07.208938] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T19:24:07.216778] [INFO ] [REMOTE ] MHK: Full fetch complete (46242 records). [2025-09-15T19:24:07.216889] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-09-15T19:24:07.518527] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T19:24:07.610864] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-09-15T19:24:07.610942] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-09-15T19:24:07.611714] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-09-15T19:24:07.611759] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-09-15T19:24:07.612938] [DEBUG] [LOCAL ] MHK: Trimmed 46242 records to 31379 (keeping 150 days of data) [2025-09-15T19:24:07.671344] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-09-15T19:24:07.816918] [DEBUG] [LOCAL ] MHK: Primary data saved (31379 records). [2025-09-15T19:24:07.817094] [INFO ] [MAIN ] MHK: Full history saved. [2025-09-15T19:24:07.817197] [INFO ] [MAIN ] Update Progress: 1359/2369 symbols completed. MHK took 47.1s. Estimated remaining: 1h 47m 5s. Rate: 9.4 symbols/min [2025-09-15T19:24:08.798464] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-15T19:24:08.803834] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-09-15T19:24:09.696298] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-15T19:24:09.700770] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-09-15T19:24:10.435675] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-15T19:24:10.437388] [INFO ] [REMOTE ] MIN: Full fetch complete (13891 records). [2025-09-15T19:24:10.437457] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-09-15T19:24:10.802538] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-09-15T19:24:10.802658] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-09-15T19:24:10.803015] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-09-15T19:24:10.803078] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-09-15T19:24:10.803699] [DEBUG] [LOCAL ] MIN: Trimmed 13891 records to 10623 (keeping 150 days of data) [2025-09-15T19:24:10.871056] [DEBUG] [LOCAL ] MIN: Primary data saved (10623 records). [2025-09-15T19:24:10.871197] [INFO ] [MAIN ] MIN: Full history saved. [2025-09-15T19:24:10.871283] [INFO ] [MAIN ] Update Progress: 1360/2369 symbols completed. MIN took 14.0s. Estimated remaining: 1h 46m 56s. Rate: 9.4 symbols/min [2025-09-15T19:24:11.597970] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:24:11.578351] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:24:11.563221] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:24:11.618048] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:24:11.619534] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-09-15T19:24:11.620445] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-09-15T19:24:11.621074] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-09-15T19:24:11.621156] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-15T19:24:11.621227] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-15T19:24:11.621283] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-09-15T19:24:11.734235] [DEBUG] [LOCAL ] MITP: Loaded 1677 existing records from primary storage. [2025-09-15T19:24:11.772138] [DEBUG] [LOCAL ] MITT: Loaded 16045 existing records from primary storage. [2025-09-15T19:24:11.754023] [INFO ] [MAIN ] MITP: Loaded 1677 existing records. [2025-09-15T19:24:11.777691] [INFO ] [MAIN ] MITT: Loaded 16045 existing records. [2025-09-15T19:24:12.077151] [DEBUG] [LOCAL ] MIR: Loaded 38381 existing records from primary storage. [2025-09-15T19:24:12.101830] [INFO ] [MAIN ] MIR: Loaded 38381 existing records. [2025-09-15T19:24:12.305960] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:24:12.333254] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-09-15T19:24:12.383324] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-09-15T19:24:12.466087] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-09-15T19:24:12.482752] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-09-15T19:24:12.482677] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:24:12.606574] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-09-15T19:24:12.623709] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-09-15T19:24:12.698322] [INFO ] [REMOTE ] MITN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:24:12.720158] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-09-15T19:24:12.760666] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-09-15T19:24:12.767985] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:24:12.782390] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-09-15T19:24:12.782613] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-09-15T19:24:12.788261] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-09-15T19:24:12.848783] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-09-15T19:24:12.937249] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-09-15T19:24:13.209482] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-15T19:24:13.261307] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-09-15T19:24:13.488434] [INFO ] [REMOTE ] MITP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:24:13.512035] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-09-15T19:24:13.783134] [INFO ] [REMOTE ] MIR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:24:13.790808] [INFO ] [REMOTE ] MITT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:24:13.791396] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-09-15T19:24:13.791201] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-09-15T19:24:13.945419] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-15T19:24:14.057908] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-09-15T19:24:14.084159] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-15T19:24:14.481486] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-15T19:24:14.564225] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T19:24:14.857870] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-09-15T19:24:15.048448] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-15T19:24:15.657914] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-09-15T19:24:15.693748] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-15T19:24:16.180795] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-15T19:24:16.457881] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-09-15T19:24:17.257872] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-09-15T19:24:18.001955] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-15T19:24:18.057822] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-09-15T19:24:18.269476] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-15T19:24:18.364248] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-15T19:24:18.857866] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-09-15T19:24:19.157244] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-15T19:24:19.657858] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-09-15T19:24:19.980776] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-15T19:24:20.457872] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-09-15T19:24:20.932222] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-15T19:24:20.933005] [INFO ] [REMOTE ] MITN: Full fetch complete (1940 records). [2025-09-15T19:24:20.933073] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-09-15T19:24:21.120581] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-15T19:24:21.120936] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:24:21.120998] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:24:21.121061] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-15T19:24:21.121147] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-15T19:24:21.121188] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-09-15T19:24:21.121229] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-09-15T19:24:21.121293] [INFO ] [MAIN ] Update Progress: 1361/2369 symbols completed. MITN took 10.2s. Estimated remaining: 1h 46m 52s. Rate: 9.4 symbols/min [2025-09-15T19:24:21.266450] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-09-15T19:24:21.291372] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:24:21.301608] [DEBUG] [LOCAL ] MIY: Loaded 4348 existing records from primary storage. [2025-09-15T19:24:21.301748] [INFO ] [MAIN ] MIY: Loaded 4348 existing records. [2025-09-15T19:24:21.481059] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:24:21.481334] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-09-15T19:24:21.481382] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-09-15T19:24:21.481636] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-09-15T19:24:21.481713] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-09-15T19:24:21.843247] [INFO ] [REMOTE ] MIY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:24:22.057853] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-09-15T19:24:22.400199] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-15T19:24:22.637529] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-15T19:24:22.857872] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-09-15T19:24:23.657901] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-09-15T19:24:24.209949] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T19:24:24.457842] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-09-15T19:24:24.761041] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-15T19:24:25.033359] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-15T19:24:25.257878] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-09-15T19:24:25.673329] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-15T19:24:26.057875] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-09-15T19:24:26.683850] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-15T19:24:26.857852] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-09-15T19:24:27.657908] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-09-15T19:24:28.205793] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-15T19:24:28.467964] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-09-15T19:24:28.474808] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-15T19:24:28.995578] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-15T19:24:29.257901] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-09-15T19:24:30.057912] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-09-15T19:24:30.689683] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T19:24:30.857844] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-09-15T19:24:31.173888] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-15T19:24:31.182688] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-15T19:24:31.657887] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-09-15T19:24:32.457876] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-09-15T19:24:32.865793] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-15T19:24:32.994252] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-15T19:24:33.257931] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-09-15T19:24:34.057893] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-09-15T19:24:34.565392] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-15T19:24:34.857885] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-09-15T19:24:35.057358] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-15T19:24:35.657892] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-09-15T19:24:36.015237] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-15T19:24:36.180164] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T19:24:36.187398] [INFO ] [REMOTE ] MIR: Full fetch complete (55107 records). [2025-09-15T19:24:36.187551] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-09-15T19:24:36.468072] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-09-15T19:24:36.647436] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-09-15T19:24:36.647549] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-09-15T19:24:36.648542] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-09-15T19:24:36.648613] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-09-15T19:24:36.650068] [DEBUG] [LOCAL ] MIR: Trimmed 55107 records to 37755 (keeping 150 days of data) [2025-09-15T19:24:36.886194] [DEBUG] [LOCAL ] MIR: Primary data saved (37755 records). [2025-09-15T19:24:36.886358] [INFO ] [MAIN ] MIR: Full history saved. [2025-09-15T19:24:36.886459] [INFO ] [MAIN ] Update Progress: 1362/2369 symbols completed. MIR took 26.0s. Estimated remaining: 1h 46m 53s. Rate: 9.4 symbols/min [2025-09-15T19:24:37.056094] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:24:37.092789] [DEBUG] [LOCAL ] MKC: Loaded 39477 existing records from primary storage. [2025-09-15T19:24:37.092943] [INFO ] [MAIN ] MKC: Loaded 39477 existing records. [2025-09-15T19:24:37.267269] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-09-15T19:24:37.273658] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:24:37.273903] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-09-15T19:24:37.273974] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-09-15T19:24:37.275045] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-09-15T19:24:37.275103] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-09-15T19:24:37.611590] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-15T19:24:37.678167] [INFO ] [REMOTE ] MKC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:24:38.036682] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-15T19:24:38.057869] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-09-15T19:24:38.592285] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-15T19:24:38.857941] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-09-15T19:24:39.534219] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-15T19:24:39.657931] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-09-15T19:24:40.457925] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-09-15T19:24:40.849569] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-15T19:24:40.850321] [INFO ] [REMOTE ] MITP: Full fetch complete (2546 records). [2025-09-15T19:24:40.850389] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-09-15T19:24:41.201375] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-09-15T19:24:41.201457] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-09-15T19:24:41.201579] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-09-15T19:24:41.201618] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-09-15T19:24:41.201977] [DEBUG] [LOCAL ] MITP: Trimmed 2546 records to 1616 (keeping 150 days of data) [2025-09-15T19:24:41.213059] [DEBUG] [LOCAL ] MITP: Primary data saved (1616 records). [2025-09-15T19:24:41.213197] [INFO ] [MAIN ] MITP: Full history saved. [2025-09-15T19:24:41.213287] [INFO ] [MAIN ] Update Progress: 1363/2369 symbols completed. MITP took 30.3s. Estimated remaining: 1h 46m 45s. Rate: 9.4 symbols/min [2025-09-15T19:24:41.269041] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-09-15T19:24:41.396084] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:24:41.427294] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-15T19:24:41.460111] [DEBUG] [LOCAL ] MKL: Loaded 25665 existing records from primary storage. [2025-09-15T19:24:41.460256] [INFO ] [MAIN ] MKL: Loaded 25665 existing records. [2025-09-15T19:24:41.634946] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:24:41.635184] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-09-15T19:24:41.635230] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-09-15T19:24:41.636028] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-09-15T19:24:41.636080] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-09-15T19:24:41.917013] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-15T19:24:41.944376] [INFO ] [REMOTE ] MIY: Full fetch complete (6356 records). [2025-09-15T19:24:41.979954] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-09-15T19:24:42.002222] [INFO ] [REMOTE ] MKL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:24:42.065875] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-09-15T19:24:42.369954] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-09-15T19:24:42.370043] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-09-15T19:24:42.370239] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-09-15T19:24:42.370281] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-09-15T19:24:42.370830] [DEBUG] [LOCAL ] MIY: Trimmed 6356 records to 4318 (keeping 150 days of data) [2025-09-15T19:24:42.400116] [DEBUG] [LOCAL ] MIY: Primary data saved (4318 records). [2025-09-15T19:24:42.400266] [INFO ] [MAIN ] MIY: Full history saved. [2025-09-15T19:24:42.400354] [INFO ] [MAIN ] Update Progress: 1364/2369 symbols completed. MIY took 21.3s. Estimated remaining: 1h 46m 35s. Rate: 9.4 symbols/min [2025-09-15T19:24:42.569615] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:24:42.612367] [DEBUG] [LOCAL ] MLI: Loaded 32624 existing records from primary storage. [2025-09-15T19:24:42.612508] [INFO ] [MAIN ] MLI: Loaded 32624 existing records. [2025-09-15T19:24:42.791321] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:24:42.791683] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-09-15T19:24:42.791925] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-09-15T19:24:42.792856] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-09-15T19:24:42.792921] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-09-15T19:24:42.862971] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-09-15T19:24:43.148570] [INFO ] [REMOTE ] MLI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:24:43.601177] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-15T19:24:43.657874] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-09-15T19:24:43.856524] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T19:24:43.859157] [INFO ] [REMOTE ] MITT: Full fetch complete (25006 records). [2025-09-15T19:24:43.859267] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-09-15T19:24:44.231439] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-09-15T19:24:44.231545] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-09-15T19:24:44.232146] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-09-15T19:24:44.232195] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-09-15T19:24:44.233165] [DEBUG] [LOCAL ] MITT: Trimmed 25006 records to 15605 (keeping 150 days of data) [2025-09-15T19:24:44.327748] [DEBUG] [LOCAL ] MITT: Primary data saved (15605 records). [2025-09-15T19:24:44.327912] [INFO ] [MAIN ] MITT: Full history saved. [2025-09-15T19:24:44.328033] [INFO ] [MAIN ] Update Progress: 1365/2369 symbols completed. MITT took 33.5s. Estimated remaining: 1h 46m 25s. Rate: 9.4 symbols/min [2025-09-15T19:24:44.472091] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-09-15T19:24:44.504617] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:24:44.526230] [DEBUG] [LOCAL ] MLM: Loaded 21830 existing records from primary storage. [2025-09-15T19:24:44.526401] [INFO ] [MAIN ] MLM: Loaded 21830 existing records. [2025-09-15T19:24:44.705406] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:24:44.705689] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-09-15T19:24:44.705736] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-09-15T19:24:44.706336] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-09-15T19:24:44.706387] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-09-15T19:24:45.065935] [INFO ] [REMOTE ] MLM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:24:45.113472] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-15T19:24:45.257885] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-09-15T19:24:45.951124] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-15T19:24:46.057906] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-09-15T19:24:46.431744] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-15T19:24:46.857955] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-09-15T19:24:47.285377] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-15T19:24:47.657935] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-09-15T19:24:48.408493] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-15T19:24:48.457821] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-09-15T19:24:49.275385] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-09-15T19:24:49.295615] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-15T19:24:50.025604] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-15T19:24:50.057818] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-09-15T19:24:50.557576] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-15T19:24:50.857942] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-09-15T19:24:51.581186] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-15T19:24:51.657860] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-09-15T19:24:52.279179] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-15T19:24:52.457878] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-09-15T19:24:52.750095] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-15T19:24:53.257883] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-09-15T19:24:53.923381] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T19:24:54.057864] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-09-15T19:24:54.394480] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-15T19:24:54.857878] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-09-15T19:24:55.403389] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-15T19:24:55.657897] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-09-15T19:24:56.457911] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-09-15T19:24:56.640623] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-15T19:24:56.958809] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-15T19:24:57.257875] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-09-15T19:24:57.372437] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-15T19:24:58.057936] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-09-15T19:24:58.719988] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T19:24:58.857883] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-09-15T19:24:59.222049] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-15T19:24:59.657873] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-09-15T19:25:00.467457] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-09-15T19:25:00.492239] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-15T19:25:00.886040] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-15T19:25:01.257907] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-09-15T19:25:02.048043] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-15T19:25:02.057815] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-09-15T19:25:02.346031] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-15T19:25:02.857863] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-09-15T19:25:03.483333] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T19:25:03.488416] [INFO ] [REMOTE ] MLI: Full fetch complete (47777 records). [2025-09-15T19:25:03.488518] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-09-15T19:25:03.675619] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-09-15T19:25:03.878831] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-09-15T19:25:03.879051] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-09-15T19:25:03.880323] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-09-15T19:25:03.880423] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-09-15T19:25:03.882326] [DEBUG] [LOCAL ] MLI: Trimmed 47777 records to 31883 (keeping 150 days of data) [2025-09-15T19:25:04.015563] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-15T19:25:04.141837] [DEBUG] [LOCAL ] MLI: Primary data saved (31883 records). [2025-09-15T19:25:04.142065] [INFO ] [MAIN ] MLI: Full history saved. [2025-09-15T19:25:04.142228] [INFO ] [MAIN ] Update Progress: 1366/2369 symbols completed. MLI took 21.7s. Estimated remaining: 1h 46m 29s. Rate: 9.4 symbols/min [2025-09-15T19:25:04.328514] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:25:04.350827] [DEBUG] [LOCAL ] MLNK: Loaded 19044 existing records from primary storage. [2025-09-15T19:25:04.351020] [INFO ] [MAIN ] MLNK: Loaded 19044 existing records. [2025-09-15T19:25:04.460552] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-09-15T19:25:04.567802] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:25:04.568588] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-09-15T19:25:04.568692] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-09-15T19:25:04.569479] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-09-15T19:25:04.569551] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-09-15T19:25:04.958636] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:25:05.257973] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-09-15T19:25:05.586279] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-15T19:25:05.609731] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-15T19:25:05.614671] [INFO ] [REMOTE ] MLM: Full fetch complete (35361 records). [2025-09-15T19:25:05.614837] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-09-15T19:25:06.007674] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-09-15T19:25:06.007823] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-09-15T19:25:06.008630] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-09-15T19:25:06.008971] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-09-15T19:25:06.027492] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T19:25:06.032368] [DEBUG] [LOCAL ] MLM: Trimmed 35361 records to 21374 (keeping 150 days of data) [2025-09-15T19:25:06.091383] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-09-15T19:25:06.172977] [DEBUG] [LOCAL ] MLM: Primary data saved (21374 records). [2025-09-15T19:25:06.173114] [INFO ] [MAIN ] MLM: Full history saved. [2025-09-15T19:25:06.173242] [INFO ] [MAIN ] Update Progress: 1367/2369 symbols completed. MLM took 21.8s. Estimated remaining: 1h 46m 19s. Rate: 9.4 symbols/min [2025-09-15T19:25:06.344984] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:25:06.349061] [DEBUG] [LOCAL ] MLP: Loaded 2297 existing records from primary storage. [2025-09-15T19:25:06.349143] [INFO ] [MAIN ] MLP: Loaded 2297 existing records. [2025-09-15T19:25:06.526168] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:25:06.526448] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-09-15T19:25:06.526497] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-09-15T19:25:06.526735] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-09-15T19:25:06.526782] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-09-15T19:25:06.879776] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-09-15T19:25:06.885004] [INFO ] [REMOTE ] MLP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:25:07.190309] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-15T19:25:07.657915] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-09-15T19:25:08.035512] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-15T19:25:08.039274] [INFO ] [REMOTE ] MKL: Full fetch complete (37674 records). [2025-09-15T19:25:08.039369] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-09-15T19:25:08.415703] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-09-15T19:25:08.415904] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-09-15T19:25:08.416718] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-09-15T19:25:08.416769] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-09-15T19:25:08.417699] [DEBUG] [LOCAL ] MKL: Trimmed 37674 records to 25028 (keeping 150 days of data) [2025-09-15T19:25:08.475084] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-09-15T19:25:08.581292] [DEBUG] [LOCAL ] MKL: Primary data saved (25028 records). [2025-09-15T19:25:08.581415] [INFO ] [MAIN ] MKL: Full history saved. [2025-09-15T19:25:08.581500] [INFO ] [MAIN ] Update Progress: 1368/2369 symbols completed. MKL took 27.4s. Estimated remaining: 1h 46m 10s. Rate: 9.4 symbols/min [2025-09-15T19:25:08.753259] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:25:08.769251] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-15T19:25:08.780892] [DEBUG] [LOCAL ] MLR: Loaded 8560 existing records from primary storage. [2025-09-15T19:25:08.780993] [INFO ] [MAIN ] MLR: Loaded 8560 existing records. [2025-09-15T19:25:08.938460] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-15T19:25:08.958632] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:25:08.958861] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-09-15T19:25:08.958905] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-09-15T19:25:08.959390] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-09-15T19:25:08.959439] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-09-15T19:25:09.262943] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-09-15T19:25:09.312853] [INFO ] [REMOTE ] MLR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:25:10.057879] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-09-15T19:25:10.124377] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T19:25:10.857871] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-09-15T19:25:11.443586] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-15T19:25:11.653488] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-15T19:25:11.661299] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-09-15T19:25:12.457933] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-09-15T19:25:13.092678] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-15T19:25:13.101345] [INFO ] [REMOTE ] MKC: Full fetch complete (57004 records). [2025-09-15T19:25:13.101461] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-09-15T19:25:13.267539] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-09-15T19:25:13.502062] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-09-15T19:25:13.510531] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-09-15T19:25:13.512283] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-09-15T19:25:13.513175] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-09-15T19:25:13.512995] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-15T19:25:13.520005] [DEBUG] [LOCAL ] MKC: Trimmed 57004 records to 38721 (keeping 150 days of data) [2025-09-15T19:25:13.778063] [DEBUG] [LOCAL ] MKC: Primary data saved (38721 records). [2025-09-15T19:25:13.778285] [INFO ] [MAIN ] MKC: Full history saved. [2025-09-15T19:25:13.778414] [INFO ] [MAIN ] Update Progress: 1369/2369 symbols completed. MKC took 36.9s. Estimated remaining: 1h 46m 3s. Rate: 9.4 symbols/min [2025-09-15T19:25:13.963103] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:25:13.996740] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-15T19:25:14.014425] [DEBUG] [LOCAL ] MMC: Loaded 38946 existing records from primary storage. [2025-09-15T19:25:14.014591] [INFO ] [MAIN ] MMC: Loaded 38946 existing records. [2025-09-15T19:25:14.066831] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-09-15T19:25:14.196495] [WARN ] [MAIN ] MMC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:25:14.196778] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-09-15T19:25:14.196831] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-09-15T19:25:14.197890] [DEBUG] [LOCAL ] MMC: Deleted primary data file. [2025-09-15T19:25:14.197944] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-09-15T19:25:14.487460] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-15T19:25:14.565803] [INFO ] [REMOTE ] MMC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:25:14.857920] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-09-15T19:25:15.397719] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-15T19:25:15.657896] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-09-15T19:25:16.457845] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-09-15T19:25:16.902397] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-15T19:25:17.257898] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-09-15T19:25:17.381578] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-15T19:25:17.821910] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-15T19:25:18.057860] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-09-15T19:25:18.499516] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-15T19:25:18.857893] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-09-15T19:25:19.314022] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-15T19:25:19.657872] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-09-15T19:25:20.457924] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-09-15T19:25:20.918790] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T19:25:20.922461] [INFO ] [REMOTE ] MLNK: Full fetch complete (27087 records). [2025-09-15T19:25:20.922568] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-09-15T19:25:21.263190] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-09-15T19:25:21.296151] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-09-15T19:25:21.303378] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-09-15T19:25:21.304320] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-09-15T19:25:21.305866] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-09-15T19:25:21.307163] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-15T19:25:21.311148] [DEBUG] [LOCAL ] MLNK: Trimmed 27087 records to 18738 (keeping 150 days of data) [2025-09-15T19:25:21.426584] [DEBUG] [LOCAL ] MLNK: Primary data saved (18738 records). [2025-09-15T19:25:21.426768] [INFO ] [MAIN ] MLNK: Full history saved. [2025-09-15T19:25:21.426889] [INFO ] [MAIN ] Update Progress: 1370/2369 symbols completed. MLNK took 17.3s. Estimated remaining: 1h 45m 57s. Rate: 9.4 symbols/min [2025-09-15T19:25:21.593697] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:25:21.603001] [DEBUG] [LOCAL ] MMD: Loaded 7956 existing records from primary storage. [2025-09-15T19:25:21.603109] [INFO ] [MAIN ] MMD: Loaded 7956 existing records. [2025-09-15T19:25:21.707621] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-15T19:25:21.791603] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:25:21.791917] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-09-15T19:25:21.791965] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-09-15T19:25:21.792344] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-09-15T19:25:21.792391] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-09-15T19:25:22.063164] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-09-15T19:25:22.159740] [INFO ] [REMOTE ] MMD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:25:22.621171] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-15T19:25:22.857874] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-09-15T19:25:23.657933] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-09-15T19:25:23.722981] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-15T19:25:24.405067] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-15T19:25:24.457941] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-09-15T19:25:25.257939] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-09-15T19:25:25.289111] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-15T19:25:26.057922] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-09-15T19:25:26.645020] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-15T19:25:26.709960] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-15T19:25:26.711050] [INFO ] [REMOTE ] MLP: Full fetch complete (3224 records). [2025-09-15T19:25:26.711119] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-09-15T19:25:26.866744] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-09-15T19:25:27.091528] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-09-15T19:25:27.091669] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-09-15T19:25:27.091864] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-09-15T19:25:27.091938] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-09-15T19:25:27.092747] [DEBUG] [LOCAL ] MLP: Trimmed 3224 records to 2255 (keeping 150 days of data) [2025-09-15T19:25:27.114154] [DEBUG] [LOCAL ] MLP: Primary data saved (2255 records). [2025-09-15T19:25:27.114372] [INFO ] [MAIN ] MLP: Full history saved. [2025-09-15T19:25:27.114505] [INFO ] [MAIN ] Update Progress: 1371/2369 symbols completed. MLP took 20.9s. Estimated remaining: 1h 45m 50s. Rate: 9.4 symbols/min [2025-09-15T19:25:27.294045] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:25:27.305888] [DEBUG] [LOCAL ] MMI: Loaded 11093 existing records from primary storage. [2025-09-15T19:25:27.306028] [INFO ] [MAIN ] MMI: Loaded 11093 existing records. [2025-09-15T19:25:27.481482] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:25:27.481779] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-09-15T19:25:27.481827] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-09-15T19:25:27.482254] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-09-15T19:25:27.482300] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-09-15T19:25:27.668111] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-09-15T19:25:27.838758] [INFO ] [REMOTE ] MMI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:25:28.457900] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-09-15T19:25:28.593032] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-15T19:25:28.655335] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-15T19:25:29.230821] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T19:25:29.257848] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-09-15T19:25:29.974238] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-15T19:25:30.057938] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-09-15T19:25:30.857944] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-09-15T19:25:31.051420] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-15T19:25:31.657942] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-09-15T19:25:32.474873] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-09-15T19:25:32.503210] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-15T19:25:32.547963] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-15T19:25:33.174899] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-15T19:25:33.257896] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-09-15T19:25:33.889515] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-15T19:25:34.057915] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-09-15T19:25:34.857899] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-09-15T19:25:35.532658] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T19:25:35.657187] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-15T19:25:35.659372] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-09-15T19:25:35.660804] [INFO ] [REMOTE ] MLR: Full fetch complete (14415 records). [2025-09-15T19:25:35.660899] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-09-15T19:25:36.037175] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-09-15T19:25:36.037260] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-09-15T19:25:36.037664] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-09-15T19:25:36.037725] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-09-15T19:25:36.038294] [DEBUG] [LOCAL ] MLR: Trimmed 14415 records to 8409 (keeping 150 days of data) [2025-09-15T19:25:36.093135] [DEBUG] [LOCAL ] MLR: Primary data saved (8409 records). [2025-09-15T19:25:36.093287] [INFO ] [MAIN ] MLR: Full history saved. [2025-09-15T19:25:36.093386] [INFO ] [MAIN ] Update Progress: 1372/2369 symbols completed. MLR took 27.5s. Estimated remaining: 1h 45m 46s. Rate: 9.4 symbols/min [2025-09-15T19:25:36.277269] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:25:36.277514] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-09-15T19:25:36.277557] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-09-15T19:25:36.277710] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-09-15T19:25:36.277754] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-15T19:25:36.277799] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-15T19:25:36.277834] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-09-15T19:25:36.462083] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-09-15T19:25:36.651057] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:25:36.710380] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-15T19:25:37.257908] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-09-15T19:25:37.525586] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-09-15T19:25:38.057858] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-09-15T19:25:38.170006] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-15T19:25:38.778550] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-15T19:25:38.857891] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-09-15T19:25:39.657912] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-09-15T19:25:40.266876] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-15T19:25:40.457909] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-09-15T19:25:40.669507] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-15T19:25:41.087993] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-15T19:25:41.257885] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-09-15T19:25:42.057857] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-09-15T19:25:42.705459] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-15T19:25:42.707243] [INFO ] [REMOTE ] MMD: Full fetch complete (12312 records). [2025-09-15T19:25:42.707321] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-09-15T19:25:42.863092] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-09-15T19:25:43.112012] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-09-15T19:25:43.112182] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-09-15T19:25:43.112687] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-09-15T19:25:43.112752] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-09-15T19:25:43.113585] [DEBUG] [LOCAL ] MMD: Trimmed 12312 records to 7760 (keeping 150 days of data) [2025-09-15T19:25:43.227116] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-15T19:25:43.249145] [DEBUG] [LOCAL ] MMD: Primary data saved (7760 records). [2025-09-15T19:25:43.249748] [INFO ] [MAIN ] MMD: Full history saved. [2025-09-15T19:25:43.249847] [INFO ] [MAIN ] Update Progress: 1373/2369 symbols completed. MMD took 21.8s. Estimated remaining: 1h 45m 40s. Rate: 9.4 symbols/min [2025-09-15T19:25:43.418940] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:25:43.460309] [DEBUG] [LOCAL ] MMM: Loaded 40041 existing records from primary storage. [2025-09-15T19:25:43.460455] [INFO ] [MAIN ] MMM: Loaded 40041 existing records. [2025-09-15T19:25:43.638623] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:25:43.638927] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-09-15T19:25:43.638973] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-09-15T19:25:43.639957] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-09-15T19:25:43.640015] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-09-15T19:25:43.663033] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-09-15T19:25:43.997896] [INFO ] [REMOTE ] MMM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:25:44.004260] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-15T19:25:44.457934] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-09-15T19:25:45.246511] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-15T19:25:45.252409] [INFO ] [REMOTE ] MMC: Full fetch complete (56269 records). [2025-09-15T19:25:45.252562] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-09-15T19:25:45.264423] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-09-15T19:25:45.650678] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-09-15T19:25:45.650765] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-09-15T19:25:45.651610] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-09-15T19:25:45.651671] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-09-15T19:25:45.652849] [DEBUG] [LOCAL ] MMC: Trimmed 56269 records to 38185 (keeping 150 days of data) [2025-09-15T19:25:45.767815] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-15T19:25:45.912567] [DEBUG] [LOCAL ] MMC: Primary data saved (38185 records). [2025-09-15T19:25:45.912755] [INFO ] [MAIN ] MMC: Full history saved. [2025-09-15T19:25:45.912891] [INFO ] [MAIN ] Update Progress: 1374/2369 symbols completed. MMC took 32.1s. Estimated remaining: 1h 45m 31s. Rate: 9.4 symbols/min [2025-09-15T19:25:46.061726] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-09-15T19:25:46.087133] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:25:46.118549] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-15T19:25:46.149014] [DEBUG] [LOCAL ] MMS: Loaded 24667 existing records from primary storage. [2025-09-15T19:25:46.149154] [INFO ] [MAIN ] MMS: Loaded 24667 existing records. [2025-09-15T19:25:46.325822] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:25:46.326088] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-09-15T19:25:46.326171] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-09-15T19:25:46.326898] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-09-15T19:25:46.326949] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-09-15T19:25:46.698158] [INFO ] [REMOTE ] MMS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:25:46.709467] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-15T19:25:46.857850] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-09-15T19:25:47.657905] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-09-15T19:25:48.039507] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-15T19:25:48.057921] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-15T19:25:48.457886] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-09-15T19:25:49.257940] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-09-15T19:25:49.664752] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-15T19:25:49.801053] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-15T19:25:50.057883] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-09-15T19:25:50.857902] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-09-15T19:25:51.584829] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-15T19:25:51.657872] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-09-15T19:25:51.742600] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-15T19:25:52.457914] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-09-15T19:25:52.762775] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-15T19:25:53.257907] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-09-15T19:25:53.337759] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-15T19:25:53.339748] [INFO ] [REMOTE ] MMI: Full fetch complete (16825 records). [2025-09-15T19:25:53.339828] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-09-15T19:25:53.710381] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-09-15T19:25:53.710461] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-09-15T19:25:53.710882] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-09-15T19:25:53.710927] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-09-15T19:25:53.711505] [DEBUG] [LOCAL ] MMI: Trimmed 16825 records to 10782 (keeping 150 days of data) [2025-09-15T19:25:53.781222] [DEBUG] [LOCAL ] MMI: Primary data saved (10782 records). [2025-09-15T19:25:53.781374] [INFO ] [MAIN ] MMI: Full history saved. [2025-09-15T19:25:53.781461] [INFO ] [MAIN ] Update Progress: 1375/2369 symbols completed. MMI took 26.7s. Estimated remaining: 1h 45m 26s. Rate: 9.4 symbols/min [2025-09-15T19:25:53.955348] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:25:53.965697] [DEBUG] [LOCAL ] MMT: Loaded 7827 existing records from primary storage. [2025-09-15T19:25:53.965795] [INFO ] [MAIN ] MMT: Loaded 7827 existing records. [2025-09-15T19:25:54.063060] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-09-15T19:25:54.142046] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:25:54.142282] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-09-15T19:25:54.142352] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-09-15T19:25:54.142752] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-09-15T19:25:54.142847] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-09-15T19:25:54.507462] [INFO ] [REMOTE ] MMT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:25:54.857832] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-09-15T19:25:55.064749] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-15T19:25:55.142494] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-15T19:25:55.622451] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-15T19:25:55.657877] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-09-15T19:25:56.457933] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-09-15T19:25:56.829368] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-15T19:25:57.038202] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-15T19:25:57.257890] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-09-15T19:25:58.057901] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-09-15T19:25:58.333001] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-15T19:25:58.856826] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-15T19:25:58.864373] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-09-15T19:25:59.279191] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-15T19:25:59.657891] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-09-15T19:26:00.457860] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-09-15T19:26:00.599759] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-15T19:26:00.915529] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-15T19:26:00.916294] [INFO ] [REMOTE ] MMKT: Full fetch complete (1529 records). [2025-09-15T19:26:00.916362] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-09-15T19:26:01.095806] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-15T19:26:01.096025] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:26:01.096092] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:26:01.096136] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-15T19:26:01.096205] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-15T19:26:01.096242] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-09-15T19:26:01.096282] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-09-15T19:26:01.096354] [INFO ] [MAIN ] Update Progress: 1376/2369 symbols completed. MMKT took 25.0s. Estimated remaining: 1h 45m 20s. Rate: 9.4 symbols/min [2025-09-15T19:26:01.274121] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-09-15T19:26:01.313962] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:26:01.331955] [DEBUG] [LOCAL ] MMU: Loaded 12504 existing records from primary storage. [2025-09-15T19:26:01.332145] [INFO ] [MAIN ] MMU: Loaded 12504 existing records. [2025-09-15T19:26:01.527999] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:26:01.528287] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-09-15T19:26:01.528336] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-09-15T19:26:01.528779] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-09-15T19:26:01.528826] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-09-15T19:26:01.933488] [INFO ] [REMOTE ] MMU: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:26:02.057913] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-09-15T19:26:02.857924] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-09-15T19:26:03.083777] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-15T19:26:03.657918] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-09-15T19:26:04.457946] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-09-15T19:26:05.481506] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-15T19:26:05.485867] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-09-15T19:26:06.553190] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-15T19:26:06.558250] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-09-15T19:26:07.419973] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T19:26:07.423415] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-09-15T19:26:08.287778] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-15T19:26:08.293500] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-09-15T19:26:09.256754] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-15T19:26:09.260396] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-09-15T19:26:16.560769] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (12.90 seconds). [2025-09-15T19:26:16.563873] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-09-15T19:26:17.190560] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (7.93 seconds). [2025-09-15T19:26:17.195734] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-09-15T19:26:17.325602] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-15T19:26:17.328695] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-09-15T19:26:17.643599] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (16.37 seconds). [2025-09-15T19:26:17.655326] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-09-15T19:26:17.926790] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-15T19:26:17.929380] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-09-15T19:26:18.062551] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-15T19:26:18.065026] [INFO ] [REMOTE ] MMU: Full fetch complete (18734 records). [2025-09-15T19:26:18.065106] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-09-15T19:26:18.444746] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-09-15T19:26:18.444840] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-09-15T19:26:18.445237] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-09-15T19:26:18.445277] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-09-15T19:26:18.445877] [DEBUG] [LOCAL ] MMU: Trimmed 18734 records to 12090 (keeping 150 days of data) [2025-09-15T19:26:18.535330] [DEBUG] [LOCAL ] MMU: Primary data saved (12090 records). [2025-09-15T19:26:18.535703] [INFO ] [MAIN ] MMU: Full history saved. [2025-09-15T19:26:18.535903] [INFO ] [MAIN ] Update Progress: 1377/2369 symbols completed. MMU took 17.4s. Estimated remaining: 1h 45m 22s. Rate: 9.4 symbols/min [2025-09-15T19:26:18.727850] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:26:18.748241] [DEBUG] [LOCAL ] MNR: Loaded 18817 existing records from primary storage. [2025-09-15T19:26:18.748413] [INFO ] [MAIN ] MNR: Loaded 18817 existing records. [2025-09-15T19:26:18.925481] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:26:18.935764] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-09-15T19:26:18.936381] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-09-15T19:26:18.936758] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-15T19:26:18.940511] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-09-15T19:26:18.940692] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-09-15T19:26:18.941377] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-09-15T19:26:19.300213] [INFO ] [REMOTE ] MNR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:26:19.300692] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-09-15T19:26:19.639234] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-15T19:26:19.650712] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-09-15T19:26:19.834690] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-15T19:26:19.837611] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-09-15T19:26:20.268316] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-15T19:26:20.275271] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-09-15T19:26:20.568824] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-15T19:26:20.570115] [INFO ] [REMOTE ] MMT: Full fetch complete (12396 records). [2025-09-15T19:26:20.570186] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-09-15T19:26:20.924694] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-09-15T19:26:20.924780] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-09-15T19:26:20.925071] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-09-15T19:26:20.925110] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-09-15T19:26:20.925554] [DEBUG] [LOCAL ] MMT: Trimmed 12396 records to 7640 (keeping 150 days of data) [2025-09-15T19:26:20.975308] [DEBUG] [LOCAL ] MMT: Primary data saved (7640 records). [2025-09-15T19:26:20.975436] [INFO ] [MAIN ] MMT: Full history saved. [2025-09-15T19:26:20.975529] [INFO ] [MAIN ] Update Progress: 1378/2369 symbols completed. MMT took 27.2s. Estimated remaining: 1h 45m 13s. Rate: 9.4 symbols/min [2025-09-15T19:26:21.142628] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:26:21.183457] [DEBUG] [LOCAL ] MNSO: Loaded 32461 existing records from primary storage. [2025-09-15T19:26:21.183600] [INFO ] [MAIN ] MNSO: Loaded 32461 existing records. [2025-09-15T19:26:21.362954] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:26:21.363557] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-09-15T19:26:21.363781] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-09-15T19:26:21.364782] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-09-15T19:26:21.364889] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-09-15T19:26:21.440879] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-15T19:26:21.491291] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-09-15T19:26:21.767093] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-15T19:26:21.786496] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:26:21.798509] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-09-15T19:26:21.800297] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-09-15T19:26:22.604568] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-15T19:26:22.609698] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-09-15T19:26:23.341495] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-15T19:26:23.350373] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-09-15T19:26:23.478812] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T19:26:23.502441] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (20.64 seconds). [2025-09-15T19:26:23.511561] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-09-15T19:26:23.512542] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-09-15T19:26:23.540884] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-15T19:26:23.550837] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-09-15T19:26:24.809956] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-15T19:26:24.815144] [INFO ] [REMOTE ] MMS: Full fetch complete (37752 records). [2025-09-15T19:26:24.815339] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-09-15T19:26:25.199364] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-15T19:26:25.271987] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-09-15T19:26:25.416453] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-09-15T19:26:25.416594] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-09-15T19:26:25.418358] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-09-15T19:26:25.418445] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-09-15T19:26:25.420314] [DEBUG] [LOCAL ] MMS: Trimmed 37752 records to 24361 (keeping 150 days of data) [2025-09-15T19:26:25.595712] [DEBUG] [LOCAL ] MMS: Primary data saved (24361 records). [2025-09-15T19:26:25.595981] [INFO ] [MAIN ] MMS: Full history saved. [2025-09-15T19:26:25.596082] [INFO ] [MAIN ] Update Progress: 1379/2369 symbols completed. MMS took 39.7s. Estimated remaining: 1h 45m 5s. Rate: 9.4 symbols/min [2025-09-15T19:26:25.779229] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:26:25.779507] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-09-15T19:26:25.779739] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-09-15T19:26:25.789894] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-09-15T19:26:25.805922] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-15T19:26:25.806137] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-15T19:26:25.806200] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-09-15T19:26:25.875787] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-09-15T19:26:25.927103] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-09-15T19:26:26.180183] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:26:26.180524] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-02. [2025-09-15T19:26:26.198751] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (2.69 seconds). [2025-09-15T19:26:26.205038] [INFO ] [REMOTE ] MMM: Full fetch complete (57929 records). [2025-09-15T19:26:26.205197] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-09-15T19:26:26.499865] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:26:26.500473] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-02 [2025-09-15T19:26:26.511280] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-03. [2025-09-15T19:26:26.593625] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-09-15T19:26:26.593735] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-09-15T19:26:26.594765] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-09-15T19:26:26.594826] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-09-15T19:26:26.596168] [DEBUG] [LOCAL ] MMM: Trimmed 57929 records to 39261 (keeping 150 days of data) [2025-09-15T19:26:26.853055] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:26:26.853183] [DEBUG] [LOCAL ] MMM: Primary data saved (39261 records). [2025-09-15T19:26:26.853436] [INFO ] [MAIN ] MMM: Full history saved. [2025-09-15T19:26:26.856358] [INFO ] [MAIN ] Update Progress: 1380/2369 symbols completed. MMM took 43.6s. Estimated remaining: 1h 44m 55s. Rate: 9.4 symbols/min [2025-09-15T19:26:26.856488] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-03 [2025-09-15T19:26:26.920220] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-04. [2025-09-15T19:26:27.032373] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:26:27.052529] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-15T19:26:27.102306] [DEBUG] [LOCAL ] MO: Loaded 40494 existing records from primary storage. [2025-09-15T19:26:27.102508] [INFO ] [MAIN ] MO: Loaded 40494 existing records. [2025-09-15T19:26:27.179596] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:26:27.207056] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-04 [2025-09-15T19:26:27.286252] [WARN ] [MAIN ] MO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:26:27.286493] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-09-15T19:26:27.286546] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-15T19:26:27.287623] [DEBUG] [LOCAL ] MO: Deleted primary data file. [2025-09-15T19:26:27.287715] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-09-15T19:26:27.646059] [INFO ] [REMOTE ] MO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:26:27.657834] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-09-15T19:26:27.790335] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-15T19:26:28.457879] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-09-15T19:26:29.205524] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-15T19:26:29.257815] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-09-15T19:26:30.057895] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-09-15T19:26:30.203487] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-15T19:26:30.857889] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-05. [2025-09-15T19:26:31.068468] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-15T19:26:31.099112] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-15T19:26:31.325162] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-15T19:26:31.657882] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-09-15T19:26:32.457902] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-06. [2025-09-15T19:26:32.650442] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T19:26:32.653270] [INFO ] [REMOTE ] MNR: Full fetch complete (28024 records). [2025-09-15T19:26:32.653344] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-09-15T19:26:33.017977] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-09-15T19:26:33.018066] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-09-15T19:26:33.018661] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-09-15T19:26:33.018704] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-09-15T19:26:33.019534] [DEBUG] [LOCAL ] MNR: Trimmed 28024 records to 18562 (keeping 150 days of data) [2025-09-15T19:26:33.136942] [DEBUG] [LOCAL ] MNR: Primary data saved (18562 records). [2025-09-15T19:26:33.137085] [INFO ] [MAIN ] MNR: Full history saved. [2025-09-15T19:26:33.137168] [INFO ] [MAIN ] Update Progress: 1381/2369 symbols completed. MNR took 14.6s. Estimated remaining: 1h 44m 48s. Rate: 9.4 symbols/min [2025-09-15T19:26:33.263087] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-09-15T19:26:33.316588] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:26:33.353717] [DEBUG] [LOCAL ] MOD: Loaded 33695 existing records from primary storage. [2025-09-15T19:26:33.354337] [INFO ] [MAIN ] MOD: Loaded 33695 existing records. [2025-09-15T19:26:33.539282] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:26:33.539551] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-09-15T19:26:33.539602] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-09-15T19:26:33.540389] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-09-15T19:26:33.540438] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-09-15T19:26:33.914113] [INFO ] [REMOTE ] MOD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:26:33.937332] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-15T19:26:34.057884] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-09-15T19:26:34.447878] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-15T19:26:34.857904] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-09-15T19:26:35.657911] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-07. [2025-09-15T19:26:35.769606] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-15T19:26:36.457910] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-09-15T19:26:36.909672] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-15T19:26:36.952240] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-15T19:26:37.257892] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-09-15T19:26:37.957212] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-15T19:26:38.057918] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-09-15T19:26:38.532483] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-15T19:26:38.857869] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-08. [2025-09-15T19:26:39.579410] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T19:26:39.657825] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-09-15T19:26:40.225176] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-15T19:26:40.457875] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-09. [2025-09-15T19:26:41.043807] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-15T19:26:41.048802] [INFO ] [REMOTE ] MNSO: Full fetch complete (48527 records). [2025-09-15T19:26:41.048974] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-09-15T19:26:41.267889] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-09-15T19:26:41.441504] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-09-15T19:26:41.441587] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-09-15T19:26:41.442373] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-09-15T19:26:41.442419] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-09-15T19:26:41.443415] [DEBUG] [LOCAL ] MNSO: Trimmed 48527 records to 31713 (keeping 150 days of data) [2025-09-15T19:26:41.646141] [DEBUG] [LOCAL ] MNSO: Primary data saved (31713 records). [2025-09-15T19:26:41.646295] [INFO ] [MAIN ] MNSO: Full history saved. [2025-09-15T19:26:41.646907] [INFO ] [MAIN ] Update Progress: 1382/2369 symbols completed. MNSO took 20.7s. Estimated remaining: 1h 44m 44s. Rate: 9.4 symbols/min [2025-09-15T19:26:41.826435] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:26:41.840503] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-15T19:26:41.845808] [INFO ] [REMOTE ] MNTN: Full fetch complete (22988 records). [2025-09-15T19:26:41.845950] [DEBUG] [VALIDATOR ] MNTN: Validating primary data. [2025-09-15T19:26:42.043506] [WARN ] [VALIDATOR ] MNTN: Validation failed - insufficient historical data. Have 79 unique days, need 150 days [2025-09-15T19:26:42.058286] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-09-15T19:26:42.058156] [FATAL] [MAIN ] MNTN: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:26:42.058551] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:26:42.059598] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-15T19:26:42.060874] [DEBUG] [LOCAL ] MODG: Loaded 38900 existing records from primary storage. [2025-09-15T19:26:42.061025] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-15T19:26:42.061214] [INFO ] [MAIN ] MODG: Loaded 38900 existing records. [2025-09-15T19:26:42.061281] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-09-15T19:26:42.118617] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-09-15T19:26:42.164486] [INFO ] [MAIN ] Update Progress: 1383/2369 symbols completed. MNTN took 16.6s. Estimated remaining: 1h 44m 33s. Rate: 9.4 symbols/min [2025-09-15T19:26:42.396442] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:26:42.421277] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:26:42.421455] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-09-15T19:26:42.421784] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-09-15T19:26:42.422599] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-09-15T19:26:42.422705] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-09-15T19:26:42.731898] [DEBUG] [LOCAL ] MOH: Loaded 32109 existing records from primary storage. [2025-09-15T19:26:42.742573] [INFO ] [MAIN ] MOH: Loaded 32109 existing records. [2025-09-15T19:26:42.872767] [INFO ] [REMOTE ] MODG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:26:42.895821] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-09-15T19:26:43.011016] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:26:43.011426] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-09-15T19:26:43.011511] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-09-15T19:26:43.061519] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-09-15T19:26:43.079214] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-09-15T19:26:43.155072] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-15T19:26:43.467480] [INFO ] [REMOTE ] MOH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:26:43.657879] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-09-15T19:26:44.119721] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-15T19:26:44.457961] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-09-15T19:26:44.665287] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-15T19:26:45.135490] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T19:26:45.257958] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-09-15T19:26:45.917914] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-15T19:26:46.057873] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-09-15T19:26:46.692803] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-15T19:26:46.857937] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-09-15T19:26:47.244519] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-15T19:26:47.657874] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-09-15T19:26:48.266884] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-15T19:26:48.457939] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-09-15T19:26:49.257938] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-09-15T19:26:49.737660] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-15T19:26:49.855496] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-15T19:26:50.057940] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-09-15T19:26:50.857895] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-09-15T19:26:51.008177] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-15T19:26:51.180709] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-15T19:26:51.185573] [INFO ] [REMOTE ] MOD: Full fetch complete (50372 records). [2025-09-15T19:26:51.185690] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-09-15T19:26:51.576835] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-09-15T19:26:51.576923] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-09-15T19:26:51.577766] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-09-15T19:26:51.577811] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-09-15T19:26:51.578910] [DEBUG] [LOCAL ] MOD: Trimmed 50372 records to 32979 (keeping 150 days of data) [2025-09-15T19:26:51.671192] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-09-15T19:26:51.787844] [DEBUG] [LOCAL ] MOD: Primary data saved (32979 records). [2025-09-15T19:26:51.787992] [INFO ] [MAIN ] MOD: Full history saved. [2025-09-15T19:26:51.788085] [INFO ] [MAIN ] Update Progress: 1384/2369 symbols completed. MOD took 18.7s. Estimated remaining: 1h 44m 29s. Rate: 9.4 symbols/min [2025-09-15T19:26:51.959533] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:26:51.997659] [DEBUG] [LOCAL ] MOS: Loaded 40283 existing records from primary storage. [2025-09-15T19:26:51.997809] [INFO ] [MAIN ] MOS: Loaded 40283 existing records. [2025-09-15T19:26:52.173931] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:26:52.174227] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-09-15T19:26:52.174273] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-09-15T19:26:52.175312] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-09-15T19:26:52.175363] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-09-15T19:26:52.462978] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-09-15T19:26:52.524414] [INFO ] [REMOTE ] MOS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:26:52.705749] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-15T19:26:52.956843] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-15T19:26:53.257937] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-09-15T19:26:53.804684] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T19:26:54.057950] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-09-15T19:26:54.865970] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-09-15T19:26:54.869024] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-15T19:26:55.664482] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-09-15T19:26:55.669888] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-15T19:26:56.033230] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-15T19:26:56.457873] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-09-15T19:26:57.257925] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-09-15T19:26:57.509406] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-15T19:26:57.517472] [INFO ] [REMOTE ] MO: Full fetch complete (58433 records). [2025-09-15T19:26:57.517692] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-09-15T19:26:57.926118] [DEBUG] [VALIDATOR ] MO: All expected trading days are present. [2025-09-15T19:26:57.926251] [DEBUG] [VALIDATOR ] MO: Primary data validation passed. [2025-09-15T19:26:57.927133] [INFO ] [MAIN ] MO: Fetched primary data is valid. [2025-09-15T19:26:57.927181] [DEBUG] [LOCAL ] MO: Saving primary data. [2025-09-15T19:26:57.928452] [DEBUG] [LOCAL ] MO: Trimmed 58433 records to 39714 (keeping 150 days of data) [2025-09-15T19:26:58.057886] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-09-15T19:26:58.193194] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-15T19:26:58.226923] [DEBUG] [LOCAL ] MO: Primary data saved (39714 records). [2025-09-15T19:26:58.227078] [INFO ] [MAIN ] MO: Full history saved. [2025-09-15T19:26:58.228273] [INFO ] [MAIN ] Update Progress: 1385/2369 symbols completed. MO took 31.4s. Estimated remaining: 1h 44m 23s. Rate: 9.4 symbols/min [2025-09-15T19:26:58.398404] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:26:58.416426] [DEBUG] [LOCAL ] MOV: Loaded 15954 existing records from primary storage. [2025-09-15T19:26:58.416564] [INFO ] [MAIN ] MOV: Loaded 15954 existing records. [2025-09-15T19:26:58.593229] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:26:58.593448] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-09-15T19:26:58.593494] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-09-15T19:26:58.594018] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-09-15T19:26:58.594069] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-09-15T19:26:58.866275] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-09-15T19:26:58.956557] [INFO ] [REMOTE ] MOV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:26:59.082356] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-15T19:26:59.156999] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-15T19:26:59.657931] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-09-15T19:27:00.438971] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-15T19:27:00.460800] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-09-15T19:27:00.462689] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-15T19:27:01.257873] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-09-15T19:27:02.057885] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-09-15T19:27:02.857886] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-09-15T19:27:03.762320] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (3.30 seconds). [2025-09-15T19:27:03.773394] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-09-15T19:27:04.362452] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (3.10 seconds). [2025-09-15T19:27:04.457875] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-09-15T19:27:05.031769] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-15T19:27:05.257888] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-09-15T19:27:05.288042] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-15T19:27:05.515659] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (3.46 seconds). [2025-09-15T19:27:05.972444] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-15T19:27:06.057848] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-09-15T19:27:06.244055] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-15T19:27:06.857876] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-09-15T19:27:07.569987] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-15T19:27:07.657884] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-09-15T19:27:07.853881] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-15T19:27:08.457872] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-09-15T19:27:09.252405] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-15T19:27:09.263207] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-09-15T19:27:09.715809] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-15T19:27:09.721584] [INFO ] [REMOTE ] MODG: Full fetch complete (56156 records). [2025-09-15T19:27:09.721740] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-09-15T19:27:10.063040] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-09-15T19:27:10.103885] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-09-15T19:27:10.104015] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-09-15T19:27:10.108678] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-09-15T19:27:10.109000] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-09-15T19:27:10.116682] [DEBUG] [LOCAL ] MODG: Trimmed 56156 records to 38153 (keeping 150 days of data) [2025-09-15T19:27:10.125608] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-15T19:27:10.352050] [DEBUG] [LOCAL ] MODG: Primary data saved (38153 records). [2025-09-15T19:27:10.352200] [INFO ] [MAIN ] MODG: Full history saved. [2025-09-15T19:27:10.352821] [INFO ] [MAIN ] Update Progress: 1386/2369 symbols completed. MODG took 28.7s. Estimated remaining: 1h 44m 20s. Rate: 9.4 symbols/min [2025-09-15T19:27:10.521770] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:27:10.564435] [DEBUG] [LOCAL ] MP: Loaded 40484 existing records from primary storage. [2025-09-15T19:27:10.564617] [INFO ] [MAIN ] MP: Loaded 40484 existing records. [2025-09-15T19:27:10.740006] [WARN ] [MAIN ] MP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:27:10.740293] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-09-15T19:27:10.740339] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-09-15T19:27:10.741260] [DEBUG] [LOCAL ] MP: Deleted primary data file. [2025-09-15T19:27:10.741313] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-09-15T19:27:10.863065] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-09-15T19:27:11.100943] [INFO ] [REMOTE ] MP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:27:11.657880] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-09-15T19:27:11.906318] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-15T19:27:12.457839] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-09-15T19:27:12.540960] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-15T19:27:12.546255] [INFO ] [REMOTE ] MOH: Full fetch complete (45402 records). [2025-09-15T19:27:12.546346] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-09-15T19:27:12.928994] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-09-15T19:27:12.929114] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-09-15T19:27:12.930473] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-09-15T19:27:12.930522] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-09-15T19:27:12.931925] [DEBUG] [LOCAL ] MOH: Trimmed 45402 records to 31518 (keeping 150 days of data) [2025-09-15T19:27:13.134271] [DEBUG] [LOCAL ] MOH: Primary data saved (31518 records). [2025-09-15T19:27:13.134546] [INFO ] [MAIN ] MOH: Full history saved. [2025-09-15T19:27:13.134706] [INFO ] [MAIN ] Update Progress: 1387/2369 symbols completed. MOH took 31.0s. Estimated remaining: 1h 44m 12s. Rate: 9.4 symbols/min [2025-09-15T19:27:13.260276] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-09-15T19:27:13.311588] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:27:13.342850] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-15T19:27:13.357630] [DEBUG] [LOCAL ] MPA: Loaded 4029 existing records from primary storage. [2025-09-15T19:27:13.357754] [INFO ] [MAIN ] MPA: Loaded 4029 existing records. [2025-09-15T19:27:13.533493] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:27:13.533753] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-09-15T19:27:13.533801] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-09-15T19:27:13.534029] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-09-15T19:27:13.534076] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-09-15T19:27:13.879789] [INFO ] [REMOTE ] MPA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:27:14.057864] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-09-15T19:27:14.723768] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-15T19:27:14.857822] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-09-15T19:27:15.092567] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-15T19:27:15.095393] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-15T19:27:15.657924] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-09-15T19:27:16.322260] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T19:27:16.457923] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-09-15T19:27:16.937740] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-15T19:27:17.200441] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-15T19:27:17.209533] [INFO ] [REMOTE ] MOS: Full fetch complete (58190 records). [2025-09-15T19:27:17.209774] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-09-15T19:27:17.262964] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-09-15T19:27:17.813044] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-09-15T19:27:17.813201] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-09-15T19:27:17.814847] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-09-15T19:27:17.814996] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-09-15T19:27:17.816976] [DEBUG] [LOCAL ] MOS: Trimmed 58190 records to 39505 (keeping 150 days of data) [2025-09-15T19:27:18.085867] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-09-15T19:27:18.160234] [DEBUG] [LOCAL ] MOS: Primary data saved (39505 records). [2025-09-15T19:27:18.160409] [INFO ] [MAIN ] MOS: Full history saved. [2025-09-15T19:27:18.161251] [INFO ] [MAIN ] Update Progress: 1388/2369 symbols completed. MOS took 26.4s. Estimated remaining: 1h 44m 4s. Rate: 9.4 symbols/min [2025-09-15T19:27:18.375922] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:27:18.421443] [DEBUG] [LOCAL ] MPC: Loaded 39139 existing records from primary storage. [2025-09-15T19:27:18.421599] [INFO ] [MAIN ] MPC: Loaded 39139 existing records. [2025-09-15T19:27:18.607217] [WARN ] [MAIN ] MPC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:27:18.607487] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-09-15T19:27:18.607534] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-09-15T19:27:18.608327] [DEBUG] [LOCAL ] MPC: Deleted primary data file. [2025-09-15T19:27:18.608379] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-09-15T19:27:18.864782] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-09-15T19:27:18.970289] [INFO ] [REMOTE ] MPC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:27:18.981246] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T19:27:18.985934] [INFO ] [REMOTE ] MOV: Full fetch complete (24068 records). [2025-09-15T19:27:18.986227] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-09-15T19:27:19.411007] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-15T19:27:19.411335] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-09-15T19:27:19.411673] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-09-15T19:27:19.428239] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-09-15T19:27:19.429062] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-09-15T19:27:19.430291] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-15T19:27:19.434810] [DEBUG] [LOCAL ] MOV: Trimmed 24068 records to 15399 (keeping 150 days of data) [2025-09-15T19:27:19.535474] [DEBUG] [LOCAL ] MOV: Primary data saved (15399 records). [2025-09-15T19:27:19.535654] [INFO ] [MAIN ] MOV: Full history saved. [2025-09-15T19:27:19.535791] [INFO ] [MAIN ] Update Progress: 1389/2369 symbols completed. MOV took 21.3s. Estimated remaining: 1h 43m 54s. Rate: 9.4 symbols/min [2025-09-15T19:27:19.663063] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-09-15T19:27:19.717143] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:27:19.761212] [DEBUG] [LOCAL ] MPLX: Loaded 37896 existing records from primary storage. [2025-09-15T19:27:19.761365] [INFO ] [MAIN ] MPLX: Loaded 37896 existing records. [2025-09-15T19:27:19.936974] [WARN ] [MAIN ] MPLX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:27:19.937243] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-09-15T19:27:19.937290] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-09-15T19:27:19.938154] [DEBUG] [LOCAL ] MPLX: Deleted primary data file. [2025-09-15T19:27:19.938205] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-09-15T19:27:20.281886] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-15T19:27:20.306701] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:27:20.457873] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-09-15T19:27:21.257934] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-09-15T19:27:21.841655] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-15T19:27:22.057915] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-09-15T19:27:22.664572] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T19:27:22.687424] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-15T19:27:22.857929] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-09-15T19:27:23.657922] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-09-15T19:27:24.457928] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-09-15T19:27:24.642400] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-15T19:27:25.257900] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-09-15T19:27:25.397929] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-15T19:27:25.747304] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-15T19:27:26.057896] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-09-15T19:27:26.566204] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-15T19:27:26.857934] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-09-15T19:27:27.385144] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-15T19:27:27.657880] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-09-15T19:27:27.737476] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-15T19:27:28.457909] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-09-15T19:27:29.234420] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-15T19:27:29.257811] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-09-15T19:27:30.057873] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-09-15T19:27:30.603809] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-15T19:27:30.605316] [INFO ] [REMOTE ] MPA: Full fetch complete (5663 records). [2025-09-15T19:27:30.607499] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-15T19:27:30.618197] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-09-15T19:27:30.828162] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-15T19:27:30.862912] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-09-15T19:27:31.039182] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-09-15T19:27:31.039261] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-09-15T19:27:31.039419] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-09-15T19:27:31.039457] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-09-15T19:27:31.039859] [DEBUG] [LOCAL ] MPA: Trimmed 5663 records to 3946 (keeping 150 days of data) [2025-09-15T19:27:31.064473] [DEBUG] [LOCAL ] MPA: Primary data saved (3946 records). [2025-09-15T19:27:31.064550] [INFO ] [MAIN ] MPA: Full history saved. [2025-09-15T19:27:31.064626] [INFO ] [MAIN ] Update Progress: 1390/2369 symbols completed. MPA took 17.9s. Estimated remaining: 1h 43m 52s. Rate: 9.4 symbols/min [2025-09-15T19:27:31.232448] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:27:31.237696] [DEBUG] [LOCAL ] MPV: Loaded 3390 existing records from primary storage. [2025-09-15T19:27:31.237788] [INFO ] [MAIN ] MPV: Loaded 3390 existing records. [2025-09-15T19:27:31.422098] [WARN ] [MAIN ] MPV: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:27:31.422407] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-09-15T19:27:31.422459] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-09-15T19:27:31.422734] [DEBUG] [LOCAL ] MPV: Deleted primary data file. [2025-09-15T19:27:31.422784] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-09-15T19:27:31.667966] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-09-15T19:27:31.781129] [INFO ] [REMOTE ] MPV: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:27:32.457856] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-09-15T19:27:32.522281] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-15T19:27:33.257943] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-09-15T19:27:33.782539] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-15T19:27:33.977138] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-15T19:27:34.057862] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-09-15T19:27:34.857992] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-09-15T19:27:35.070355] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-15T19:27:35.300359] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-15T19:27:35.657864] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-09-15T19:27:35.710757] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-15T19:27:36.221860] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-15T19:27:36.457861] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-09-15T19:27:37.257905] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-09-15T19:27:37.771005] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-15T19:27:38.057865] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-09-15T19:27:38.208799] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-15T19:27:38.857906] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-09-15T19:27:39.603733] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-15T19:27:39.657887] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-09-15T19:27:40.257055] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-15T19:27:40.457938] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-09-15T19:27:40.714911] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-15T19:27:40.720591] [INFO ] [REMOTE ] MPLX: Full fetch complete (55407 records). [2025-09-15T19:27:40.720728] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-09-15T19:27:41.107681] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present. [2025-09-15T19:27:41.107857] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed. [2025-09-15T19:27:41.108882] [INFO ] [MAIN ] MPLX: Fetched primary data is valid. [2025-09-15T19:27:41.108954] [DEBUG] [LOCAL ] MPLX: Saving primary data. [2025-09-15T19:27:41.116377] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-15T19:27:41.119456] [DEBUG] [LOCAL ] MPLX: Trimmed 55407 records to 37164 (keeping 150 days of data) [2025-09-15T19:27:41.290371] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-09-15T19:27:41.352733] [DEBUG] [LOCAL ] MPLX: Primary data saved (37164 records). [2025-09-15T19:27:41.352862] [INFO ] [MAIN ] MPLX: Full history saved. [2025-09-15T19:27:41.353906] [INFO ] [MAIN ] Update Progress: 1391/2369 symbols completed. MPLX took 21.8s. Estimated remaining: 1h 43m 48s. Rate: 9.4 symbols/min [2025-09-15T19:27:41.521892] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:27:41.562071] [DEBUG] [LOCAL ] MPW: Loaded 40288 existing records from primary storage. [2025-09-15T19:27:41.562214] [INFO ] [MAIN ] MPW: Loaded 40288 existing records. [2025-09-15T19:27:41.748743] [WARN ] [MAIN ] MPW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:27:41.749062] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-09-15T19:27:41.749124] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-09-15T19:27:41.749956] [DEBUG] [LOCAL ] MPW: Deleted primary data file. [2025-09-15T19:27:41.750024] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-09-15T19:27:42.062952] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-09-15T19:27:42.143926] [INFO ] [REMOTE ] MPW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:27:42.529988] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-15T19:27:42.857887] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-09-15T19:27:43.067184] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-15T19:27:43.657909] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-09-15T19:27:44.131971] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-15T19:27:44.457877] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-09-15T19:27:44.557264] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-15T19:27:45.257875] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-09-15T19:27:46.057899] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-09-15T19:27:46.453448] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-15T19:27:46.843846] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-15T19:27:46.857825] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-09-15T19:27:47.411511] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-15T19:27:47.417322] [INFO ] [REMOTE ] MPC: Full fetch complete (56784 records). [2025-09-15T19:27:47.417432] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-09-15T19:27:47.663708] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-09-15T19:27:47.817153] [DEBUG] [VALIDATOR ] MPC: All expected trading days are present. [2025-09-15T19:27:47.817256] [DEBUG] [VALIDATOR ] MPC: Primary data validation passed. [2025-09-15T19:27:47.818177] [INFO ] [MAIN ] MPC: Fetched primary data is valid. [2025-09-15T19:27:47.818235] [DEBUG] [LOCAL ] MPC: Saving primary data. [2025-09-15T19:27:47.819532] [DEBUG] [LOCAL ] MPC: Trimmed 56784 records to 38350 (keeping 150 days of data) [2025-09-15T19:27:48.073704] [DEBUG] [LOCAL ] MPC: Primary data saved (38350 records). [2025-09-15T19:27:48.073881] [INFO ] [MAIN ] MPC: Full history saved. [2025-09-15T19:27:48.074870] [INFO ] [MAIN ] Update Progress: 1392/2369 symbols completed. MPC took 29.9s. Estimated remaining: 1h 43m 42s. Rate: 9.4 symbols/min [2025-09-15T19:27:48.247290] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:27:48.251966] [DEBUG] [LOCAL ] MPX: Loaded 2890 existing records from primary storage. [2025-09-15T19:27:48.252049] [INFO ] [MAIN ] MPX: Loaded 2890 existing records. [2025-09-15T19:27:48.434139] [WARN ] [MAIN ] MPX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:27:48.434549] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-09-15T19:27:48.434608] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-09-15T19:27:48.434914] [DEBUG] [LOCAL ] MPX: Deleted primary data file. [2025-09-15T19:27:48.434966] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-09-15T19:27:48.469045] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-09-15T19:27:48.803143] [INFO ] [REMOTE ] MPX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:27:48.841559] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-15T19:27:48.939696] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-15T19:27:48.941598] [INFO ] [REMOTE ] MPV: Full fetch complete (5855 records). [2025-09-15T19:27:48.941712] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-09-15T19:27:49.270528] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-09-15T19:27:49.310484] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-09-15T19:27:49.310566] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-09-15T19:27:49.310755] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-09-15T19:27:49.310800] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-09-15T19:27:49.311234] [DEBUG] [LOCAL ] MPV: Trimmed 5855 records to 3301 (keeping 150 days of data) [2025-09-15T19:27:49.334472] [DEBUG] [LOCAL ] MPV: Primary data saved (3301 records). [2025-09-15T19:27:49.334625] [INFO ] [MAIN ] MPV: Full history saved. [2025-09-15T19:27:49.334758] [INFO ] [MAIN ] Update Progress: 1393/2369 symbols completed. MPV took 18.3s. Estimated remaining: 1h 43m 32s. Rate: 9.4 symbols/min [2025-09-15T19:27:49.503227] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:27:49.510523] [DEBUG] [LOCAL ] MQT: Loaded 5655 existing records from primary storage. [2025-09-15T19:27:49.510612] [INFO ] [MAIN ] MQT: Loaded 5655 existing records. [2025-09-15T19:27:49.684798] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:27:49.685054] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-09-15T19:27:49.685101] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-09-15T19:27:49.685376] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-09-15T19:27:49.685422] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-09-15T19:27:50.034954] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-15T19:27:50.056909] [INFO ] [REMOTE ] MQT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:27:50.059203] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-09-15T19:27:50.151322] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-09-15T19:27:50.531619] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-15T19:27:50.857902] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-09-15T19:27:51.484282] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-15T19:27:51.657890] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-09-15T19:27:52.132862] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-15T19:27:52.457866] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-09-15T19:27:53.185198] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-15T19:27:53.257837] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-09-15T19:27:54.057885] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-09-15T19:27:54.857886] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-09-15T19:27:55.441604] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-15T19:27:55.545685] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-15T19:27:55.573523] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-15T19:27:55.580519] [INFO ] [REMOTE ] MP: Full fetch complete (58249 records). [2025-09-15T19:27:55.580656] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-09-15T19:27:55.663071] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-09-15T19:27:55.969884] [DEBUG] [VALIDATOR ] MP: All expected trading days are present. [2025-09-15T19:27:55.970040] [DEBUG] [VALIDATOR ] MP: Primary data validation passed. [2025-09-15T19:27:55.971314] [INFO ] [MAIN ] MP: Fetched primary data is valid. [2025-09-15T19:27:55.971365] [DEBUG] [LOCAL ] MP: Saving primary data. [2025-09-15T19:27:55.973180] [DEBUG] [LOCAL ] MP: Trimmed 58249 records to 39704 (keeping 150 days of data) [2025-09-15T19:27:56.243201] [DEBUG] [LOCAL ] MP: Primary data saved (39704 records). [2025-09-15T19:27:56.243445] [INFO ] [MAIN ] MP: Full history saved. [2025-09-15T19:27:56.244091] [INFO ] [MAIN ] Update Progress: 1394/2369 symbols completed. MP took 45.9s. Estimated remaining: 1h 43m 26s. Rate: 9.4 symbols/min [2025-09-15T19:27:56.355366] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-15T19:27:56.431568] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:27:56.451889] [DEBUG] [LOCAL ] MQY: Loaded 11827 existing records from primary storage. [2025-09-15T19:27:56.452086] [INFO ] [MAIN ] MQY: Loaded 11827 existing records. [2025-09-15T19:27:56.463243] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-09-15T19:27:56.636215] [WARN ] [MAIN ] MQY: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:27:56.636520] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-09-15T19:27:56.636568] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-09-15T19:27:56.637022] [DEBUG] [LOCAL ] MQY: Deleted primary data file. [2025-09-15T19:27:56.637071] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-09-15T19:27:56.929494] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-15T19:27:57.007496] [INFO ] [REMOTE ] MQY: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:27:57.257893] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-09-15T19:27:58.057932] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-09-15T19:27:58.276910] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-15T19:27:58.857870] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-09-15T19:27:59.039618] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T19:27:59.040580] [INFO ] [REMOTE ] MPX: Full fetch complete (4838 records). [2025-09-15T19:27:59.040674] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-09-15T19:27:59.391360] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present. [2025-09-15T19:27:59.391441] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed. [2025-09-15T19:27:59.391591] [INFO ] [MAIN ] MPX: Fetched primary data is valid. [2025-09-15T19:27:59.391628] [DEBUG] [LOCAL ] MPX: Saving primary data. [2025-09-15T19:27:59.392009] [DEBUG] [LOCAL ] MPX: Trimmed 4838 records to 2844 (keeping 150 days of data) [2025-09-15T19:27:59.409300] [DEBUG] [LOCAL ] MPX: Primary data saved (2844 records). [2025-09-15T19:27:59.409359] [INFO ] [MAIN ] MPX: Full history saved. [2025-09-15T19:27:59.409445] [INFO ] [MAIN ] Update Progress: 1395/2369 symbols completed. MPX took 11.3s. Estimated remaining: 1h 43m 17s. Rate: 9.4 symbols/min [2025-09-15T19:27:59.586154] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:27:59.616354] [DEBUG] [LOCAL ] MRC: Loaded 27384 existing records from primary storage. [2025-09-15T19:27:59.616499] [INFO ] [MAIN ] MRC: Loaded 27384 existing records. [2025-09-15T19:27:59.660504] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-09-15T19:27:59.729613] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-15T19:27:59.811230] [WARN ] [MAIN ] MRC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:27:59.811501] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-09-15T19:27:59.811562] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-09-15T19:27:59.812158] [DEBUG] [LOCAL ] MRC: Deleted primary data file. [2025-09-15T19:27:59.812222] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-09-15T19:28:00.174084] [INFO ] [REMOTE ] MRC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:28:00.457910] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-09-15T19:28:00.779465] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-15T19:28:01.257898] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-09-15T19:28:01.794304] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-15T19:28:02.057874] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-09-15T19:28:02.857891] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-09-15T19:28:02.916694] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-15T19:28:03.469887] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-15T19:28:03.657876] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-09-15T19:28:03.828382] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-15T19:28:04.457882] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-09-15T19:28:04.964235] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-15T19:28:05.166844] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-15T19:28:05.257905] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-09-15T19:28:05.709680] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-15T19:28:06.057896] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-09-15T19:28:06.752135] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-15T19:28:06.857877] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-09-15T19:28:07.440292] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-15T19:28:07.657903] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-09-15T19:28:08.457874] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-09-15T19:28:09.202430] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-15T19:28:09.257882] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-09-15T19:28:09.415161] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-15T19:28:10.057873] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-09-15T19:28:10.575120] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T19:28:10.771188] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-15T19:28:10.857868] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-09-15T19:28:11.447842] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-15T19:28:11.449664] [INFO ] [REMOTE ] MQT: Full fetch complete (9431 records). [2025-09-15T19:28:11.449764] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-09-15T19:28:11.662941] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-09-15T19:28:11.809225] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-09-15T19:28:11.809365] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-09-15T19:28:11.809603] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-09-15T19:28:11.809671] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-09-15T19:28:11.810150] [DEBUG] [LOCAL ] MQT: Trimmed 9431 records to 5280 (keeping 150 days of data) [2025-09-15T19:28:11.842868] [DEBUG] [LOCAL ] MQT: Primary data saved (5280 records). [2025-09-15T19:28:11.842978] [INFO ] [MAIN ] MQT: Full history saved. [2025-09-15T19:28:11.843061] [INFO ] [MAIN ] Update Progress: 1396/2369 symbols completed. MQT took 22.5s. Estimated remaining: 1h 43m 15s. Rate: 9.4 symbols/min [2025-09-15T19:28:12.011001] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:28:12.053570] [DEBUG] [LOCAL ] MRK: Loaded 40530 existing records from primary storage. [2025-09-15T19:28:12.053729] [INFO ] [MAIN ] MRK: Loaded 40530 existing records. [2025-09-15T19:28:12.229344] [WARN ] [MAIN ] MRK: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:28:12.229630] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-09-15T19:28:12.229698] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-09-15T19:28:12.230735] [DEBUG] [LOCAL ] MRK: Deleted primary data file. [2025-09-15T19:28:12.230786] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-09-15T19:28:12.468258] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-09-15T19:28:12.580117] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-15T19:28:12.603624] [INFO ] [REMOTE ] MRK: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:28:13.257873] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-09-15T19:28:14.013228] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-15T19:28:14.057823] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-09-15T19:28:14.857868] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-09-15T19:28:15.158146] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-15T19:28:15.275229] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T19:28:15.657927] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-09-15T19:28:16.457935] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-09-15T19:28:16.765138] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-15T19:28:16.802608] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-15T19:28:17.186355] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-15T19:28:17.257882] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-09-15T19:28:18.057921] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-09-15T19:28:18.857885] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-09-15T19:28:19.145221] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-15T19:28:19.150996] [INFO ] [REMOTE ] MPW: Full fetch complete (58153 records). [2025-09-15T19:28:19.151102] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-09-15T19:28:19.533207] [DEBUG] [VALIDATOR ] MPW: All expected trading days are present. [2025-09-15T19:28:19.533297] [DEBUG] [VALIDATOR ] MPW: Primary data validation passed. [2025-09-15T19:28:19.534245] [INFO ] [MAIN ] MPW: Fetched primary data is valid. [2025-09-15T19:28:19.534295] [DEBUG] [LOCAL ] MPW: Saving primary data. [2025-09-15T19:28:19.535545] [DEBUG] [LOCAL ] MPW: Trimmed 58153 records to 39513 (keeping 150 days of data) [2025-09-15T19:28:19.659600] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-09-15T19:28:19.783959] [DEBUG] [LOCAL ] MPW: Primary data saved (39513 records). [2025-09-15T19:28:19.784155] [INFO ] [MAIN ] MPW: Full history saved. [2025-09-15T19:28:19.785882] [INFO ] [MAIN ] Update Progress: 1397/2369 symbols completed. MPW took 38.4s. Estimated remaining: 1h 43m 10s. Rate: 9.4 symbols/min [2025-09-15T19:28:19.898989] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-15T19:28:20.457890] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-09-15T19:28:20.762208] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-09-15T19:28:21.257867] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-09-15T19:28:21.628710] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-15T19:28:21.632295] [INFO ] [REMOTE ] MRC: Full fetch complete (41114 records). [2025-09-15T19:28:21.632385] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-09-15T19:28:22.017241] [DEBUG] [VALIDATOR ] MRC: All expected trading days are present. [2025-09-15T19:28:22.017335] [DEBUG] [VALIDATOR ] MRC: Primary data validation passed. [2025-09-15T19:28:22.018056] [INFO ] [MAIN ] MRC: Fetched primary data is valid. [2025-09-15T19:28:22.018102] [DEBUG] [LOCAL ] MRC: Saving primary data. [2025-09-15T19:28:22.018965] [DEBUG] [LOCAL ] MRC: Trimmed 41114 records to 26794 (keeping 150 days of data) [2025-09-15T19:28:22.178020] [DEBUG] [LOCAL ] MRC: Primary data saved (26794 records). [2025-09-15T19:28:22.178161] [INFO ] [MAIN ] MRC: Full history saved. [2025-09-15T19:28:22.178245] [INFO ] [MAIN ] Update Progress: 1398/2369 symbols completed. MRC took 22.8s. Estimated remaining: 1h 43m 1s. Rate: 9.4 symbols/min [2025-09-15T19:28:22.323504] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-15T19:28:22.326294] [INFO ] [REMOTE ] MQY: Full fetch complete (18403 records). [2025-09-15T19:28:22.326368] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-09-15T19:28:22.691758] [DEBUG] [VALIDATOR ] MQY: All expected trading days are present. [2025-09-15T19:28:22.691902] [DEBUG] [VALIDATOR ] MQY: Primary data validation passed. [2025-09-15T19:28:22.692375] [INFO ] [MAIN ] MQY: Fetched primary data is valid. [2025-09-15T19:28:22.692431] [DEBUG] [LOCAL ] MQY: Saving primary data. [2025-09-15T19:28:22.693283] [DEBUG] [LOCAL ] MQY: Trimmed 18403 records to 11648 (keeping 150 days of data) [2025-09-15T19:28:22.765266] [DEBUG] [LOCAL ] MQY: Primary data saved (11648 records). [2025-09-15T19:28:22.765416] [INFO ] [MAIN ] MQY: Full history saved. [2025-09-15T19:28:22.765501] [INFO ] [MAIN ] Update Progress: 1399/2369 symbols completed. MQY took 26.5s. Estimated remaining: 1h 42m 50s. Rate: 9.4 symbols/min [2025-09-15T19:28:23.383075] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-15T19:28:23.394398] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-09-15T19:28:25.065017] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-15T19:28:25.076461] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-09-15T19:28:27.082709] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-15T19:28:27.093613] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-09-15T19:28:29.088510] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-15T19:28:29.100789] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-09-15T19:28:31.125805] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-15T19:28:31.140168] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-09-15T19:28:33.001277] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-15T19:28:33.008241] [INFO ] [REMOTE ] MRK: Full fetch complete (58469 records). [2025-09-15T19:28:33.008408] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-09-15T19:28:33.389197] [DEBUG] [VALIDATOR ] MRK: All expected trading days are present. [2025-09-15T19:28:33.389277] [DEBUG] [VALIDATOR ] MRK: Primary data validation passed. [2025-09-15T19:28:33.390195] [INFO ] [MAIN ] MRK: Fetched primary data is valid. [2025-09-15T19:28:33.390243] [DEBUG] [LOCAL ] MRK: Saving primary data. [2025-09-15T19:28:33.391419] [DEBUG] [LOCAL ] MRK: Trimmed 58469 records to 39751 (keeping 150 days of data) [2025-09-15T19:28:33.644130] [DEBUG] [LOCAL ] MRK: Primary data saved (39751 records). [2025-09-15T19:28:33.644290] [INFO ] [MAIN ] MRK: Full history saved. [2025-09-15T19:28:33.644375] [INFO ] [MAIN ] Update Progress: 1400/2369 symbols completed. MRK took 21.8s. Estimated remaining: 1h 42m 47s. Rate: 9.4 symbols/min [2025-09-15T19:28:34.242853] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:28:34.243678] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:28:34.340227] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:28:34.375233] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:28:34.396973] [DEBUG] [LOCAL ] MSB: Loaded 6124 existing records from primary storage. [2025-09-15T19:28:34.397227] [INFO ] [MAIN ] MSB: Loaded 6124 existing records. [2025-09-15T19:28:34.510758] [DEBUG] [LOCAL ] MRP: Loaded 34842 existing records from primary storage. [2025-09-15T19:28:34.531270] [INFO ] [MAIN ] MRP: Loaded 34842 existing records. [2025-09-15T19:28:34.527755] [DEBUG] [LOCAL ] MSA: Loaded 14092 existing records from primary storage. [2025-09-15T19:28:34.541755] [INFO ] [MAIN ] MSA: Loaded 14092 existing records. [2025-09-15T19:28:34.619110] [DEBUG] [LOCAL ] MS: Loaded 40437 existing records from primary storage. [2025-09-15T19:28:34.708021] [INFO ] [MAIN ] MS: Loaded 40437 existing records. [2025-09-15T19:28:34.775844] [WARN ] [MAIN ] MSB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:28:34.868442] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-09-15T19:28:34.938824] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-09-15T19:28:35.037240] [DEBUG] [LOCAL ] MSB: Deleted primary data file. [2025-09-15T19:28:35.088299] [WARN ] [MAIN ] MSA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:28:35.159693] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-09-15T19:28:35.159818] [WARN ] [MAIN ] MRP: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:28:35.164547] [WARN ] [MAIN ] MS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:28:35.164830] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-09-15T19:28:35.185086] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-09-15T19:28:35.175659] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-09-15T19:28:35.205713] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-09-15T19:28:35.235088] [DEBUG] [LOCAL ] MSA: Deleted primary data file. [2025-09-15T19:28:35.205757] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-09-15T19:28:35.229936] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-15T19:28:35.240416] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-09-15T19:28:35.251487] [DEBUG] [LOCAL ] MS: Deleted primary data file. [2025-09-15T19:28:35.251597] [DEBUG] [LOCAL ] MRP: Deleted primary data file. [2025-09-15T19:28:35.268269] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-09-15T19:28:35.268210] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-09-15T19:28:36.406402] [INFO ] [REMOTE ] MSB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:28:36.475214] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-09-15T19:28:36.603972] [INFO ] [REMOTE ] MRP: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:28:36.675501] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-02. [2025-09-15T19:28:36.718598] [INFO ] [REMOTE ] MS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:28:36.738981] [INFO ] [REMOTE ] MSA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:28:36.739882] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-09-15T19:28:36.739555] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-09-15T19:28:37.247173] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T19:28:37.250217] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-09-15T19:28:37.665003] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-15T19:28:37.668699] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-09-15T19:28:37.839123] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-15T19:28:37.841607] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-09-15T19:28:38.138762] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-15T19:28:38.147873] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-03. [2025-09-15T19:28:38.348241] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-15T19:28:38.367668] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-09-15T19:28:38.385432] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-15T19:28:38.396532] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-09-15T19:28:38.410334] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-15T19:28:38.414448] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-09-15T19:28:38.966438] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-15T19:28:38.969308] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-09-15T19:28:39.377913] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-15T19:28:39.380309] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-09-15T19:28:39.461073] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-15T19:28:39.471526] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-04. [2025-09-15T19:28:39.580315] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-15T19:28:39.585977] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-09-15T19:28:39.844093] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-15T19:28:39.855633] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-09-15T19:28:39.954965] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-15T19:28:39.957805] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-09-15T19:28:40.217128] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-15T19:28:40.223807] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-09-15T19:28:40.548090] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-15T19:28:40.551747] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-09-15T19:28:40.858785] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-15T19:28:41.025006] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-15T19:28:41.026274] [INFO ] [REMOTE ] MSB: Full fetch complete (9194 records). [2025-09-15T19:28:41.026344] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-09-15T19:28:41.268911] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-05. [2025-09-15T19:28:41.412869] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T19:28:41.413066] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present. [2025-09-15T19:28:41.417396] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed. [2025-09-15T19:28:41.418319] [INFO ] [MAIN ] MSB: Fetched primary data is valid. [2025-09-15T19:28:41.418382] [DEBUG] [LOCAL ] MSB: Saving primary data. [2025-09-15T19:28:41.419118] [DEBUG] [LOCAL ] MSB: Trimmed 9194 records to 5948 (keeping 150 days of data) [2025-09-15T19:28:41.456393] [DEBUG] [LOCAL ] MSB: Primary data saved (5948 records). [2025-09-15T19:28:41.456591] [INFO ] [MAIN ] MSB: Full history saved. [2025-09-15T19:28:41.456761] [INFO ] [MAIN ] Update Progress: 1401/2369 symbols completed. MSB took 7.8s. Estimated remaining: 1h 42m 42s. Rate: 9.4 symbols/min [2025-09-15T19:28:41.643002] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:28:41.655467] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-09-15T19:28:41.655524] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-09-15T19:28:41.656177] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-09-15T19:28:41.657139] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-15T19:28:41.657264] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-15T19:28:41.667771] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-15T19:28:41.668101] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-09-15T19:28:42.027103] [INFO ] [REMOTE ] MSC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:28:42.057816] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-09-15T19:28:42.538425] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-15T19:28:42.606628] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-15T19:28:42.857921] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-09-15T19:28:43.197321] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-15T19:28:43.657956] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-06. [2025-09-15T19:28:44.457926] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-09-15T19:28:45.127475] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-15T19:28:45.257870] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-07. [2025-09-15T19:28:45.440762] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-15T19:28:46.057900] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-09-15T19:28:46.790620] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-15T19:28:46.857842] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-09-15T19:28:46.932098] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-15T19:28:47.657888] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-08. [2025-09-15T19:28:48.418150] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-15T19:28:48.457892] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-09-15T19:28:48.728745] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-09-15T19:28:48.979608] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T19:28:49.257945] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-09-15T19:28:50.057924] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-09-15T19:28:50.220084] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-15T19:28:50.222545] [INFO ] [REMOTE ] MSA: Full fetch complete (20247 records). [2025-09-15T19:28:50.222618] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-09-15T19:28:50.401188] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-15T19:28:50.590966] [DEBUG] [VALIDATOR ] MSA: All expected trading days are present. [2025-09-15T19:28:50.591072] [DEBUG] [VALIDATOR ] MSA: Primary data validation passed. [2025-09-15T19:28:50.591563] [INFO ] [MAIN ] MSA: Fetched primary data is valid. [2025-09-15T19:28:50.591631] [DEBUG] [LOCAL ] MSA: Saving primary data. [2025-09-15T19:28:50.592544] [DEBUG] [LOCAL ] MSA: Trimmed 20247 records to 13825 (keeping 150 days of data) [2025-09-15T19:28:50.680176] [DEBUG] [LOCAL ] MSA: Primary data saved (13825 records). [2025-09-15T19:28:50.680337] [INFO ] [MAIN ] MSA: Full history saved. [2025-09-15T19:28:50.680431] [INFO ] [MAIN ] Update Progress: 1402/2369 symbols completed. MSA took 17.0s. Estimated remaining: 1h 42m 37s. Rate: 9.4 symbols/min [2025-09-15T19:28:50.850013] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:28:50.857930] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-09-15T19:28:50.878690] [DEBUG] [LOCAL ] MSCI: Loaded 25461 existing records from primary storage. [2025-09-15T19:28:50.878848] [INFO ] [MAIN ] MSCI: Loaded 25461 existing records. [2025-09-15T19:28:51.059288] [WARN ] [MAIN ] MSCI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:28:51.059690] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-09-15T19:28:51.059767] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-09-15T19:28:51.060481] [DEBUG] [LOCAL ] MSCI: Deleted primary data file. [2025-09-15T19:28:51.060530] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-09-15T19:28:51.410137] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:28:51.657859] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-09-15T19:28:52.462991] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-09. [2025-09-15T19:28:52.486489] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-15T19:28:52.634036] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-15T19:28:53.257931] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-09-15T19:28:54.057982] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-09-15T19:28:54.104468] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-15T19:28:54.110630] [INFO ] [REMOTE ] MRP: Full fetch complete (51803 records). [2025-09-15T19:28:54.110881] [DEBUG] [VALIDATOR ] MRP: Validating primary data. [2025-09-15T19:28:54.384626] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-15T19:28:54.506861] [DEBUG] [VALIDATOR ] MRP: All expected trading days are present. [2025-09-15T19:28:54.506954] [DEBUG] [VALIDATOR ] MRP: Primary data validation passed. [2025-09-15T19:28:54.508142] [INFO ] [MAIN ] MRP: Fetched primary data is valid. [2025-09-15T19:28:54.508192] [DEBUG] [LOCAL ] MRP: Saving primary data. [2025-09-15T19:28:54.509393] [DEBUG] [LOCAL ] MRP: Trimmed 51803 records to 34180 (keeping 150 days of data) [2025-09-15T19:28:54.726671] [DEBUG] [LOCAL ] MRP: Primary data saved (34180 records). [2025-09-15T19:28:54.726831] [INFO ] [MAIN ] MRP: Full history saved. [2025-09-15T19:28:54.726954] [INFO ] [MAIN ] Update Progress: 1403/2369 symbols completed. MRP took 21.1s. Estimated remaining: 1h 42m 29s. Rate: 9.4 symbols/min [2025-09-15T19:28:54.867500] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-09-15T19:28:54.899490] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:28:54.913243] [DEBUG] [LOCAL ] MSD: Loaded 12044 existing records from primary storage. [2025-09-15T19:28:54.913384] [INFO ] [MAIN ] MSD: Loaded 12044 existing records. [2025-09-15T19:28:55.095692] [WARN ] [MAIN ] MSD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:28:55.096123] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-09-15T19:28:55.096256] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-09-15T19:28:55.096747] [DEBUG] [LOCAL ] MSD: Deleted primary data file. [2025-09-15T19:28:55.096804] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-09-15T19:28:55.257470] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-15T19:28:55.515693] [INFO ] [REMOTE ] MSD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:28:55.657824] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-09-15T19:28:56.381902] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-15T19:28:56.457871] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-09-15T19:28:56.533580] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-15T19:28:57.257924] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-09-15T19:28:57.796064] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-15T19:28:58.057922] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-09-15T19:28:58.163789] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-15T19:28:58.857894] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-09-15T19:28:59.578991] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-15T19:28:59.657883] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-09-15T19:28:59.830550] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-15T19:29:00.457880] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-09-15T19:29:00.744306] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-15T19:29:01.141532] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-15T19:29:01.257875] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-09-15T19:29:01.846722] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-15T19:29:02.057872] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-09-15T19:29:02.857865] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-09-15T19:29:03.657841] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-09-15T19:29:03.725693] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-15T19:29:03.731574] [INFO ] [REMOTE ] MS: Full fetch complete (58374 records). [2025-09-15T19:29:03.731727] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-09-15T19:29:04.106827] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-15T19:29:04.126044] [DEBUG] [VALIDATOR ] MS: All expected trading days are present. [2025-09-15T19:29:04.126149] [DEBUG] [VALIDATOR ] MS: Primary data validation passed. [2025-09-15T19:29:04.127154] [INFO ] [MAIN ] MS: Fetched primary data is valid. [2025-09-15T19:29:04.127219] [DEBUG] [LOCAL ] MS: Saving primary data. [2025-09-15T19:29:04.128697] [DEBUG] [LOCAL ] MS: Trimmed 58374 records to 39657 (keeping 150 days of data) [2025-09-15T19:29:04.252397] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-15T19:29:04.422557] [DEBUG] [LOCAL ] MS: Primary data saved (39657 records). [2025-09-15T19:29:04.422742] [INFO ] [MAIN ] MS: Full history saved. [2025-09-15T19:29:04.422857] [INFO ] [MAIN ] Update Progress: 1404/2369 symbols completed. MS took 30.8s. Estimated remaining: 1h 42m 25s. Rate: 9.4 symbols/min [2025-09-15T19:29:04.463420] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-09-15T19:29:04.596891] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:29:04.623835] [DEBUG] [LOCAL ] MSDL: Loaded 27502 existing records from primary storage. [2025-09-15T19:29:04.623972] [INFO ] [MAIN ] MSDL: Loaded 27502 existing records. [2025-09-15T19:29:04.797525] [WARN ] [MAIN ] MSDL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:29:04.797863] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-09-15T19:29:04.797912] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-09-15T19:29:04.798575] [DEBUG] [LOCAL ] MSDL: Deleted primary data file. [2025-09-15T19:29:04.798624] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-09-15T19:29:05.152173] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:29:05.257931] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-09-15T19:29:05.516101] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-15T19:29:06.057870] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-09-15T19:29:06.314626] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-15T19:29:06.857881] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-09-15T19:29:06.949315] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-15T19:29:07.657832] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-09-15T19:29:07.922094] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-09-15T19:29:08.142021] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-15T19:29:08.457916] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-09-15T19:29:09.257963] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-09-15T19:29:09.808306] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-15T19:29:09.809361] [INFO ] [REMOTE ] MSC: Full fetch complete (1880 records). [2025-09-15T19:29:09.809429] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-09-15T19:29:09.996616] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 143 unique days, need 150 days [2025-09-15T19:29:09.996900] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:29:09.996984] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:29:09.997103] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-15T19:29:09.997196] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-15T19:29:09.997261] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-09-15T19:29:09.997320] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-09-15T19:29:09.997390] [INFO ] [MAIN ] Update Progress: 1405/2369 symbols completed. MSC took 28.5s. Estimated remaining: 1h 42m 18s. Rate: 9.4 symbols/min [2025-09-15T19:29:10.058710] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-09-15T19:29:10.218802] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:29:10.223990] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-15T19:29:10.250221] [DEBUG] [LOCAL ] MSGE: Loaded 19384 existing records from primary storage. [2025-09-15T19:29:10.250386] [INFO ] [MAIN ] MSGE: Loaded 19384 existing records. [2025-09-15T19:29:10.425104] [WARN ] [MAIN ] MSGE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:29:10.425371] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-09-15T19:29:10.425421] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-09-15T19:29:10.425945] [DEBUG] [LOCAL ] MSGE: Deleted primary data file. [2025-09-15T19:29:10.425997] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-09-15T19:29:10.775800] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:29:10.857822] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-09-15T19:29:11.040420] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T19:29:11.043050] [INFO ] [REMOTE ] MSD: Full fetch complete (16731 records). [2025-09-15T19:29:11.043136] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-09-15T19:29:11.422625] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-09-15T19:29:11.422736] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-09-15T19:29:11.423109] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-09-15T19:29:11.423159] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-09-15T19:29:11.423848] [DEBUG] [LOCAL ] MSD: Trimmed 16731 records to 11977 (keeping 150 days of data) [2025-09-15T19:29:11.491771] [DEBUG] [LOCAL ] MSD: Primary data saved (11977 records). [2025-09-15T19:29:11.491901] [INFO ] [MAIN ] MSD: Full history saved. [2025-09-15T19:29:11.491987] [INFO ] [MAIN ] Update Progress: 1406/2369 symbols completed. MSD took 16.8s. Estimated remaining: 1h 42m 9s. Rate: 9.4 symbols/min [2025-09-15T19:29:11.667863] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:29:11.664699] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-09-15T19:29:11.682017] [DEBUG] [LOCAL ] MSGS: Loaded 12313 existing records from primary storage. [2025-09-15T19:29:11.682138] [INFO ] [MAIN ] MSGS: Loaded 12313 existing records. [2025-09-15T19:29:11.866972] [WARN ] [MAIN ] MSGS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:29:11.867208] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-09-15T19:29:11.867255] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-09-15T19:29:11.867700] [DEBUG] [LOCAL ] MSGS: Deleted primary data file. [2025-09-15T19:29:11.867751] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-09-15T19:29:12.242543] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:29:12.265150] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-15T19:29:12.457873] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-09-15T19:29:13.001444] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-15T19:29:13.257856] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-09-15T19:29:13.279836] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-15T19:29:14.057866] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-09-15T19:29:14.420674] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-15T19:29:14.857932] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-09-15T19:29:15.373534] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T19:29:15.378256] [INFO ] [REMOTE ] MSCI: Full fetch complete (37965 records). [2025-09-15T19:29:15.378344] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-09-15T19:29:15.663032] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-09-15T19:29:15.773547] [DEBUG] [VALIDATOR ] MSCI: All expected trading days are present. [2025-09-15T19:29:15.773637] [DEBUG] [VALIDATOR ] MSCI: Primary data validation passed. [2025-09-15T19:29:15.774467] [INFO ] [MAIN ] MSCI: Fetched primary data is valid. [2025-09-15T19:29:15.774526] [DEBUG] [LOCAL ] MSCI: Saving primary data. [2025-09-15T19:29:15.775466] [DEBUG] [LOCAL ] MSCI: Trimmed 37965 records to 25068 (keeping 150 days of data) [2025-09-15T19:29:15.943816] [DEBUG] [LOCAL ] MSCI: Primary data saved (25068 records). [2025-09-15T19:29:15.943997] [INFO ] [MAIN ] MSCI: Full history saved. [2025-09-15T19:29:15.944219] [INFO ] [MAIN ] Update Progress: 1407/2369 symbols completed. MSCI took 25.3s. Estimated remaining: 1h 42m 1s. Rate: 9.4 symbols/min [2025-09-15T19:29:16.078815] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-15T19:29:16.156988] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:29:16.189062] [DEBUG] [LOCAL ] MSI: Loaded 30154 existing records from primary storage. [2025-09-15T19:29:16.189230] [INFO ] [MAIN ] MSI: Loaded 30154 existing records. [2025-09-15T19:29:16.363506] [WARN ] [MAIN ] MSI: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:29:16.363849] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-09-15T19:29:16.363901] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-09-15T19:29:16.364798] [DEBUG] [LOCAL ] MSI: Deleted primary data file. [2025-09-15T19:29:16.364853] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-09-15T19:29:16.463467] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-09-15T19:29:16.723946] [INFO ] [REMOTE ] MSI: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:29:16.747091] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-15T19:29:17.201575] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-15T19:29:17.257842] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-09-15T19:29:18.057884] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-09-15T19:29:18.213262] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-15T19:29:18.857843] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-09-15T19:29:18.939382] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-15T19:29:19.443364] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-15T19:29:19.657893] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-09-15T19:29:20.457889] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-09-15T19:29:20.816393] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-15T19:29:21.008187] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-15T19:29:21.257941] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-09-15T19:29:22.057890] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-09-15T19:29:22.450617] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-15T19:29:22.857951] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-09-15T19:29:23.589170] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-15T19:29:23.668231] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-09-15T19:29:23.681380] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-15T19:29:24.457912] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-09-15T19:29:25.173937] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-15T19:29:25.257860] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-09-15T19:29:25.399896] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-15T19:29:26.057890] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-09-15T19:29:26.574915] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-15T19:29:26.857888] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-09-15T19:29:27.062211] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-15T19:29:27.065765] [INFO ] [REMOTE ] MSGE: Full fetch complete (29282 records). [2025-09-15T19:29:27.065852] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-09-15T19:29:27.464565] [DEBUG] [VALIDATOR ] MSGE: All expected trading days are present. [2025-09-15T19:29:27.464871] [DEBUG] [VALIDATOR ] MSGE: Primary data validation passed. [2025-09-15T19:29:27.466122] [INFO ] [MAIN ] MSGE: Fetched primary data is valid. [2025-09-15T19:29:27.466190] [DEBUG] [LOCAL ] MSGE: Saving primary data. [2025-09-15T19:29:27.467296] [DEBUG] [LOCAL ] MSGE: Trimmed 29282 records to 19047 (keeping 150 days of data) [2025-09-15T19:29:27.598814] [DEBUG] [LOCAL ] MSGE: Primary data saved (19047 records). [2025-09-15T19:29:27.599127] [INFO ] [MAIN ] MSGE: Full history saved. [2025-09-15T19:29:27.599287] [INFO ] [MAIN ] Update Progress: 1408/2369 symbols completed. MSGE took 17.6s. Estimated remaining: 1h 41m 58s. Rate: 9.4 symbols/min [2025-09-15T19:29:27.668231] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-09-15T19:29:27.789769] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:29:27.804058] [DEBUG] [LOCAL ] MSIF: Loaded 10482 existing records from primary storage. [2025-09-15T19:29:27.804427] [INFO ] [MAIN ] MSIF: Loaded 10482 existing records. [2025-09-15T19:29:27.995977] [WARN ] [MAIN ] MSIF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:29:27.996320] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-09-15T19:29:27.996372] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-15T19:29:27.996864] [DEBUG] [LOCAL ] MSIF: Deleted primary data file. [2025-09-15T19:29:27.996922] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-09-15T19:29:28.401468] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:29:28.436682] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-15T19:29:28.457825] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-09-15T19:29:28.708244] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-15T19:29:29.257925] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-09-15T19:29:29.523146] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-15T19:29:30.059114] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-09-15T19:29:30.060923] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-15T19:29:30.857853] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-09-15T19:29:31.331736] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-15T19:29:31.657889] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-02. [2025-09-15T19:29:31.938112] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-15T19:29:32.457882] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-09-15T19:29:32.548724] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-15T19:29:33.257932] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-09-15T19:29:33.978601] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T19:29:34.057870] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-09-15T19:29:34.593942] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-15T19:29:34.857883] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-09-15T19:29:35.037908] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-15T19:29:35.042220] [INFO ] [REMOTE ] MSI: Full fetch complete (44511 records). [2025-09-15T19:29:35.042331] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-09-15T19:29:35.419123] [DEBUG] [VALIDATOR ] MSI: All expected trading days are present. [2025-09-15T19:29:35.419244] [DEBUG] [VALIDATOR ] MSI: Primary data validation passed. [2025-09-15T19:29:35.420142] [INFO ] [MAIN ] MSI: Fetched primary data is valid. [2025-09-15T19:29:35.420200] [DEBUG] [LOCAL ] MSI: Saving primary data. [2025-09-15T19:29:35.422614] [DEBUG] [LOCAL ] MSI: Trimmed 44511 records to 29648 (keeping 150 days of data) [2025-09-15T19:29:35.622120] [DEBUG] [LOCAL ] MSI: Primary data saved (29648 records). [2025-09-15T19:29:35.622246] [INFO ] [MAIN ] MSI: Full history saved. [2025-09-15T19:29:35.622402] [INFO ] [MAIN ] Update Progress: 1409/2369 symbols completed. MSI took 19.7s. Estimated remaining: 1h 41m 53s. Rate: 9.4 symbols/min [2025-09-15T19:29:35.664915] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-09-15T19:29:35.792920] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:29:35.819337] [DEBUG] [LOCAL ] MSM: Loaded 25777 existing records from primary storage. [2025-09-15T19:29:35.819479] [INFO ] [MAIN ] MSM: Loaded 25777 existing records. [2025-09-15T19:29:35.993864] [WARN ] [MAIN ] MSM: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:29:35.994106] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-09-15T19:29:35.994152] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-09-15T19:29:35.994979] [DEBUG] [LOCAL ] MSM: Deleted primary data file. [2025-09-15T19:29:35.995031] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-09-15T19:29:36.347907] [INFO ] [REMOTE ] MSM: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:29:36.459036] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-03. [2025-09-15T19:29:36.460780] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-15T19:29:36.465626] [INFO ] [REMOTE ] MSDL: Full fetch complete (41567 records). [2025-09-15T19:29:36.465738] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-09-15T19:29:36.806264] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-15T19:29:36.874541] [DEBUG] [VALIDATOR ] MSDL: All expected trading days are present. [2025-09-15T19:29:36.874625] [DEBUG] [VALIDATOR ] MSDL: Primary data validation passed. [2025-09-15T19:29:36.875467] [INFO ] [MAIN ] MSDL: Fetched primary data is valid. [2025-09-15T19:29:36.875512] [DEBUG] [LOCAL ] MSDL: Saving primary data. [2025-09-15T19:29:36.876400] [DEBUG] [LOCAL ] MSDL: Trimmed 41567 records to 27074 (keeping 150 days of data) [2025-09-15T19:29:37.052272] [DEBUG] [LOCAL ] MSDL: Primary data saved (27074 records). [2025-09-15T19:29:37.052416] [INFO ] [MAIN ] MSDL: Full history saved. [2025-09-15T19:29:37.052525] [INFO ] [MAIN ] Update Progress: 1410/2369 symbols completed. MSDL took 32.6s. Estimated remaining: 1h 41m 43s. Rate: 9.4 symbols/min [2025-09-15T19:29:37.233277] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:29:37.234140] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-15T19:29:37.260942] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-09-15T19:29:37.277806] [DEBUG] [LOCAL ] MT: Loaded 37882 existing records from primary storage. [2025-09-15T19:29:37.277942] [INFO ] [MAIN ] MT: Loaded 37882 existing records. [2025-09-15T19:29:37.455715] [WARN ] [MAIN ] MT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:29:37.456007] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-09-15T19:29:37.456067] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-09-15T19:29:37.457102] [DEBUG] [LOCAL ] MT: Deleted primary data file. [2025-09-15T19:29:37.457159] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-09-15T19:29:37.804373] [INFO ] [REMOTE ] MT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:29:38.057858] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-09-15T19:29:38.572163] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-15T19:29:38.857882] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-09-15T19:29:39.596509] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-15T19:29:39.657832] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-09-15T19:29:40.130437] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-15T19:29:40.457935] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-09-15T19:29:41.016202] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-15T19:29:41.257897] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-04. [2025-09-15T19:29:41.771943] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-15T19:29:41.803904] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-15T19:29:42.057928] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-09-15T19:29:42.857839] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-09-15T19:29:43.109790] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-15T19:29:43.112445] [INFO ] [REMOTE ] MSGS: Full fetch complete (17715 records). [2025-09-15T19:29:43.112515] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-09-15T19:29:43.490948] [DEBUG] [VALIDATOR ] MSGS: All expected trading days are present. [2025-09-15T19:29:43.491060] [DEBUG] [VALIDATOR ] MSGS: Primary data validation passed. [2025-09-15T19:29:43.491499] [INFO ] [MAIN ] MSGS: Fetched primary data is valid. [2025-09-15T19:29:43.491552] [DEBUG] [LOCAL ] MSGS: Saving primary data. [2025-09-15T19:29:43.492333] [DEBUG] [LOCAL ] MSGS: Trimmed 17715 records to 12220 (keeping 150 days of data) [2025-09-15T19:29:43.572823] [DEBUG] [LOCAL ] MSGS: Primary data saved (12220 records). [2025-09-15T19:29:43.572961] [INFO ] [MAIN ] MSGS: Full history saved. [2025-09-15T19:29:43.573066] [INFO ] [MAIN ] Update Progress: 1411/2369 symbols completed. MSGS took 32.1s. Estimated remaining: 1h 41m 37s. Rate: 9.4 symbols/min [2025-09-15T19:29:43.663077] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-05. [2025-09-15T19:29:43.755707] [INFO ] [MAIN ] MTAL: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:29:43.784830] [DEBUG] [LOCAL ] MTAL: Loaded 27726 existing records from primary storage. [2025-09-15T19:29:43.784967] [INFO ] [MAIN ] MTAL: Loaded 27726 existing records. [2025-09-15T19:29:43.964305] [WARN ] [MAIN ] MTAL: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:29:43.964603] [INFO ] [MAIN ] MTAL: Wiping existing primary data before full refresh. [2025-09-15T19:29:43.964687] [INFO ] [LOCAL ] MTAL: Starting deletion of primary data. [2025-09-15T19:29:43.965315] [DEBUG] [LOCAL ] MTAL: Deleted primary data file. [2025-09-15T19:29:43.965363] [INFO ] [MAIN ] MTAL: Starting full primary refresh. [2025-09-15T19:29:44.337561] [INFO ] [REMOTE ] MTAL: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:29:44.358975] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-15T19:29:44.418779] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-15T19:29:44.457835] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-09-15T19:29:45.257884] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-02. [2025-09-15T19:29:45.700553] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-15T19:29:46.057869] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-06. [2025-09-15T19:29:46.229793] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-15T19:29:46.741050] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-15T19:29:46.857879] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-09-15T19:29:47.657906] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-09-15T19:29:48.183315] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-15T19:29:48.457889] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-07. [2025-09-15T19:29:48.610636] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-15T19:29:49.246188] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-15T19:29:49.257806] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-08. [2025-09-15T19:29:50.057839] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-09-15T19:29:50.191079] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-15T19:29:50.857849] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-09-15T19:29:51.267052] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-15T19:29:51.657928] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-09-15T19:29:52.395401] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-15T19:29:52.457850] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-09-15T19:29:53.107864] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-15T19:29:53.257861] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-09-15T19:29:53.916079] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T19:29:54.005084] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-15T19:29:54.057838] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-09-15T19:29:54.857928] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-03. [2025-09-15T19:29:55.114709] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-15T19:29:55.118830] [INFO ] [REMOTE ] MSM: Full fetch complete (38155 records). [2025-09-15T19:29:55.118920] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-09-15T19:29:55.492750] [DEBUG] [VALIDATOR ] MSM: All expected trading days are present. [2025-09-15T19:29:55.492830] [DEBUG] [VALIDATOR ] MSM: Primary data validation passed. [2025-09-15T19:29:55.493498] [INFO ] [MAIN ] MSM: Fetched primary data is valid. [2025-09-15T19:29:55.493538] [DEBUG] [LOCAL ] MSM: Saving primary data. [2025-09-15T19:29:55.494427] [DEBUG] [LOCAL ] MSM: Trimmed 38155 records to 25248 (keeping 150 days of data) [2025-09-15T19:29:55.652171] [DEBUG] [LOCAL ] MSM: Primary data saved (25248 records). [2025-09-15T19:29:55.652305] [INFO ] [MAIN ] MSM: Full history saved. [2025-09-15T19:29:55.652390] [INFO ] [MAIN ] Update Progress: 1412/2369 symbols completed. MSM took 20.0s. Estimated remaining: 1h 41m 35s. Rate: 9.4 symbols/min [2025-09-15T19:29:55.663014] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-09-15T19:29:55.825148] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:29:55.862674] [DEBUG] [LOCAL ] MTB: Loaded 35024 existing records from primary storage. [2025-09-15T19:29:55.862823] [INFO ] [MAIN ] MTB: Loaded 35024 existing records. [2025-09-15T19:29:56.042533] [WARN ] [MAIN ] MTB: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:29:56.042957] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-09-15T19:29:56.043094] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-09-15T19:29:56.044122] [DEBUG] [LOCAL ] MTB: Deleted primary data file. [2025-09-15T19:29:56.044261] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-09-15T19:29:56.174573] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-15T19:29:56.430296] [INFO ] [REMOTE ] MTB: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:29:56.457818] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-09-15T19:29:57.128736] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-15T19:29:57.135204] [INFO ] [REMOTE ] MT: Full fetch complete (55428 records). [2025-09-15T19:29:57.135409] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-09-15T19:29:57.263143] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-09. [2025-09-15T19:29:57.533660] [DEBUG] [VALIDATOR ] MT: All expected trading days are present. [2025-09-15T19:29:57.533803] [DEBUG] [VALIDATOR ] MT: Primary data validation passed. [2025-09-15T19:29:57.535780] [INFO ] [MAIN ] MT: Fetched primary data is valid. [2025-09-15T19:29:57.535840] [DEBUG] [LOCAL ] MT: Saving primary data. [2025-09-15T19:29:57.537574] [DEBUG] [LOCAL ] MT: Trimmed 55428 records to 37095 (keeping 150 days of data) [2025-09-15T19:29:57.789910] [DEBUG] [LOCAL ] MT: Primary data saved (37095 records). [2025-09-15T19:29:57.790075] [INFO ] [MAIN ] MT: Full history saved. [2025-09-15T19:29:57.790929] [INFO ] [MAIN ] Update Progress: 1413/2369 symbols completed. MT took 20.7s. Estimated remaining: 1h 41m 25s. Rate: 9.4 symbols/min [2025-09-15T19:29:57.957915] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:29:57.972062] [DEBUG] [LOCAL ] MTD: Loaded 11405 existing records from primary storage. [2025-09-15T19:29:57.972221] [INFO ] [MAIN ] MTD: Loaded 11405 existing records. [2025-09-15T19:29:58.062779] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-04. [2025-09-15T19:29:58.155832] [WARN ] [MAIN ] MTD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:29:58.156236] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-09-15T19:29:58.156371] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-09-15T19:29:58.156868] [DEBUG] [LOCAL ] MTD: Deleted primary data file. [2025-09-15T19:29:58.157015] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-09-15T19:29:58.428922] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-15T19:29:58.481167] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-15T19:29:58.486564] [INFO ] [REMOTE ] MSIF: Full fetch complete (14315 records). [2025-09-15T19:29:58.502208] [DEBUG] [VALIDATOR ] MSIF: Validating primary data. [2025-09-15T19:29:58.651274] [INFO ] [REMOTE ] MTD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:29:58.863028] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-09-15T19:29:58.936189] [DEBUG] [VALIDATOR ] MSIF: All expected trading days are present. [2025-09-15T19:29:58.936265] [DEBUG] [VALIDATOR ] MSIF: Primary data validation passed. [2025-09-15T19:29:58.936586] [INFO ] [MAIN ] MSIF: Fetched primary data is valid. [2025-09-15T19:29:58.936624] [DEBUG] [LOCAL ] MSIF: Saving primary data. [2025-09-15T19:29:58.937465] [DEBUG] [LOCAL ] MSIF: Trimmed 14315 records to 10557 (keeping 150 days of data) [2025-09-15T19:29:59.005813] [DEBUG] [LOCAL ] MSIF: Primary data saved (10557 records). [2025-09-15T19:29:59.006005] [INFO ] [MAIN ] MSIF: Full history saved. [2025-09-15T19:29:59.006113] [INFO ] [MAIN ] Update Progress: 1414/2369 symbols completed. MSIF took 31.4s. Estimated remaining: 1h 41m 16s. Rate: 9.4 symbols/min [2025-09-15T19:29:59.177502] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:29:59.199676] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-15T19:29:59.242237] [DEBUG] [LOCAL ] MTDR: Loaded 38772 existing records from primary storage. [2025-09-15T19:29:59.242441] [INFO ] [MAIN ] MTDR: Loaded 38772 existing records. [2025-09-15T19:29:59.418383] [WARN ] [MAIN ] MTDR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:29:59.418683] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-09-15T19:29:59.418735] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-09-15T19:29:59.419678] [DEBUG] [LOCAL ] MTDR: Deleted primary data file. [2025-09-15T19:29:59.419749] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-09-15T19:29:59.664763] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-05. [2025-09-15T19:29:59.720245] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-15T19:29:59.798855] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:30:00.457944] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-09-15T19:30:00.857348] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-15T19:30:01.257957] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-09-15T19:30:01.517995] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-15T19:30:02.057918] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-09-15T19:30:02.114202] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-15T19:30:02.857914] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-09-15T19:30:03.657889] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-06. [2025-09-15T19:30:04.350260] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-15T19:30:04.457909] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-09-15T19:30:04.548830] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-15T19:30:05.257887] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-09-15T19:30:06.057876] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-09-15T19:30:06.266306] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-09-15T19:30:06.655446] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-15T19:30:06.857876] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-09-15T19:30:06.988988] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-15T19:30:07.095990] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-15T19:30:07.657874] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-07. [2025-09-15T19:30:08.333087] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-15T19:30:08.457877] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-09-15T19:30:08.968554] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-15T19:30:09.257893] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-09-15T19:30:09.852321] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-15T19:30:10.057897] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-09-15T19:30:10.857882] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-08. [2025-09-15T19:30:10.992814] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-15T19:30:11.301608] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-15T19:30:11.657866] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-09-15T19:30:12.117988] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-15T19:30:12.457872] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-09. [2025-09-15T19:30:13.041067] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-15T19:30:13.257894] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-09-15T19:30:13.856989] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-15T19:30:13.861670] [INFO ] [REMOTE ] MTAL: Full fetch complete (38017 records). [2025-09-15T19:30:13.861769] [DEBUG] [VALIDATOR ] MTAL: Validating primary data. [2025-09-15T19:30:14.067832] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-09-15T19:30:14.235779] [DEBUG] [VALIDATOR ] MTAL: All expected trading days are present. [2025-09-15T19:30:14.235881] [DEBUG] [VALIDATOR ] MTAL: Primary data validation passed. [2025-09-15T19:30:14.236712] [INFO ] [MAIN ] MTAL: Fetched primary data is valid. [2025-09-15T19:30:14.236760] [DEBUG] [LOCAL ] MTAL: Saving primary data. [2025-09-15T19:30:14.237833] [DEBUG] [LOCAL ] MTAL: Trimmed 38017 records to 27153 (keeping 150 days of data) [2025-09-15T19:30:14.401831] [DEBUG] [LOCAL ] MTAL: Primary data saved (27153 records). [2025-09-15T19:30:14.402022] [INFO ] [MAIN ] MTAL: Full history saved. [2025-09-15T19:30:14.402119] [INFO ] [MAIN ] Update Progress: 1415/2369 symbols completed. MTAL took 30.8s. Estimated remaining: 1h 41m 15s. Rate: 9.4 symbols/min [2025-09-15T19:30:14.590323] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:30:14.627958] [DEBUG] [LOCAL ] MTG: Loaded 38305 existing records from primary storage. [2025-09-15T19:30:14.628213] [INFO ] [MAIN ] MTG: Loaded 38305 existing records. [2025-09-15T19:30:14.834934] [WARN ] [MAIN ] MTG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:30:14.835929] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-09-15T19:30:14.836437] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-09-15T19:30:14.839722] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-15T19:30:14.849512] [DEBUG] [LOCAL ] MTG: Deleted primary data file. [2025-09-15T19:30:14.850044] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-09-15T19:30:14.861765] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-09-15T19:30:14.930554] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-15T19:30:15.215474] [INFO ] [REMOTE ] MTG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:30:15.657898] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-09-15T19:30:16.005853] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-15T19:30:16.457943] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-09-15T19:30:17.257958] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-09-15T19:30:17.482172] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-15T19:30:17.607525] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-15T19:30:18.057876] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-09-15T19:30:18.857987] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-09-15T19:30:19.096816] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-15T19:30:19.102026] [INFO ] [REMOTE ] MTB: Full fetch complete (51241 records). [2025-09-15T19:30:19.102151] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-09-15T19:30:19.504500] [DEBUG] [VALIDATOR ] MTB: All expected trading days are present. [2025-09-15T19:30:19.512344] [DEBUG] [VALIDATOR ] MTB: Primary data validation passed. [2025-09-15T19:30:19.514220] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-15T19:30:19.513842] [INFO ] [MAIN ] MTB: Fetched primary data is valid. [2025-09-15T19:30:19.517531] [DEBUG] [LOCAL ] MTB: Saving primary data. [2025-09-15T19:30:19.518865] [DEBUG] [LOCAL ] MTB: Trimmed 51241 records to 34251 (keeping 150 days of data) [2025-09-15T19:30:19.695095] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-09-15T19:30:19.751731] [DEBUG] [LOCAL ] MTB: Primary data saved (34251 records). [2025-09-15T19:30:19.751902] [INFO ] [MAIN ] MTB: Full history saved. [2025-09-15T19:30:19.752556] [INFO ] [MAIN ] Update Progress: 1416/2369 symbols completed. MTB took 24.1s. Estimated remaining: 1h 41m 8s. Rate: 9.4 symbols/min [2025-09-15T19:30:19.932182] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:30:19.967261] [DEBUG] [LOCAL ] MTH: Loaded 32732 existing records from primary storage. [2025-09-15T19:30:19.967426] [INFO ] [MAIN ] MTH: Loaded 32732 existing records. [2025-09-15T19:30:20.156178] [WARN ] [MAIN ] MTH: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:30:20.157304] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-09-15T19:30:20.157370] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-09-15T19:30:20.158509] [DEBUG] [LOCAL ] MTH: Deleted primary data file. [2025-09-15T19:30:20.158576] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-09-15T19:30:20.467889] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-09-15T19:30:20.528952] [INFO ] [REMOTE ] MTH: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:30:20.561655] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-15T19:30:20.596245] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T19:30:20.598004] [INFO ] [REMOTE ] MTD: Full fetch complete (16731 records). [2025-09-15T19:30:20.598091] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-09-15T19:30:20.961129] [DEBUG] [VALIDATOR ] MTD: All expected trading days are present. [2025-09-15T19:30:20.961211] [DEBUG] [VALIDATOR ] MTD: Primary data validation passed. [2025-09-15T19:30:20.961573] [INFO ] [MAIN ] MTD: Fetched primary data is valid. [2025-09-15T19:30:20.961611] [DEBUG] [LOCAL ] MTD: Saving primary data. [2025-09-15T19:30:20.962155] [DEBUG] [LOCAL ] MTD: Trimmed 16731 records to 11010 (keeping 150 days of data) [2025-09-15T19:30:21.031404] [DEBUG] [LOCAL ] MTD: Primary data saved (11010 records). [2025-09-15T19:30:21.031533] [INFO ] [MAIN ] MTD: Full history saved. [2025-09-15T19:30:21.031617] [INFO ] [MAIN ] Update Progress: 1417/2369 symbols completed. MTD took 23.2s. Estimated remaining: 1h 40m 58s. Rate: 9.4 symbols/min [2025-09-15T19:30:21.205539] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:30:21.240214] [DEBUG] [LOCAL ] MTN: Loaded 29044 existing records from primary storage. [2025-09-15T19:30:21.240378] [INFO ] [MAIN ] MTN: Loaded 29044 existing records. [2025-09-15T19:30:21.263099] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-09-15T19:30:21.422202] [WARN ] [MAIN ] MTN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:30:21.422483] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-09-15T19:30:21.422544] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-09-15T19:30:21.423301] [DEBUG] [LOCAL ] MTN: Deleted primary data file. [2025-09-15T19:30:21.423365] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-09-15T19:30:21.772143] [INFO ] [REMOTE ] MTN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:30:21.868331] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-15T19:30:22.057925] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-09-15T19:30:22.776528] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-15T19:30:22.782278] [INFO ] [REMOTE ] MTDR: Full fetch complete (55914 records). [2025-09-15T19:30:22.782419] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-09-15T19:30:22.862953] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-09-15T19:30:23.188486] [DEBUG] [VALIDATOR ] MTDR: All expected trading days are present. [2025-09-15T19:30:23.188589] [DEBUG] [VALIDATOR ] MTDR: Primary data validation passed. [2025-09-15T19:30:23.189669] [INFO ] [MAIN ] MTDR: Fetched primary data is valid. [2025-09-15T19:30:23.189728] [DEBUG] [LOCAL ] MTDR: Saving primary data. [2025-09-15T19:30:23.191068] [DEBUG] [LOCAL ] MTDR: Trimmed 55914 records to 37997 (keeping 150 days of data) [2025-09-15T19:30:23.440818] [DEBUG] [LOCAL ] MTDR: Primary data saved (37997 records). [2025-09-15T19:30:23.441006] [INFO ] [MAIN ] MTDR: Full history saved. [2025-09-15T19:30:23.441110] [INFO ] [MAIN ] Update Progress: 1418/2369 symbols completed. MTDR took 24.4s. Estimated remaining: 1h 40m 49s. Rate: 9.4 symbols/min [2025-09-15T19:30:23.597305] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-15T19:30:23.654712] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:30:23.658393] [DEBUG] [LOCAL ] MTR: Loaded 1606 existing records from primary storage. [2025-09-15T19:30:23.658237] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-09-15T19:30:23.658536] [INFO ] [MAIN ] MTR: Loaded 1606 existing records. [2025-09-15T19:30:23.843853] [WARN ] [MAIN ] MTR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:30:23.844115] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-09-15T19:30:23.844207] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-15T19:30:23.844409] [DEBUG] [LOCAL ] MTR: Deleted primary data file. [2025-09-15T19:30:23.844457] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-09-15T19:30:24.208368] [INFO ] [REMOTE ] MTR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:30:24.437717] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-15T19:30:24.457821] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-09-15T19:30:25.248201] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-15T19:30:25.257830] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-09-15T19:30:26.057848] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-09-15T19:30:26.172146] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-15T19:30:26.663875] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-15T19:30:26.857902] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-09-15T19:30:27.273349] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-15T19:30:27.329909] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-15T19:30:27.657875] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-09-15T19:30:27.979314] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-15T19:30:28.457888] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-09-15T19:30:28.870377] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-15T19:30:29.257879] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-09-15T19:30:30.057935] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-09-15T19:30:30.661510] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-15T19:30:30.857879] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-09-15T19:30:31.657949] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-09-15T19:30:31.796890] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-15T19:30:32.017266] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-15T19:30:32.418874] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-15T19:30:32.457856] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-09-15T19:30:33.257899] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-09-15T19:30:34.007895] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-15T19:30:34.057816] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-09-15T19:30:34.620872] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-15T19:30:34.857866] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-09-15T19:30:35.381391] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-15T19:30:35.657880] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-09-15T19:30:36.072212] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-15T19:30:36.457882] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-09-15T19:30:37.135522] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-15T19:30:37.257875] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-09-15T19:30:37.756906] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-15T19:30:38.057906] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-09-15T19:30:38.611827] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-15T19:30:38.857917] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-09-15T19:30:39.372937] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-15T19:30:39.657893] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-09-15T19:30:39.926433] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-15T19:30:40.142682] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-15T19:30:40.457934] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-09-15T19:30:40.907208] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-15T19:30:41.257914] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-09-15T19:30:42.057942] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-09-15T19:30:42.573470] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-15T19:30:42.578378] [INFO ] [REMOTE ] MTN: Full fetch complete (42302 records). [2025-09-15T19:30:42.578520] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-09-15T19:30:42.866450] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-09-15T19:30:42.965566] [DEBUG] [VALIDATOR ] MTN: All expected trading days are present. [2025-09-15T19:30:42.965689] [DEBUG] [VALIDATOR ] MTN: Primary data validation passed. [2025-09-15T19:30:42.966456] [INFO ] [MAIN ] MTN: Fetched primary data is valid. [2025-09-15T19:30:42.966501] [DEBUG] [LOCAL ] MTN: Saving primary data. [2025-09-15T19:30:42.967662] [DEBUG] [LOCAL ] MTN: Trimmed 42302 records to 28572 (keeping 150 days of data) [2025-09-15T19:30:43.157503] [DEBUG] [LOCAL ] MTN: Primary data saved (28572 records). [2025-09-15T19:30:43.157683] [INFO ] [MAIN ] MTN: Full history saved. [2025-09-15T19:30:43.157798] [INFO ] [MAIN ] Update Progress: 1419/2369 symbols completed. MTN took 22.1s. Estimated remaining: 1h 40m 52s. Rate: 9.4 symbols/min [2025-09-15T19:30:43.331057] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:30:43.348339] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-15T19:30:43.354605] [INFO ] [REMOTE ] MTH: Full fetch complete (47970 records). [2025-09-15T19:30:43.354755] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-09-15T19:30:43.495440] [DEBUG] [LOCAL ] MTRN: Loaded 13788 existing records from primary storage. [2025-09-15T19:30:43.501461] [INFO ] [MAIN ] MTRN: Loaded 13788 existing records. [2025-09-15T19:30:43.673733] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-09-15T19:30:43.879837] [WARN ] [MAIN ] MTRN: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:30:43.917394] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-09-15T19:30:43.933453] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-09-15T19:30:43.943763] [DEBUG] [LOCAL ] MTRN: Deleted primary data file. [2025-09-15T19:30:43.943863] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-09-15T19:30:44.159403] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-15T19:30:44.215563] [DEBUG] [VALIDATOR ] MTH: All expected trading days are present. [2025-09-15T19:30:44.228835] [DEBUG] [VALIDATOR ] MTH: Primary data validation passed. [2025-09-15T19:30:44.230782] [INFO ] [MAIN ] MTH: Fetched primary data is valid. [2025-09-15T19:30:44.247337] [DEBUG] [LOCAL ] MTH: Saving primary data. [2025-09-15T19:30:44.364999] [DEBUG] [LOCAL ] MTH: Trimmed 47970 records to 32137 (keeping 150 days of data) [2025-09-15T19:30:44.470084] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-09-15T19:30:44.510313] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:30:44.689827] [DEBUG] [LOCAL ] MTH: Primary data saved (32137 records). [2025-09-15T19:30:44.690407] [INFO ] [MAIN ] MTH: Full history saved. [2025-09-15T19:30:44.692438] [INFO ] [MAIN ] Update Progress: 1420/2369 symbols completed. MTH took 24.9s. Estimated remaining: 1h 40m 42s. Rate: 9.4 symbols/min [2025-09-15T19:30:44.691738] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-15T19:30:44.875235] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:30:44.900818] [DEBUG] [LOCAL ] MTUS: Loaded 21091 existing records from primary storage. [2025-09-15T19:30:44.900945] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-15T19:30:44.901850] [INFO ] [REMOTE ] MTR: Full fetch complete (1926 records). [2025-09-15T19:30:44.901937] [INFO ] [MAIN ] MTUS: Loaded 21091 existing records. [2025-09-15T19:30:44.902026] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-09-15T19:30:45.272629] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-09-15T19:30:45.290914] [WARN ] [MAIN ] MTUS: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:30:45.376072] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-09-15T19:30:45.379564] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-09-15T19:30:45.385687] [DEBUG] [LOCAL ] MTUS: Deleted primary data file. [2025-09-15T19:30:45.396039] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-09-15T19:30:45.544335] [DEBUG] [VALIDATOR ] MTR: All expected trading days are present. [2025-09-15T19:30:45.563182] [DEBUG] [VALIDATOR ] MTR: Primary data validation passed. [2025-09-15T19:30:45.565779] [INFO ] [MAIN ] MTR: Fetched primary data is valid. [2025-09-15T19:30:45.566125] [DEBUG] [LOCAL ] MTR: Saving primary data. [2025-09-15T19:30:45.582328] [DEBUG] [LOCAL ] MTR: Trimmed 1926 records to 1586 (keeping 150 days of data) [2025-09-15T19:30:45.652259] [DEBUG] [LOCAL ] MTR: Primary data saved (1586 records). [2025-09-15T19:30:45.719109] [INFO ] [MAIN ] MTR: Full history saved. [2025-09-15T19:30:45.746057] [INFO ] [MAIN ] Update Progress: 1421/2369 symbols completed. MTR took 22.3s. Estimated remaining: 1h 40m 33s. Rate: 9.4 symbols/min [2025-09-15T19:30:45.936136] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:30:46.006408] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:30:46.026405] [DEBUG] [LOCAL ] MTW: Loaded 20093 existing records from primary storage. [2025-09-15T19:30:46.026568] [INFO ] [MAIN ] MTW: Loaded 20093 existing records. [2025-09-15T19:30:46.062928] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-09-15T19:30:46.216889] [WARN ] [MAIN ] MTW: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:30:46.217333] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-09-15T19:30:46.217390] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-09-15T19:30:46.218115] [DEBUG] [LOCAL ] MTW: Deleted primary data file. [2025-09-15T19:30:46.218177] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-09-15T19:30:46.599519] [INFO ] [REMOTE ] MTW: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:30:46.681728] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-15T19:30:46.794091] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-15T19:30:46.857886] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-09-15T19:30:47.657978] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-09-15T19:30:47.961417] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-15T19:30:48.237858] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-15T19:30:48.457911] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-09-15T19:30:49.257896] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-09-15T19:30:49.284217] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-15T19:30:50.057893] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-09-15T19:30:50.300746] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-15T19:30:50.857924] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-09-15T19:30:51.156083] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-15T19:30:51.657881] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-09-15T19:30:52.049201] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-15T19:30:52.054879] [INFO ] [REMOTE ] MTG: Full fetch complete (55864 records). [2025-09-15T19:30:52.055000] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-09-15T19:30:52.432523] [DEBUG] [VALIDATOR ] MTG: All expected trading days are present. [2025-09-15T19:30:52.432608] [DEBUG] [VALIDATOR ] MTG: Primary data validation passed. [2025-09-15T19:30:52.433497] [INFO ] [MAIN ] MTG: Fetched primary data is valid. [2025-09-15T19:30:52.433544] [DEBUG] [LOCAL ] MTG: Saving primary data. [2025-09-15T19:30:52.434763] [DEBUG] [LOCAL ] MTG: Trimmed 55864 records to 37536 (keeping 150 days of data) [2025-09-15T19:30:52.492414] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-09-15T19:30:52.701576] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-15T19:30:52.725325] [DEBUG] [LOCAL ] MTG: Primary data saved (37536 records). [2025-09-15T19:30:52.725706] [INFO ] [MAIN ] MTG: Full history saved. [2025-09-15T19:30:52.727219] [INFO ] [MAIN ] Update Progress: 1422/2369 symbols completed. MTG took 38.3s. Estimated remaining: 1h 40m 27s. Rate: 9.4 symbols/min [2025-09-15T19:30:52.897683] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:30:52.915920] [DEBUG] [LOCAL ] MTX: Loaded 17744 existing records from primary storage. [2025-09-15T19:30:52.916054] [INFO ] [MAIN ] MTX: Loaded 17744 existing records. [2025-09-15T19:30:53.091511] [WARN ] [MAIN ] MTX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:30:53.091829] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-09-15T19:30:53.091878] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-09-15T19:30:53.092459] [DEBUG] [LOCAL ] MTX: Deleted primary data file. [2025-09-15T19:30:53.092509] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-09-15T19:30:53.263939] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-09-15T19:30:53.451303] [INFO ] [REMOTE ] MTX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:30:53.631133] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-15T19:30:54.057835] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-09-15T19:30:54.402657] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-15T19:30:54.857838] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-09-15T19:30:54.917997] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-15T19:30:55.657884] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-09-15T19:30:55.771808] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-15T19:30:56.457858] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-09-15T19:30:56.831887] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-15T19:30:57.079939] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-15T19:30:57.257872] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-09-15T19:30:58.057905] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-09-15T19:30:58.125441] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-15T19:30:58.127440] [INFO ] [REMOTE ] MTRN: Full fetch complete (18849 records). [2025-09-15T19:30:58.127552] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-09-15T19:30:58.488030] [DEBUG] [VALIDATOR ] MTRN: All expected trading days are present. [2025-09-15T19:30:58.488110] [DEBUG] [VALIDATOR ] MTRN: Primary data validation passed. [2025-09-15T19:30:58.488507] [INFO ] [MAIN ] MTRN: Fetched primary data is valid. [2025-09-15T19:30:58.488547] [DEBUG] [LOCAL ] MTRN: Saving primary data. [2025-09-15T19:30:58.489145] [DEBUG] [LOCAL ] MTRN: Trimmed 18849 records to 13585 (keeping 150 days of data) [2025-09-15T19:30:58.581689] [DEBUG] [LOCAL ] MTRN: Primary data saved (13585 records). [2025-09-15T19:30:58.581917] [INFO ] [MAIN ] MTRN: Full history saved. [2025-09-15T19:30:58.582068] [INFO ] [MAIN ] Update Progress: 1423/2369 symbols completed. MTRN took 15.4s. Estimated remaining: 1h 40m 20s. Rate: 9.4 symbols/min [2025-09-15T19:30:58.759009] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:30:58.794023] [DEBUG] [LOCAL ] MTZ: Loaded 32078 existing records from primary storage. [2025-09-15T19:30:58.794228] [INFO ] [MAIN ] MTZ: Loaded 32078 existing records. [2025-09-15T19:30:58.862963] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-09-15T19:30:58.978093] [WARN ] [MAIN ] MTZ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:30:58.978340] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-09-15T19:30:58.978387] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-09-15T19:30:58.979192] [DEBUG] [LOCAL ] MTZ: Deleted primary data file. [2025-09-15T19:30:58.979253] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-09-15T19:30:59.343274] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:30:59.360164] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-15T19:30:59.657897] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-09-15T19:30:59.674963] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-15T19:31:00.457947] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-09-15T19:31:00.864830] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-15T19:31:01.257921] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-09-15T19:31:01.869816] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-15T19:31:02.057894] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-09-15T19:31:02.409692] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-15T19:31:02.857846] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-09-15T19:31:03.009523] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-15T19:31:03.657936] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-09-15T19:31:03.954109] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-15T19:31:04.457899] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-09-15T19:31:05.256944] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-15T19:31:05.266262] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-09-15T19:31:05.302472] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-15T19:31:06.057870] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-09-15T19:31:06.277299] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-15T19:31:06.857875] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-09-15T19:31:07.281694] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-15T19:31:07.657874] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-09-15T19:31:07.905119] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-15T19:31:08.457910] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-09-15T19:31:09.050610] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-15T19:31:09.257901] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-09-15T19:31:09.507434] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-15T19:31:10.057881] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-09-15T19:31:10.313181] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-15T19:31:10.857868] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-09-15T19:31:11.068600] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-15T19:31:11.071373] [INFO ] [REMOTE ] MTX: Full fetch complete (24968 records). [2025-09-15T19:31:11.071451] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-09-15T19:31:11.447879] [DEBUG] [VALIDATOR ] MTX: All expected trading days are present. [2025-09-15T19:31:11.447977] [DEBUG] [VALIDATOR ] MTX: Primary data validation passed. [2025-09-15T19:31:11.448565] [INFO ] [MAIN ] MTX: Fetched primary data is valid. [2025-09-15T19:31:11.448606] [DEBUG] [LOCAL ] MTX: Saving primary data. [2025-09-15T19:31:11.449373] [DEBUG] [LOCAL ] MTX: Trimmed 24968 records to 17395 (keeping 150 days of data) [2025-09-15T19:31:11.570512] [DEBUG] [LOCAL ] MTX: Primary data saved (17395 records). [2025-09-15T19:31:11.570677] [INFO ] [MAIN ] MTX: Full history saved. [2025-09-15T19:31:11.570807] [INFO ] [MAIN ] Update Progress: 1424/2369 symbols completed. MTX took 18.8s. Estimated remaining: 1h 40m 18s. Rate: 9.4 symbols/min [2025-09-15T19:31:11.662925] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-09-15T19:31:11.744766] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:31:11.755186] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-15T19:31:11.762477] [INFO ] [REMOTE ] MTUS: Full fetch complete (31823 records). [2025-09-15T19:31:11.762656] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-09-15T19:31:11.834924] [DEBUG] [LOCAL ] MUA: Loaded 8490 existing records from primary storage. [2025-09-15T19:31:11.852063] [INFO ] [MAIN ] MUA: Loaded 8490 existing records. [2025-09-15T19:31:12.245533] [WARN ] [MAIN ] MUA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:31:12.248710] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-09-15T19:31:12.248814] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-09-15T19:31:12.265300] [DEBUG] [LOCAL ] MUA: Deleted primary data file. [2025-09-15T19:31:12.306710] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-09-15T19:31:12.438241] [DEBUG] [VALIDATOR ] MTUS: All expected trading days are present. [2025-09-15T19:31:12.449178] [DEBUG] [VALIDATOR ] MTUS: Primary data validation passed. [2025-09-15T19:31:12.459581] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-09-15T19:31:12.460506] [INFO ] [MAIN ] MTUS: Fetched primary data is valid. [2025-09-15T19:31:12.465742] [DEBUG] [LOCAL ] MTUS: Saving primary data. [2025-09-15T19:31:12.542554] [DEBUG] [LOCAL ] MTUS: Trimmed 31823 records to 20687 (keeping 150 days of data) [2025-09-15T19:31:12.791403] [INFO ] [REMOTE ] MUA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:31:12.827409] [DEBUG] [LOCAL ] MTUS: Primary data saved (20687 records). [2025-09-15T19:31:12.827534] [INFO ] [MAIN ] MTUS: Full history saved. [2025-09-15T19:31:12.827668] [INFO ] [MAIN ] Update Progress: 1425/2369 symbols completed. MTUS took 28.1s. Estimated remaining: 1h 40m 8s. Rate: 9.4 symbols/min [2025-09-15T19:31:12.996775] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:31:13.012799] [DEBUG] [LOCAL ] MUC: Loaded 14665 existing records from primary storage. [2025-09-15T19:31:13.012970] [INFO ] [MAIN ] MUC: Loaded 14665 existing records. [2025-09-15T19:31:13.192865] [WARN ] [MAIN ] MUC: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:31:13.193190] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-09-15T19:31:13.193467] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-09-15T19:31:13.193992] [DEBUG] [LOCAL ] MUC: Deleted primary data file. [2025-09-15T19:31:13.194102] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-09-15T19:31:13.262971] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-09-15T19:31:13.574966] [INFO ] [REMOTE ] MUC: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:31:13.577004] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-15T19:31:13.679867] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-15T19:31:13.780991] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-15T19:31:14.057870] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-09-15T19:31:14.857934] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-09-15T19:31:15.354515] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-15T19:31:15.657870] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-09-15T19:31:15.786956] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-15T19:31:16.457870] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-09-15T19:31:16.684837] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-15T19:31:17.257878] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-09-15T19:31:17.824743] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-15T19:31:17.875381] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-15T19:31:18.057857] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-09-15T19:31:18.857948] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-09-15T19:31:19.030296] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-15T19:31:19.657887] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-09-15T19:31:19.874514] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-15T19:31:19.877506] [INFO ] [REMOTE ] MTW: Full fetch complete (29429 records). [2025-09-15T19:31:19.877607] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-09-15T19:31:20.245758] [DEBUG] [VALIDATOR ] MTW: All expected trading days are present. [2025-09-15T19:31:20.245894] [DEBUG] [VALIDATOR ] MTW: Primary data validation passed. [2025-09-15T19:31:20.246573] [INFO ] [MAIN ] MTW: Fetched primary data is valid. [2025-09-15T19:31:20.247199] [DEBUG] [LOCAL ] MTW: Saving primary data. [2025-09-15T19:31:20.248252] [DEBUG] [LOCAL ] MTW: Trimmed 29429 records to 19697 (keeping 150 days of data) [2025-09-15T19:31:20.368309] [DEBUG] [LOCAL ] MTW: Primary data saved (19697 records). [2025-09-15T19:31:20.368462] [INFO ] [MAIN ] MTW: Full history saved. [2025-09-15T19:31:20.368562] [INFO ] [MAIN ] Update Progress: 1426/2369 symbols completed. MTW took 34.6s. Estimated remaining: 1h 40m 3s. Rate: 9.4 symbols/min [2025-09-15T19:31:20.458324] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-09-15T19:31:20.540498] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:31:20.554099] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-15T19:31:20.566003] [DEBUG] [LOCAL ] MUE: Loaded 9473 existing records from primary storage. [2025-09-15T19:31:20.566104] [INFO ] [MAIN ] MUE: Loaded 9473 existing records. [2025-09-15T19:31:20.745852] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:31:20.746149] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-09-15T19:31:20.746204] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-09-15T19:31:20.746581] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-09-15T19:31:20.746629] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-09-15T19:31:21.098625] [INFO ] [REMOTE ] MUE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:31:21.257879] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-09-15T19:31:22.057860] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-09-15T19:31:22.206065] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-15T19:31:22.282322] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-15T19:31:22.479341] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-15T19:31:22.857953] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-09-15T19:31:23.657904] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-09-15T19:31:24.457981] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-09-15T19:31:24.534971] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-15T19:31:24.565462] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-15T19:31:25.037816] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-15T19:31:25.257879] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-09-15T19:31:26.057893] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-09-15T19:31:26.101561] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-15T19:31:26.857878] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-09-15T19:31:26.969783] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-15T19:31:27.657924] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-09-15T19:31:28.075714] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-15T19:31:28.080931] [INFO ] [REMOTE ] MTZ: Full fetch complete (47569 records). [2025-09-15T19:31:28.081023] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-09-15T19:31:28.329258] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-15T19:31:28.469891] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-09-15T19:31:28.487443] [DEBUG] [VALIDATOR ] MTZ: All expected trading days are present. [2025-09-15T19:31:28.487534] [DEBUG] [VALIDATOR ] MTZ: Primary data validation passed. [2025-09-15T19:31:28.488444] [INFO ] [MAIN ] MTZ: Fetched primary data is valid. [2025-09-15T19:31:28.488506] [DEBUG] [LOCAL ] MTZ: Saving primary data. [2025-09-15T19:31:28.489900] [DEBUG] [LOCAL ] MTZ: Trimmed 47569 records to 31459 (keeping 150 days of data) [2025-09-15T19:31:28.694684] [DEBUG] [LOCAL ] MTZ: Primary data saved (31459 records). [2025-09-15T19:31:28.694834] [INFO ] [MAIN ] MTZ: Full history saved. [2025-09-15T19:31:28.694945] [INFO ] [MAIN ] Update Progress: 1427/2369 symbols completed. MTZ took 30.1s. Estimated remaining: 1h 39m 57s. Rate: 9.4 symbols/min [2025-09-15T19:31:28.867219] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:31:28.910211] [DEBUG] [LOCAL ] MUFG: Loaded 39562 existing records from primary storage. [2025-09-15T19:31:28.910402] [INFO ] [MAIN ] MUFG: Loaded 39562 existing records. [2025-09-15T19:31:29.087696] [WARN ] [MAIN ] MUFG: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:31:29.088048] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-09-15T19:31:29.088096] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-09-15T19:31:29.089041] [DEBUG] [LOCAL ] MUFG: Deleted primary data file. [2025-09-15T19:31:29.089093] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-09-15T19:31:29.271139] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-15T19:31:29.270455] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-09-15T19:31:29.456844] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:31:30.057884] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-09-15T19:31:30.108082] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-15T19:31:30.697669] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-15T19:31:30.857888] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-09-15T19:31:31.657904] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-09-15T19:31:31.722121] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-15T19:31:32.457927] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-09-15T19:31:32.634295] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-15T19:31:33.257886] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-09-15T19:31:33.972372] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-15T19:31:34.020260] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-15T19:31:34.057858] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-09-15T19:31:34.857922] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-09-15T19:31:35.657838] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-09-15T19:31:35.698008] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-15T19:31:35.723965] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-15T19:31:35.725798] [INFO ] [REMOTE ] MUA: Full fetch complete (13602 records). [2025-09-15T19:31:35.725872] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-09-15T19:31:36.080412] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-09-15T19:31:36.080488] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-09-15T19:31:36.080799] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-09-15T19:31:36.080840] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-09-15T19:31:36.081335] [DEBUG] [LOCAL ] MUA: Trimmed 13602 records to 8367 (keeping 150 days of data) [2025-09-15T19:31:36.134471] [DEBUG] [LOCAL ] MUA: Primary data saved (8367 records). [2025-09-15T19:31:36.134595] [INFO ] [MAIN ] MUA: Full history saved. [2025-09-15T19:31:36.134707] [INFO ] [MAIN ] Update Progress: 1428/2369 symbols completed. MUA took 24.6s. Estimated remaining: 1h 39m 52s. Rate: 9.4 symbols/min [2025-09-15T19:31:36.305478] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:31:36.316568] [DEBUG] [LOCAL ] MUJ: Loaded 10212 existing records from primary storage. [2025-09-15T19:31:36.316692] [INFO ] [MAIN ] MUJ: Loaded 10212 existing records. [2025-09-15T19:31:36.463983] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-09-15T19:31:36.491856] [WARN ] [MAIN ] MUJ: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:31:36.492010] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-09-15T19:31:36.492054] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-09-15T19:31:36.492487] [DEBUG] [LOCAL ] MUJ: Deleted primary data file. [2025-09-15T19:31:36.492535] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-09-15T19:31:36.825231] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-15T19:31:36.866357] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:31:37.257866] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-09-15T19:31:37.334244] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-15T19:31:37.872242] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-15T19:31:38.057885] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-09-15T19:31:38.861778] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-09-15T19:31:38.862791] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-15T19:31:39.657874] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-09-15T19:31:39.740284] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-15T19:31:40.457892] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-09-15T19:31:40.644632] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-15T19:31:40.647499] [INFO ] [REMOTE ] MUC: Full fetch complete (21393 records). [2025-09-15T19:31:40.647580] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-09-15T19:31:41.011469] [DEBUG] [VALIDATOR ] MUC: All expected trading days are present. [2025-09-15T19:31:41.011560] [DEBUG] [VALIDATOR ] MUC: Primary data validation passed. [2025-09-15T19:31:41.012077] [INFO ] [MAIN ] MUC: Fetched primary data is valid. [2025-09-15T19:31:41.012122] [DEBUG] [LOCAL ] MUC: Saving primary data. [2025-09-15T19:31:41.012744] [DEBUG] [LOCAL ] MUC: Trimmed 21393 records to 14348 (keeping 150 days of data) [2025-09-15T19:31:41.098980] [DEBUG] [LOCAL ] MUC: Primary data saved (14348 records). [2025-09-15T19:31:41.099112] [INFO ] [MAIN ] MUC: Full history saved. [2025-09-15T19:31:41.099203] [INFO ] [MAIN ] Update Progress: 1429/2369 symbols completed. MUC took 28.3s. Estimated remaining: 1h 39m 45s. Rate: 9.4 symbols/min [2025-09-15T19:31:41.268357] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:31:41.265336] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-09-15T19:31:41.310111] [DEBUG] [LOCAL ] MUR: Loaded 39754 existing records from primary storage. [2025-09-15T19:31:41.310247] [INFO ] [MAIN ] MUR: Loaded 39754 existing records. [2025-09-15T19:31:41.492559] [WARN ] [MAIN ] MUR: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:31:41.492866] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-09-15T19:31:41.492914] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-09-15T19:31:41.493941] [DEBUG] [LOCAL ] MUR: Deleted primary data file. [2025-09-15T19:31:41.493995] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-09-15T19:31:41.868403] [INFO ] [REMOTE ] MUR: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:31:42.064518] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-09-15T19:31:42.088359] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-15T19:31:42.158616] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-15T19:31:42.160592] [INFO ] [REMOTE ] MUE: Full fetch complete (12507 records). [2025-09-15T19:31:42.160687] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-09-15T19:31:42.517608] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-09-15T19:31:42.517704] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-09-15T19:31:42.518003] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-09-15T19:31:42.518048] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-09-15T19:31:42.518532] [DEBUG] [LOCAL ] MUE: Trimmed 12507 records to 9308 (keeping 150 days of data) [2025-09-15T19:31:42.575717] [DEBUG] [LOCAL ] MUE: Primary data saved (9308 records). [2025-09-15T19:31:42.575886] [INFO ] [MAIN ] MUE: Full history saved. [2025-09-15T19:31:42.575977] [INFO ] [MAIN ] Update Progress: 1430/2369 symbols completed. MUE took 22.2s. Estimated remaining: 1h 39m 35s. Rate: 9.4 symbols/min [2025-09-15T19:31:42.756266] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:31:42.767505] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-15T19:31:42.787211] [DEBUG] [LOCAL ] MUSA: Loaded 18803 existing records from primary storage. [2025-09-15T19:31:42.787341] [INFO ] [MAIN ] MUSA: Loaded 18803 existing records. [2025-09-15T19:31:42.863049] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-09-15T19:31:42.998794] [WARN ] [MAIN ] MUSA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:31:42.999041] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-09-15T19:31:42.999086] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-09-15T19:31:42.999631] [DEBUG] [LOCAL ] MUSA: Deleted primary data file. [2025-09-15T19:31:42.999711] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-09-15T19:31:43.351676] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:31:43.657881] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-09-15T19:31:44.457839] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-09-15T19:31:44.704705] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-15T19:31:44.855898] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-15T19:31:45.232395] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-15T19:31:45.257823] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-09-15T19:31:45.977372] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-15T19:31:46.057907] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-09-15T19:31:46.857876] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-09-15T19:31:47.226343] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-15T19:31:47.657863] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-09-15T19:31:48.408734] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-15T19:31:48.457855] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-09-15T19:31:48.598492] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-15T19:31:49.257880] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-09-15T19:31:49.926423] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-15T19:31:50.057871] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-09-15T19:31:50.857885] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-09-15T19:31:50.945059] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-15T19:31:50.999232] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-15T19:31:51.657919] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-09-15T19:31:52.251697] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-15T19:31:52.457910] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-09-15T19:31:53.114071] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-15T19:31:53.257869] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-09-15T19:31:54.057829] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-09-15T19:31:54.178914] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-15T19:31:54.523022] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-15T19:31:54.857874] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-09-15T19:31:55.503547] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-15T19:31:55.516403] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-15T19:31:55.657866] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-09-15T19:31:56.457921] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-09-15T19:31:57.163374] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-15T19:31:57.166117] [INFO ] [REMOTE ] MUJ: Full fetch complete (13883 records). [2025-09-15T19:31:57.166217] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-09-15T19:31:57.268183] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-09-15T19:31:57.551304] [DEBUG] [VALIDATOR ] MUJ: All expected trading days are present. [2025-09-15T19:31:57.551473] [DEBUG] [VALIDATOR ] MUJ: Primary data validation passed. [2025-09-15T19:31:57.552082] [INFO ] [MAIN ] MUJ: Fetched primary data is valid. [2025-09-15T19:31:57.552172] [DEBUG] [LOCAL ] MUJ: Saving primary data. [2025-09-15T19:31:57.552827] [DEBUG] [LOCAL ] MUJ: Trimmed 13883 records to 10188 (keeping 150 days of data) [2025-09-15T19:31:57.650592] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-15T19:31:57.668070] [DEBUG] [LOCAL ] MUJ: Primary data saved (10188 records). [2025-09-15T19:31:57.668345] [INFO ] [MAIN ] MUJ: Full history saved. [2025-09-15T19:31:57.668451] [INFO ] [MAIN ] Update Progress: 1431/2369 symbols completed. MUJ took 21.5s. Estimated remaining: 1h 39m 34s. Rate: 9.4 symbols/min [2025-09-15T19:31:57.839840] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:31:57.840068] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-09-15T19:31:57.840109] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-09-15T19:31:57.840231] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-09-15T19:31:57.840272] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-15T19:31:57.840316] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-15T19:31:57.840351] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-09-15T19:31:58.063009] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-09-15T19:31:58.196206] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:31:58.214597] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-15T19:31:58.857906] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-02. [2025-09-15T19:31:59.113033] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:31:59.113378] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-02 [2025-09-15T19:31:59.657868] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-09-15T19:31:59.793548] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-15T19:31:59.799231] [INFO ] [REMOTE ] MUFG: Full fetch complete (57152 records). [2025-09-15T19:31:59.799330] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-09-15T19:32:00.180193] [DEBUG] [VALIDATOR ] MUFG: All expected trading days are present. [2025-09-15T19:32:00.180286] [DEBUG] [VALIDATOR ] MUFG: Primary data validation passed. [2025-09-15T19:32:00.181256] [INFO ] [MAIN ] MUFG: Fetched primary data is valid. [2025-09-15T19:32:00.181347] [DEBUG] [LOCAL ] MUFG: Saving primary data. [2025-09-15T19:32:00.182695] [DEBUG] [LOCAL ] MUFG: Trimmed 57152 records to 38767 (keeping 150 days of data) [2025-09-15T19:32:00.424069] [DEBUG] [LOCAL ] MUFG: Primary data saved (38767 records). [2025-09-15T19:32:00.424282] [INFO ] [MAIN ] MUFG: Full history saved. [2025-09-15T19:32:00.424414] [INFO ] [MAIN ] Update Progress: 1432/2369 symbols completed. MUFG took 31.7s. Estimated remaining: 1h 39m 26s. Rate: 9.4 symbols/min [2025-09-15T19:32:00.464847] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-03. [2025-09-15T19:32:00.616865] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:32:00.648487] [DEBUG] [LOCAL ] MUX: Loaded 31410 existing records from primary storage. [2025-09-15T19:32:00.648661] [INFO ] [MAIN ] MUX: Loaded 31410 existing records. [2025-09-15T19:32:00.841144] [WARN ] [MAIN ] MUX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:32:00.841960] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-09-15T19:32:00.842496] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-15T19:32:00.842603] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-09-15T19:32:00.848946] [DEBUG] [LOCAL ] MUX: Deleted primary data file. [2025-09-15T19:32:00.849005] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-09-15T19:32:00.958485] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-15T19:32:01.216321] [INFO ] [REMOTE ] MUX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:32:01.257835] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-04. [2025-09-15T19:32:01.505681] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-09-15T19:32:02.057872] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-09-15T19:32:02.857880] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-09-15T19:32:03.657888] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-05. [2025-09-15T19:32:03.785423] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-15T19:32:03.976253] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-15T19:32:04.008416] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-15T19:32:04.457872] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-09-15T19:32:05.257875] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-09-15T19:32:06.072274] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-09-15T19:32:06.107498] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-15T19:32:06.225967] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-15T19:32:06.229236] [INFO ] [REMOTE ] MUSA: Full fetch complete (27511 records). [2025-09-15T19:32:06.229354] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-09-15T19:32:06.607863] [DEBUG] [VALIDATOR ] MUSA: All expected trading days are present. [2025-09-15T19:32:06.607963] [DEBUG] [VALIDATOR ] MUSA: Primary data validation passed. [2025-09-15T19:32:06.608604] [INFO ] [MAIN ] MUSA: Fetched primary data is valid. [2025-09-15T19:32:06.608681] [DEBUG] [LOCAL ] MUSA: Saving primary data. [2025-09-15T19:32:06.609465] [DEBUG] [LOCAL ] MUSA: Trimmed 27511 records to 18513 (keeping 150 days of data) [2025-09-15T19:32:06.729329] [DEBUG] [LOCAL ] MUSA: Primary data saved (18513 records). [2025-09-15T19:32:06.729498] [INFO ] [MAIN ] MUSA: Full history saved. [2025-09-15T19:32:06.729620] [INFO ] [MAIN ] Update Progress: 1433/2369 symbols completed. MUSA took 24.2s. Estimated remaining: 1h 39m 19s. Rate: 9.4 symbols/min [2025-09-15T19:32:06.869056] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-06. [2025-09-15T19:32:06.901430] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:32:06.911872] [DEBUG] [LOCAL ] MVF: Loaded 9100 existing records from primary storage. [2025-09-15T19:32:06.912007] [INFO ] [MAIN ] MVF: Loaded 9100 existing records. [2025-09-15T19:32:07.091458] [WARN ] [MAIN ] MVF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:32:07.091764] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-09-15T19:32:07.091818] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-09-15T19:32:07.092218] [DEBUG] [LOCAL ] MVF: Deleted primary data file. [2025-09-15T19:32:07.092267] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-09-15T19:32:07.138374] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-15T19:32:07.449090] [INFO ] [REMOTE ] MVF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:32:07.513332] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-15T19:32:07.657871] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-07. [2025-09-15T19:32:07.871183] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-09-15T19:32:08.457861] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-08. [2025-09-15T19:32:08.668940] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-08 (0.21 seconds). [2025-09-15T19:32:09.257869] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-09-15T19:32:09.848087] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-15T19:32:10.057885] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-09. [2025-09-15T19:32:10.530524] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-15T19:32:10.530869] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-09 [2025-09-15T19:32:10.530962] [INFO ] [REMOTE ] MUSE: Full fetch complete (95 records). [2025-09-15T19:32:10.531025] [DEBUG] [VALIDATOR ] MUSE: Validating primary data. [2025-09-15T19:32:10.531626] [FATAL] [VALIDATOR ] MUSE: Data is stale - most recent date (2025-08-05) is before last completed trading day (2025-09-15). Symbol may be delisted or halted. [2025-09-15T19:32:10.531720] [FATAL] [MAIN ] MUSE: Fetched primary data is invalid. Refusing to save it. [2025-09-15T19:32:10.531757] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to validation failure. [2025-09-15T19:32:10.531794] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-15T19:32:10.531853] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-15T19:32:10.531888] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-09-15T19:32:10.531973] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-09-15T19:32:10.532044] [INFO ] [MAIN ] Update Progress: 1434/2369 symbols completed. MUSE took 12.9s. Estimated remaining: 1h 39m 11s. Rate: 9.4 symbols/min [2025-09-15T19:32:10.703457] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:32:10.711884] [DEBUG] [LOCAL ] MVO: Loaded 6506 existing records from primary storage. [2025-09-15T19:32:10.712024] [INFO ] [MAIN ] MVO: Loaded 6506 existing records. [2025-09-15T19:32:10.868707] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-09-15T19:32:10.895252] [WARN ] [MAIN ] MVO: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:32:10.895844] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-09-15T19:32:10.895898] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-09-15T19:32:10.896368] [DEBUG] [LOCAL ] MVO: Deleted primary data file. [2025-09-15T19:32:10.896437] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-09-15T19:32:11.260467] [INFO ] [REMOTE ] MVO: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:32:11.657877] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-09-15T19:32:11.852885] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-15T19:32:12.457855] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-09-15T19:32:13.029325] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-15T19:32:13.035382] [INFO ] [REMOTE ] MUR: Full fetch complete (57587 records). [2025-09-15T19:32:13.035521] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-09-15T19:32:13.260300] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-09-15T19:32:13.255103] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-15T19:32:13.490635] [DEBUG] [VALIDATOR ] MUR: All expected trading days are present. [2025-09-15T19:32:13.490737] [DEBUG] [VALIDATOR ] MUR: Primary data validation passed. [2025-09-15T19:32:13.491609] [INFO ] [MAIN ] MUR: Fetched primary data is valid. [2025-09-15T19:32:13.491670] [DEBUG] [LOCAL ] MUR: Saving primary data. [2025-09-15T19:32:13.492856] [DEBUG] [LOCAL ] MUR: Trimmed 57587 records to 38975 (keeping 150 days of data) [2025-09-15T19:32:13.741324] [DEBUG] [LOCAL ] MUR: Primary data saved (38975 records). [2025-09-15T19:32:13.741481] [INFO ] [MAIN ] MUR: Full history saved. [2025-09-15T19:32:13.742389] [INFO ] [MAIN ] Update Progress: 1435/2369 symbols completed. MUR took 32.6s. Estimated remaining: 1h 39m 3s. Rate: 9.4 symbols/min [2025-09-15T19:32:13.917877] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:32:13.928483] [DEBUG] [LOCAL ] MVT: Loaded 7495 existing records from primary storage. [2025-09-15T19:32:13.928623] [INFO ] [MAIN ] MVT: Loaded 7495 existing records. [2025-09-15T19:32:14.068717] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-09-15T19:32:14.106716] [WARN ] [MAIN ] MVT: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:32:14.106950] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-09-15T19:32:14.106996] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-09-15T19:32:14.107314] [DEBUG] [LOCAL ] MVT: Deleted primary data file. [2025-09-15T19:32:14.107360] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-09-15T19:32:14.292116] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-15T19:32:14.479399] [INFO ] [REMOTE ] MVT: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:32:14.857896] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-09-15T19:32:15.453457] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-15T19:32:15.610611] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-15T19:32:15.657895] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-09-15T19:32:16.219112] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-15T19:32:16.457928] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-09-15T19:32:17.113320] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-15T19:32:17.257882] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-09-15T19:32:18.024131] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-15T19:32:18.057914] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-09-15T19:32:18.857897] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-09-15T19:32:19.212517] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-15T19:32:19.425872] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-15T19:32:19.657865] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-09-15T19:32:20.457886] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-09-15T19:32:21.070542] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-15T19:32:21.257908] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-09-15T19:32:21.291552] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-15T19:32:22.057914] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-09-15T19:32:22.374666] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-15T19:32:22.853926] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-15T19:32:22.857802] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-09-15T19:32:23.330748] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-15T19:32:23.657900] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-09-15T19:32:24.450207] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-15T19:32:24.457823] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-09-15T19:32:25.099056] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-15T19:32:25.257876] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-09-15T19:32:26.057917] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-09-15T19:32:26.805175] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-15T19:32:26.867661] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-09-15T19:32:26.870450] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-15T19:32:27.657926] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-09-15T19:32:27.718361] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-15T19:32:28.457880] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-09-15T19:32:29.211739] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-15T19:32:29.213903] [INFO ] [REMOTE ] MVF: Full fetch complete (13703 records). [2025-09-15T19:32:29.213989] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-09-15T19:32:29.263007] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-09-15T19:32:29.419466] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-15T19:32:29.641373] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present. [2025-09-15T19:32:29.641472] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed. [2025-09-15T19:32:29.641866] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-09-15T19:32:29.641911] [DEBUG] [LOCAL ] MVF: Saving primary data. [2025-09-15T19:32:29.642455] [DEBUG] [LOCAL ] MVF: Trimmed 13703 records to 8769 (keeping 150 days of data) [2025-09-15T19:32:29.697954] [DEBUG] [LOCAL ] MVF: Primary data saved (8769 records). [2025-09-15T19:32:29.698109] [INFO ] [MAIN ] MVF: Full history saved. [2025-09-15T19:32:29.698213] [INFO ] [MAIN ] Update Progress: 1436/2369 symbols completed. MVF took 23.0s. Estimated remaining: 1h 39m 3s. Rate: 9.4 symbols/min [2025-09-15T19:32:29.887588] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:32:29.930406] [DEBUG] [LOCAL ] MWA: Loaded 34538 existing records from primary storage. [2025-09-15T19:32:29.930603] [INFO ] [MAIN ] MWA: Loaded 34538 existing records. [2025-09-15T19:32:30.063071] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-09-15T19:32:30.117007] [WARN ] [MAIN ] MWA: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:32:30.117252] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-09-15T19:32:30.117301] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-09-15T19:32:30.118146] [DEBUG] [LOCAL ] MWA: Deleted primary data file. [2025-09-15T19:32:30.118210] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-09-15T19:32:30.231080] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-15T19:32:30.489430] [INFO ] [REMOTE ] MWA: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:32:30.857873] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-09-15T19:32:30.877573] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-15T19:32:31.657903] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-09-15T19:32:32.334573] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-15T19:32:32.346113] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-15T19:32:32.348747] [INFO ] [REMOTE ] MUX: Full fetch complete (45654 records). [2025-09-15T19:32:32.349125] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-09-15T19:32:32.462940] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-09-15T19:32:32.736732] [DEBUG] [VALIDATOR ] MUX: All expected trading days are present. [2025-09-15T19:32:32.736815] [DEBUG] [VALIDATOR ] MUX: Primary data validation passed. [2025-09-15T19:32:32.737583] [INFO ] [MAIN ] MUX: Fetched primary data is valid. [2025-09-15T19:32:32.737632] [DEBUG] [LOCAL ] MUX: Saving primary data. [2025-09-15T19:32:32.738680] [DEBUG] [LOCAL ] MUX: Trimmed 45654 records to 30886 (keeping 150 days of data) [2025-09-15T19:32:32.923900] [DEBUG] [LOCAL ] MUX: Primary data saved (30886 records). [2025-09-15T19:32:32.924036] [INFO ] [MAIN ] MUX: Full history saved. [2025-09-15T19:32:32.924130] [INFO ] [MAIN ] Update Progress: 1437/2369 symbols completed. MUX took 32.5s. Estimated remaining: 1h 38m 54s. Rate: 9.4 symbols/min [2025-09-15T19:32:33.090053] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-15T19:32:33.257870] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-09-15T19:32:34.057905] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-09-15T19:32:34.683095] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-15T19:32:34.727808] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-15T19:32:34.729544] [INFO ] [REMOTE ] MVT: Full fetch complete (10464 records). [2025-09-15T19:32:34.729618] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-09-15T19:32:34.869224] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-09-15T19:32:35.093786] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-09-15T19:32:35.093869] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-09-15T19:32:35.094207] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-09-15T19:32:35.094265] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-09-15T19:32:35.094841] [DEBUG] [LOCAL ] MVT: Trimmed 10464 records to 7340 (keeping 150 days of data) [2025-09-15T19:32:35.141443] [DEBUG] [LOCAL ] MVT: Primary data saved (7340 records). [2025-09-15T19:32:35.141587] [INFO ] [MAIN ] MVT: Full history saved. [2025-09-15T19:32:35.141706] [INFO ] [MAIN ] Update Progress: 1438/2369 symbols completed. MVT took 21.4s. Estimated remaining: 1h 38m 45s. Rate: 9.4 symbols/min [2025-09-15T19:32:35.657900] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-09-15T19:32:35.678829] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-15T19:32:36.457908] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-09-15T19:32:37.166114] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-15T19:32:37.167480] [INFO ] [REMOTE ] MVO: Full fetch complete (10058 records). [2025-09-15T19:32:37.167551] [DEBUG] [VALIDATOR ] MVO: Validating primary data. [2025-09-15T19:32:37.525571] [DEBUG] [VALIDATOR ] MVO: All expected trading days are present. [2025-09-15T19:32:37.525699] [DEBUG] [VALIDATOR ] MVO: Primary data validation passed. [2025-09-15T19:32:37.526187] [INFO ] [MAIN ] MVO: Fetched primary data is valid. [2025-09-15T19:32:37.526242] [DEBUG] [LOCAL ] MVO: Saving primary data. [2025-09-15T19:32:37.526812] [DEBUG] [LOCAL ] MVO: Trimmed 10058 records to 6388 (keeping 150 days of data) [2025-09-15T19:32:37.596976] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-15T19:32:37.610866] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-09-15T19:32:37.613456] [DEBUG] [LOCAL ] MVO: Primary data saved (6388 records). [2025-09-15T19:32:37.613598] [INFO ] [MAIN ] MVO: Full history saved. [2025-09-15T19:32:37.614986] [INFO ] [MAIN ] Update Progress: 1439/2369 symbols completed. MVO took 27.1s. Estimated remaining: 1h 38m 36s. Rate: 9.4 symbols/min [2025-09-15T19:32:39.133988] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-15T19:32:39.144830] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-09-15T19:32:40.759910] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-15T19:32:40.774907] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-09-15T19:32:42.215146] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-15T19:32:42.226059] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-09-15T19:32:43.708376] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-15T19:32:43.718504] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-09-15T19:32:45.131005] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-15T19:32:45.142703] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-09-15T19:32:46.311563] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-15T19:32:46.316594] [INFO ] [REMOTE ] MWA: Full fetch complete (51539 records). [2025-09-15T19:32:46.316766] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-09-15T19:32:46.690568] [DEBUG] [VALIDATOR ] MWA: All expected trading days are present. [2025-09-15T19:32:46.690660] [DEBUG] [VALIDATOR ] MWA: Primary data validation passed. [2025-09-15T19:32:46.691408] [INFO ] [MAIN ] MWA: Fetched primary data is valid. [2025-09-15T19:32:46.691448] [DEBUG] [LOCAL ] MWA: Saving primary data. [2025-09-15T19:32:46.692407] [DEBUG] [LOCAL ] MWA: Trimmed 51539 records to 33785 (keeping 150 days of data) [2025-09-15T19:32:46.905927] [DEBUG] [LOCAL ] MWA: Primary data saved (33785 records). [2025-09-15T19:32:46.906108] [INFO ] [MAIN ] MWA: Full history saved. [2025-09-15T19:32:46.906202] [INFO ] [MAIN ] Update Progress: 1440/2369 symbols completed. MWA took 17.2s. Estimated remaining: 1h 38m 32s. Rate: 9.4 symbols/min [2025-09-15T19:32:47.485494] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:32:47.537009] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:32:47.576441] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:32:47.630919] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-09-05 to 2025-09-15. [2025-09-15T19:32:47.636416] [DEBUG] [LOCAL ] MXF: Loaded 4251 existing records from primary storage. [2025-09-15T19:32:47.636677] [INFO ] [MAIN ] MXF: Loaded 4251 existing records. [2025-09-15T19:32:47.636604] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-09-15T19:32:47.642182] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-09-15T19:32:47.666280] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-09-15T19:32:47.699457] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-15T19:32:47.717501] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-15T19:32:47.733309] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-09-15T19:32:47.708438] [DEBUG] [LOCAL ] MYD: Loaded 9439 existing records from primary storage. [2025-09-15T19:32:47.759378] [INFO ] [MAIN ] MYD: Loaded 9439 existing records. [2025-09-15T19:32:48.001744] [WARN ] [MAIN ] MXF: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:32:47.978108] [DEBUG] [LOCAL ] MX: Loaded 16829 existing records from primary storage. [2025-09-15T19:32:48.036530] [INFO ] [MAIN ] MX: Loaded 16829 existing records. [2025-09-15T19:32:48.047014] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-09-15T19:32:48.098784] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-09-15T19:32:48.182873] [DEBUG] [LOCAL ] MXF: Deleted primary data file. [2025-09-15T19:32:48.276584] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-09-15T19:32:48.458573] [WARN ] [MAIN ] MYD: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:32:48.526061] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-09-15T19:32:48.613774] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-09-15T19:32:48.661636] [INFO ] [REMOTE ] MXE: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:32:48.665432] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-09-15T19:32:48.665677] [DEBUG] [LOCAL ] MYD: Deleted primary data file. [2025-09-15T19:32:48.665068] [WARN ] [MAIN ] MX: Insufficient historical data. Have data from 2025-04-15, but need from 2025-02-10 for 150 day retention. Performing full refresh. [2025-09-15T19:32:48.666754] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-09-15T19:32:48.666895] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-09-15T19:32:48.682862] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-09-15T19:32:48.822135] [DEBUG] [LOCAL ] MX: Deleted primary data file. [2025-09-15T19:32:48.868917] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-09-15T19:32:49.246133] [INFO ] [REMOTE ] MXF: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:32:49.263146] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-15T19:32:49.279500] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-09-15T19:32:49.291166] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-09-15T19:32:49.557747] [INFO ] [REMOTE ] MYD: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:32:49.576862] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-09-15T19:32:49.669223] [INFO ] [REMOTE ] MX: Fetching primary data covering 150 trading days from 2025-02-10 to 2025-09-15 (requires 8 months of data pull). [2025-09-15T19:32:49.669577] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-09-15T19:32:49.678700] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-15T19:32:49.679744] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-09-15T19:32:50.035846] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-15T19:32:50.038108] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-09-15T19:32:50.090569] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-15T19:32:50.091630] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-09-15T19:32:50.348232] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-15T19:32:50.351722] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-09-15T19:32:50.426462] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-15T19:32:50.427465] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-09-15T19:32:50.521578] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-15T19:32:50.526156] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-09-15T19:32:50.752447] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-15T19:32:50.758635] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-15T19:32:50.857900] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-09-15T19:32:51.014234] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-15T19:32:51.257517] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-15T19:32:51.367103] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-15T19:32:51.657876] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-09-15T19:32:52.417780] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-15T19:32:52.457921] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-09-15T19:32:52.844834] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-15T19:32:53.257882] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-09-15T19:32:53.700543] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-15T19:32:54.057882] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-09-15T19:32:54.857896] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-09-15T19:32:55.027979] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-15T19:32:55.657845] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-09-15T19:32:55.673502] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-15T19:32:56.416986] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-15T19:32:56.457879] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-09-15T19:32:57.052709] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-15T19:32:57.257887] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-09-15T19:32:57.829811] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-15T19:32:58.057906] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-09-15T19:32:58.468496] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-15T19:32:58.857883] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-09-15T19:32:59.357798] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-15T19:32:59.358719] [INFO ] [REMOTE ] MXF: Full fetch complete (6984 records). [2025-09-15T19:32:59.358800] [DEBUG] [VA